摘要
Though efforts on the quantification of information started several decades earlier,the foundations of information theoretic studies were laid during the middle and late 1940’s,from two perspectives that both based on probability theory.The most famous one is a systematic theory from a perspective of information transmission over a noisy channel,namely the information theory developed by Claude E.Shannon[1].