构成信息理论体系的关键物理量及其相互关系

Basic concepts of information theory and their mutual relations

指出了构成信息理论体系的关键物理量:熵、互信息、信道容量和信息率失真函数,对它们的定义、物理意义及相互关系进行了探讨,用这些物理量导出信息理论体系,得到与这些物理量相对应的基本编码定理,即无失真信源编码定理、信道编码定理和限失真信源编码定理。

The information and information theory are becoming more and more valuable and significant. This paper indicates basic concepts of information theory, and its definitions, physical meanings and their mutual relations are discussed briefly. At the end of this article, the architecture of information theory is put forward from the basic concepts, and the coding theorems are pointed out as well. The coding theorems include: source coding theorem, distortion-free source coding theorem and channel coding theorem.