The present article gives an introduction to information geometry and surveys its applications in the area of machine learning,optimization and statistical inference.Information geometry is explained intuitively by us...The present article gives an introduction to information geometry and surveys its applications in the area of machine learning,optimization and statistical inference.Information geometry is explained intuitively by using divergence functions introduced in a manifold of probability distributions and other general manifolds.They give a Riemannian structure together with a pair of dual flatness criteria.Many manifolds are dually flat.When a manifold is dually flat,a generalized Pythagorean theorem and related projection theorem are introduced.They provide useful means for various approximation and optimization problems.We apply them to alternative minimization problems,Ying-Yang machines and belief propagation algorithm in machine learning.展开更多
文摘The present article gives an introduction to information geometry and surveys its applications in the area of machine learning,optimization and statistical inference.Information geometry is explained intuitively by using divergence functions introduced in a manifold of probability distributions and other general manifolds.They give a Riemannian structure together with a pair of dual flatness criteria.Many manifolds are dually flat.When a manifold is dually flat,a generalized Pythagorean theorem and related projection theorem are introduced.They provide useful means for various approximation and optimization problems.We apply them to alternative minimization problems,Ying-Yang machines and belief propagation algorithm in machine learning.
