神经网络结构动态优化设计的分析与展望

Dynamic optimization structure design for neural networks: review and perspective

阐述了神经网络结构设计对神经网络性能的影响.介绍了动态结构神经网络,尤其是增长型和修剪型神经网络研究的发展过程,分析了动态设计方法研究在计算能力、学习理论和网络的稳定性等方面取得的成果.最后对神经网络动态设计的研究进行总结,给出了神经网络结构动态设计研究的发展趋势.

The influence of the structure design to the capabilities of neural networks is discussed in this paper. The development history of the dynamic structure neural networks, especially the growing and the pruning neural networks are introduced. The substantial results on the computing capabilities, learning theories, stability of neural networks are then analyzed. Finally, the research on the dynamic optimization structure design is summarized and several views are put forward.