一种估计人工神经网络泛化误差的新方法

A New Method to Estimate the Generalization Error of Artificial Neural Network

神经网络的结构学习就是要确定网络的拓扑 ,使之有较好的泛化能力 .本文考虑了确定性前向网络 ,而其训练集合是随机点集的结构学习问题 .文章定义了一种新的结构学习目标函数 ,给出了它与目前常用的目标函数比较的优越性 ,讨论了相关的学习算法 。

The constructional learning is used to determine the architecture of neural network such that the network holds a satisfactory generalization. This paper considers the constructional learning in the case where the training set is randomly chosen from an input output space. A new objective function of constructional learning is presented. It is illustrated the reason why this objective function is superior to other functions. The learning algorithm for this objective function is also analyzed. Finally, a simulation example is given to show the efficiency of the method presented in this paper.