Let SFd and ∏φ,n,d ={∑j^n=1bjφ（wj.x＋θj）：bj,θj∈R,wj∈R^d} be the set of periodic and Lebesgue＇s square-integrable functions and the set of feedforward neural network （FNN） functions, respectively. Denote ...Let SFd and ∏φ,n,d ={∑j^n=1bjφ（wj.x＋θj）：bj,θj∈R,wj∈R^d} be the set of periodic and Lebesgue＇s square-integrable functions and the set of feedforward neural network （FNN） functions, respectively. Denote by dist （SFd , ∏φ,n,d） the deviation of the set SFd from the set ∏φ,n,d. A main purpose of this paper is to estimate the deviation. In particular, based on the Fourier transforms and the theory of approximation, a lower estimation for dist （SFd and ∏φ,n,d） is proved. That is, dist（SFd and ∏φ,n,d） ≥C/（nlog2n）1/2. The obtained estimation depends only on the number of neuron in the hidden layer, and is independent of the approximated target functions and dimensional number of input. This estimation also reveals the relationship between the approximation rate of FNNs and the topology structure of hidden layer.展开更多
基金Supported by the National Natural Science Foundation of China (Grant No. 60873206)the National Basic Research Program of China(Grant No. 2007CB311002)
文摘Let SFd and ∏φ,n,d ={∑j^n=1bjφ（wj.x＋θj）：bj,θj∈R,wj∈R^d} be the set of periodic and Lebesgue＇s square-integrable functions and the set of feedforward neural network （FNN） functions, respectively. Denote by dist （SFd , ∏φ,n,d） the deviation of the set SFd from the set ∏φ,n,d. A main purpose of this paper is to estimate the deviation. In particular, based on the Fourier transforms and the theory of approximation, a lower estimation for dist （SFd and ∏φ,n,d） is proved. That is, dist（SFd and ∏φ,n,d） ≥C/（nlog2n）1/2. The obtained estimation depends only on the number of neuron in the hidden layer, and is independent of the approximated target functions and dimensional number of input. This estimation also reveals the relationship between the approximation rate of FNNs and the topology structure of hidden layer.
