We extend two adaptive step-size methods for solving two-dimensional or multi-dimensional generalized nonlinear Schr ¨odinger equation(GNLSE): one is the conservation quantity error adaptive step-control method(R...We extend two adaptive step-size methods for solving two-dimensional or multi-dimensional generalized nonlinear Schr ¨odinger equation(GNLSE): one is the conservation quantity error adaptive step-control method(RK4IP-CQE), and the other is the local error adaptive step-control method(RK4IP-LEM). The methods are developed in the vector form of fourthorder Runge–Kutta iterative scheme in the interaction picture by converting a vector equation in frequency domain. By simulating the supercontinuum generated from the high birefringence photonic crystal fiber, the calculation accuracies and the efficiencies of the two adaptive step-size methods are discussed. The simulation results show that the two methods have the same global average error, while RK4IP-LEM spends more time than RK4IP-CQE. The decrease of huge calculation time is due to the differences in the convergences of the relative photon number error and the approximated local error between these two adaptive step-size algorithms.展开更多
The step-size procedure is very important for solving optimization problems. The Armijo step-size rule, the Armijo-Goldstein step-size rule and the Wolfe-Powell step-size rule are three well-known line search methods....The step-size procedure is very important for solving optimization problems. The Armijo step-size rule, the Armijo-Goldstein step-size rule and the Wolfe-Powell step-size rule are three well-known line search methods. On the basis of the above three types of line search methods and the idea of the proximal point methods, a new class of step-size rules was proposed. Instead of a single objective function f, f +1/2(x - xk)^TBk(x-Xk) was used as the merit function in iteration k, where Sk is a given symmetric positive definite matrix. The existence of the steplength for the new rules was proved. Some convergence properties were also discussed.展开更多
We present a new least-mean-square algorithm of adaptive filtering to improve the signal to noise ratio for magneto-cardiography data collected with high-temperature SQUID-based magnetometers. By frequently adjusting ...We present a new least-mean-square algorithm of adaptive filtering to improve the signal to noise ratio for magneto-cardiography data collected with high-temperature SQUID-based magnetometers. By frequently adjusting the adaptive parameter a go systematic optimum values in the course of the programmed procedure, the convergence is accelerated with a highest speed and the minimum steady-state error is obtained simultaneously. This algorithm may be applied to eliminate other non-steady relevant noises as well.展开更多
This paper proposes a robust adaptive filter based on the exponent sin cost to improve the capability against Gaussian or multiple types of non-Gaussian noises of the adaptive filtering algorithm when dealing with tim...This paper proposes a robust adaptive filter based on the exponent sin cost to improve the capability against Gaussian or multiple types of non-Gaussian noises of the adaptive filtering algorithm when dealing with time-varying/time-invariant linear systems function exponent sin(ExpSin).Then a variable step-size(VSS)-ExpSin algorithm is extended further.Besides,the stepsize,the convergence,and the steady-state performance of the proposed algorithm are validated experimentally.The Monte Carlo simulation results of linear system identification illustrate the principle and efficiency of this proposed adaptive filtering algorithm.Results suggest that the proposed adaptive filtering algorithm has superior performance when estimating the unknown linear systems under multiple-types measurement noises.展开更多
To solve the contradiction between convergence rate and steady-state error in least mean square (LMS) algorithm, basing on independence assumption, this paper proposes and proves the optimal step-size theorem from the...To solve the contradiction between convergence rate and steady-state error in least mean square (LMS) algorithm, basing on independence assumption, this paper proposes and proves the optimal step-size theorem from the view of minimizing mean squared error (MSE). The theorem reveals the one-to-one mapping between the optimal step-size and MSE. Following the theorem, optimal variable step-size LMS (OVS-LMS) model, describing the theoretical bound of the convergence rate of LMS algorithm, is constructed. Then we discuss the selection of initial optimal step-size and updating of optimal step-size at the time of unknown system changing. At last an optimal step-size LMS algorithm is proposed and tested in various environments. Simulation results show the proposed algorithm is very close to the theoretical bound.展开更多
In this paper, a new step-size skill for a projection and contraction method([10]) for linear programming is generalized to an iterative method([22]) for solving nonlinear projection equation. For linear programming, ...In this paper, a new step-size skill for a projection and contraction method([10]) for linear programming is generalized to an iterative method([22]) for solving nonlinear projection equation. For linear programming, our scheme is the same as that of([10]). For complementarity problem and related problems, we give an improved algorithm by considering the new step-size skill and ALGORITHM B discussed in [22]. Numerical results are provided.展开更多
Implicit-explicit (IMEX) linear multistep methods are popular techniques for solving partial differential equations (PDEs) with terms of different types. While fixed timestep versions of such schemes have been dev...Implicit-explicit (IMEX) linear multistep methods are popular techniques for solving partial differential equations (PDEs) with terms of different types. While fixed timestep versions of such schemes have been developed and studied, implicit-explicit schemes also naturally arise in general situations where the temporal smoothness of the solution changes. In this paper we consider easily implementable variable step-size implicit-explicit (VSIMEX) linear multistep methods for time-dependent PDEs. Families of order-p, pstep VSIMEX schemes are constructed and analyzed, where p ranges from 1 to 4. The corresponding schemes are simple to implement and have the property that they reduce to the classical IMEX schemes whenever constant time step-sizes are imposed. The methods are validated on the Burgers' equation. These results demonstrate that by varying the time step-size, VSIMEX methods can outperform their fixed time step counterparts while still maintaining good numerical behavior.展开更多
Non-uniform step-size distribution is implemented for split-step based nonlinear compensation in singlechannel 112-Gb/s 16 quadrature amplitude modulation (QAM) transmission. Numerical simulations of the system incl...Non-uniform step-size distribution is implemented for split-step based nonlinear compensation in singlechannel 112-Gb/s 16 quadrature amplitude modulation (QAM) transmission. Numerical simulations of the system including a 20 × 80 km uncompensated link are performed using logarithmic step size distribution to compensate signal distortions. 50% of reduction in number of steps with respect to using constant step sizes is observed. The performance is further improved by optimizing nonlinear calculating position (NLCP) in case of using constant step sizes while NLCP optimization becomes unnecessary when using logarithmic step sizes, which reduces the computational effort due to uniformly distributed nonlinear phase for all successive steps.展开更多
This work is devoted to asymptotic properties of a sign-error adaptive filtering algorithm with constant step size. Under much weaker conditions than those that appear in the literature, we obtain convergence and rate...This work is devoted to asymptotic properties of a sign-error adaptive filtering algorithm with constant step size. Under much weaker conditions than those that appear in the literature, we obtain convergence and rate of convergence by using weak convergence methods. An example is provided to demonstrate the performance of the algorithm.展开更多
最大功率点跟踪技术(Maximum Power Point Tracking, MPPT)是光伏发电系统中关键技术研究的热点之一。针对传统扰动观察法跟踪速度和精度无法兼顾的问题,文中提出了一种以功率变化量为步长控制量的自适应变步长扰动观察法,通过判断功率...最大功率点跟踪技术(Maximum Power Point Tracking, MPPT)是光伏发电系统中关键技术研究的热点之一。针对传统扰动观察法跟踪速度和精度无法兼顾的问题,文中提出了一种以功率变化量为步长控制量的自适应变步长扰动观察法,通过判断功率变化趋势,对远离最大功率点,采用大步长逼近;靠近最大功率点,采用小步长逼近。建立太阳能光伏电池数学模型得到其输出特性曲线,再利用MATLAB/Simulink搭建基于Boost电路的MPPT仿真模型,最后经仿真验证了所提出算法的稳定性、快速性和准确性,它比传统算法具有更好的MPPT暂态性能。展开更多
为改善滤波-x最小均方(filtered-x least mean square,FxLMS)算法在噪声主动控制时无法兼顾收敛速度和稳态误差的问题,提出了基于sigmoid-sinh分段函数的FxLMS(SSFxLMS)算法,并引入蚁狮算法对SFxLMS(sigmoid filtered-x least mean squa...为改善滤波-x最小均方(filtered-x least mean square,FxLMS)算法在噪声主动控制时无法兼顾收敛速度和稳态误差的问题,提出了基于sigmoid-sinh分段函数的FxLMS(SSFxLMS)算法,并引入蚁狮算法对SFxLMS(sigmoid filtered-x least mean square)、ShFxLMS(sinh filtered-x least mean square)、SSFxLMS算法的参数进行优化。分别采用高斯白噪声和实测簇绒地毯织机噪声为输入信号,采用FxLMS、SFxLMS、ShFxLMS、SSFxLMS算法进行噪声主动控制仿真,对比分析这4种算法的性能。结果表明:与其他3种算法相比,采用SSFxLMS算法对高斯白噪声和簇绒地毯织机噪声进行控制时,误差信号的平均绝对值更小,平均降噪量与收敛速度也有大幅度提升。由此可知,SSFxLMS算法有效改善了FxLMS算法无法兼顾收敛速度和稳态误差的问题,研究结果为噪声主动控制算法设计提供了一定的参考。展开更多
当前对抗训练(AT)及其变体被证明是防御对抗攻击的最有效方法,但生成对抗样本的过程需要庞大的计算资源,导致模型训练效率低、可行性不强;快速AT(Fast-AT)使用单步对抗攻击代替多步对抗攻击加速训练过程,但模型鲁棒性远低于多步AT方法...当前对抗训练(AT)及其变体被证明是防御对抗攻击的最有效方法,但生成对抗样本的过程需要庞大的计算资源,导致模型训练效率低、可行性不强;快速AT(Fast-AT)使用单步对抗攻击代替多步对抗攻击加速训练过程,但模型鲁棒性远低于多步AT方法且容易发生灾难性过拟合(CO)。针对这些问题,提出一种基于随机噪声和自适应步长的Fast-AT方法。首先,在生成对抗样本的每次迭代中,通过对原始输入图像添加随机噪声增强数据;其次,累积训练过程中每个对抗样本的梯度,并根据梯度信息自适应地调整对抗样本的扰动步长;最后,根据步长和梯度进行对抗攻击,生成对抗样本用于模型训练。在CIFAR-10、CIFAR-100数据集上进行多种对抗攻击,相较于N-FGSM(Noise Fast Gradient Sign Method),所提方法在鲁棒准确率上取得了至少0.35个百分点的提升。实验结果表明,所提方法能避免Fast-AT中的CO问题,提高深度学习模型的鲁棒性。展开更多
基金supported by the National Key Research and Development Program of China (Grant Nos. 2021YFC2201803 and 2020YFC2200104)。
文摘We extend two adaptive step-size methods for solving two-dimensional or multi-dimensional generalized nonlinear Schr ¨odinger equation(GNLSE): one is the conservation quantity error adaptive step-control method(RK4IP-CQE), and the other is the local error adaptive step-control method(RK4IP-LEM). The methods are developed in the vector form of fourthorder Runge–Kutta iterative scheme in the interaction picture by converting a vector equation in frequency domain. By simulating the supercontinuum generated from the high birefringence photonic crystal fiber, the calculation accuracies and the efficiencies of the two adaptive step-size methods are discussed. The simulation results show that the two methods have the same global average error, while RK4IP-LEM spends more time than RK4IP-CQE. The decrease of huge calculation time is due to the differences in the convergences of the relative photon number error and the approximated local error between these two adaptive step-size algorithms.
基金Project supported by the National Natural Science Foundation of China(Grant No.10161002), and the Natural Science Foundation of Guangxi Province (Grant No.0135004)
文摘The step-size procedure is very important for solving optimization problems. The Armijo step-size rule, the Armijo-Goldstein step-size rule and the Wolfe-Powell step-size rule are three well-known line search methods. On the basis of the above three types of line search methods and the idea of the proximal point methods, a new class of step-size rules was proposed. Instead of a single objective function f, f +1/2(x - xk)^TBk(x-Xk) was used as the merit function in iteration k, where Sk is a given symmetric positive definite matrix. The existence of the steplength for the new rules was proved. Some convergence properties were also discussed.
文摘We present a new least-mean-square algorithm of adaptive filtering to improve the signal to noise ratio for magneto-cardiography data collected with high-temperature SQUID-based magnetometers. By frequently adjusting the adaptive parameter a go systematic optimum values in the course of the programmed procedure, the convergence is accelerated with a highest speed and the minimum steady-state error is obtained simultaneously. This algorithm may be applied to eliminate other non-steady relevant noises as well.
文摘This paper proposes a robust adaptive filter based on the exponent sin cost to improve the capability against Gaussian or multiple types of non-Gaussian noises of the adaptive filtering algorithm when dealing with time-varying/time-invariant linear systems function exponent sin(ExpSin).Then a variable step-size(VSS)-ExpSin algorithm is extended further.Besides,the stepsize,the convergence,and the steady-state performance of the proposed algorithm are validated experimentally.The Monte Carlo simulation results of linear system identification illustrate the principle and efficiency of this proposed adaptive filtering algorithm.Results suggest that the proposed adaptive filtering algorithm has superior performance when estimating the unknown linear systems under multiple-types measurement noises.
基金This work was supported in part by the National Fundamental Research Program(Grant No.G1998030406)the National Natural Science Foundation of China(Grant No.69972020)by the State Key Lab on Microwave and Digital Communications,Department of Electronics Engineering,Tsinghua University.
文摘To solve the contradiction between convergence rate and steady-state error in least mean square (LMS) algorithm, basing on independence assumption, this paper proposes and proves the optimal step-size theorem from the view of minimizing mean squared error (MSE). The theorem reveals the one-to-one mapping between the optimal step-size and MSE. Following the theorem, optimal variable step-size LMS (OVS-LMS) model, describing the theoretical bound of the convergence rate of LMS algorithm, is constructed. Then we discuss the selection of initial optimal step-size and updating of optimal step-size at the time of unknown system changing. At last an optimal step-size LMS algorithm is proposed and tested in various environments. Simulation results show the proposed algorithm is very close to the theoretical bound.
文摘In this paper, a new step-size skill for a projection and contraction method([10]) for linear programming is generalized to an iterative method([22]) for solving nonlinear projection equation. For linear programming, our scheme is the same as that of([10]). For complementarity problem and related problems, we give an improved algorithm by considering the new step-size skill and ALGORITHM B discussed in [22]. Numerical results are provided.
基金supported by an NSERC Canada Postgraduate Scholarshipsupported by a grant from NSERC Canada
文摘Implicit-explicit (IMEX) linear multistep methods are popular techniques for solving partial differential equations (PDEs) with terms of different types. While fixed timestep versions of such schemes have been developed and studied, implicit-explicit schemes also naturally arise in general situations where the temporal smoothness of the solution changes. In this paper we consider easily implementable variable step-size implicit-explicit (VSIMEX) linear multistep methods for time-dependent PDEs. Families of order-p, pstep VSIMEX schemes are constructed and analyzed, where p ranges from 1 to 4. The corresponding schemes are simple to implement and have the property that they reduce to the classical IMEX schemes whenever constant time step-sizes are imposed. The methods are validated on the Burgers' equation. These results demonstrate that by varying the time step-size, VSIMEX methods can outperform their fixed time step counterparts while still maintaining good numerical behavior.
基金funding of the Erlangen Graduate School in Advanced Optical Technologies (SAOT) by the German National Science Foundation(DFG) in the framework of the excellence initiative
文摘Non-uniform step-size distribution is implemented for split-step based nonlinear compensation in singlechannel 112-Gb/s 16 quadrature amplitude modulation (QAM) transmission. Numerical simulations of the system including a 20 × 80 km uncompensated link are performed using logarithmic step size distribution to compensate signal distortions. 50% of reduction in number of steps with respect to using constant step sizes is observed. The performance is further improved by optimizing nonlinear calculating position (NLCP) in case of using constant step sizes while NLCP optimization becomes unnecessary when using logarithmic step sizes, which reduces the computational effort due to uniformly distributed nonlinear phase for all successive steps.
基金The first author was supported in part by the National Science Foundation of USA(Grant No. DMS-9877090), and the second author was supported in part by the National Key Project of China and the National Natural Science Foundation of China.
文摘This work is devoted to asymptotic properties of a sign-error adaptive filtering algorithm with constant step size. Under much weaker conditions than those that appear in the literature, we obtain convergence and rate of convergence by using weak convergence methods. An example is provided to demonstrate the performance of the algorithm.
文摘最大功率点跟踪技术(Maximum Power Point Tracking, MPPT)是光伏发电系统中关键技术研究的热点之一。针对传统扰动观察法跟踪速度和精度无法兼顾的问题,文中提出了一种以功率变化量为步长控制量的自适应变步长扰动观察法,通过判断功率变化趋势,对远离最大功率点,采用大步长逼近;靠近最大功率点,采用小步长逼近。建立太阳能光伏电池数学模型得到其输出特性曲线,再利用MATLAB/Simulink搭建基于Boost电路的MPPT仿真模型,最后经仿真验证了所提出算法的稳定性、快速性和准确性,它比传统算法具有更好的MPPT暂态性能。
文摘为改善滤波-x最小均方(filtered-x least mean square,FxLMS)算法在噪声主动控制时无法兼顾收敛速度和稳态误差的问题,提出了基于sigmoid-sinh分段函数的FxLMS(SSFxLMS)算法,并引入蚁狮算法对SFxLMS(sigmoid filtered-x least mean square)、ShFxLMS(sinh filtered-x least mean square)、SSFxLMS算法的参数进行优化。分别采用高斯白噪声和实测簇绒地毯织机噪声为输入信号,采用FxLMS、SFxLMS、ShFxLMS、SSFxLMS算法进行噪声主动控制仿真,对比分析这4种算法的性能。结果表明:与其他3种算法相比,采用SSFxLMS算法对高斯白噪声和簇绒地毯织机噪声进行控制时,误差信号的平均绝对值更小,平均降噪量与收敛速度也有大幅度提升。由此可知,SSFxLMS算法有效改善了FxLMS算法无法兼顾收敛速度和稳态误差的问题,研究结果为噪声主动控制算法设计提供了一定的参考。
文摘当前对抗训练(AT)及其变体被证明是防御对抗攻击的最有效方法,但生成对抗样本的过程需要庞大的计算资源,导致模型训练效率低、可行性不强;快速AT(Fast-AT)使用单步对抗攻击代替多步对抗攻击加速训练过程,但模型鲁棒性远低于多步AT方法且容易发生灾难性过拟合(CO)。针对这些问题,提出一种基于随机噪声和自适应步长的Fast-AT方法。首先,在生成对抗样本的每次迭代中,通过对原始输入图像添加随机噪声增强数据;其次,累积训练过程中每个对抗样本的梯度,并根据梯度信息自适应地调整对抗样本的扰动步长;最后,根据步长和梯度进行对抗攻击,生成对抗样本用于模型训练。在CIFAR-10、CIFAR-100数据集上进行多种对抗攻击,相较于N-FGSM(Noise Fast Gradient Sign Method),所提方法在鲁棒准确率上取得了至少0.35个百分点的提升。实验结果表明,所提方法能避免Fast-AT中的CO问题,提高深度学习模型的鲁棒性。