STOCHASTIC OPTIMAL CONTROL FOR THE RESPONSE OF QUASI NON-INTEGRABLE HAMILTONIAN SYSTEMS

A strategy is proposed based on the stochastic averaging method for quasi non- integrable Hamiltonian systems and the stochastic dynamical programming principle.The pro- posed strategy can be used to design nonlinear stochastic optimal control to minimize the response of quasi non-integrable Hamiltonian systems subject to Gaussian white noise excitation.By using the stochastic averaging method for quasi non-integrable Hamiltonian systems the equations of motion of a controlled quasi non-integrable Hamiltonian system is reduced to a one-dimensional av- eraged It stochastic differential equation.By using the stochastic dynamical programming princi- ple the dynamical programming equation for minimizing the response of the system is formulated. The optimal control law is derived from the dynamical programming equation and the bounded control constraints.The response of optimally controlled systems is predicted through solving the FPK equation associated with It stochastic differential equation.An example is worked out in detail to illustrate the application of the control strategy proposed.

STOCHASTIC HOPF BIFURCATION IN QUASIINTEGRABLE-HAMILTONIAN SYSTEMS

A new procedure is developed to study the stochastic Hopf bifurcation in quasi- integrable-Hamiltonian systems under the Gaussian white noise excitation.Firstly,the singular bound- aries of the first-class and their asymptotic stable conditions in probability are given for the averaged Ito differential equations about all the sub-system's energy levels with respect to the stochastic aver- aging method.Secondly,the stochastic Hopf bifurcation for the coupled sub-systems are discussed by defining a suitable bounded torus region in the space of the energy levels and employing the theory of the torus region when the singular boundaries turn into the unstable ones.Lastly,a quasi-integrable- Hamiltonian system with two degrees of freedom is studied in detail to illustrate the above procedure. Moreover,simulations by the Monte-Carlo method are performed for the illustrative example to verify the proposed procedure.It is shown that the attenuation motions and the stochastic Hopf bifurcation of two oscillators and the stochastic Hopf bifurcation of a single oscillator may occur in the system for some system's parameters.Therefore,one can see that the numerical results are consistent with the theoretical predictions.

FIRST-PASSAGE TIME OF QUASI-NON-INTEGRABLE-HAMILTONIAN SYSTEM

Studies on first-passage failure are extended to the multi-degree-of-freedom quasi-non-integrable-Hamiltonian systems under parametric excitations of Gaussian white noises in this paper. By the stochastic averaging method of energy envelope, the system's energy can be modeled as a one-dimensional approximate diffusion process by which the classical Pontryagin equation with suitable boundary conditions is applicable to analyzing the statistical moments of the first-passage time of an arbitrary order. An example is studied in detail and some numerical results are given to illustrate the above procedure.

Some applications of stochastic averaging method for quasi Hamiltonian systems in physics

Many physical systems can be modeled as quasi-Hamiltonian systems and the stochastic averaging method for quasi-Hamiltonian systems can be applied to yield reasonable approximate response sta-tistics.In the present paper,the basic idea and procedure of the stochastic averaging method for quasi Hamiltonian systems are briefly introduced.The applications of the stochastic averaging method in studying the dynamics of active Brownian particles,the reaction rate theory,the dynamics of breathing and denaturation of DNA,and the Fermi resonance and its effect on the mean transition time are reviewed.

Energy diffusion controlled reaction rate in dissipative Hamiltonian systems

In this paper the energy diffusion controlled reaction rate in dissipative Hamiltonian systems is investigated by using the stochastic averaging method for quasi Hamiltonian systems. The boundary value problem of mean first- passage time （MFPT） of averaged system is formulated and the energy diffusion controlled reaction rate is obtained as the inverse of MFPT. The energy diffusion controlled reaction rate in the classical Kramers bistable potential and in a two-dimensional bistable potential with a heat bath are obtained by using the proposed approach respectively. The obtained results are then compared with those from Monte Carlo simulation of original systems and from the classical Kraraers theory. It is shown that the reaction rate obtained by using the proposed approach agrees well with that from Monte Carlo simulation and is more accurate than the classical Kramers rate.

Time-delayed feedback control optimization for quasi linear systems under random excitations

A strategy for time-delayed feedback control optimization of quasi linear systems with random excitation is proposed. First, the stochastic averaging method is used to reduce the dimension of the state space and to derive the stationary response of the system. Secondly, the control law is assumed to be velocity feedback control with time delay and the unknown control gains are determined by the performance indices. The response of the controlled system is predicted through solving the Fokker-Plank-Kolmogorov equation associated with the averaged Ito equation. Finally, numerical examples are used to illustrate the proposed control method, and the numerical results are confirmed by Monte Carlo simulation .

Stochastic averaging of quasi partially integrable Hamiltonian systems under fractional Gaussian noise

A stochastic averaging method for predicting the response of quasi partially integrable and non-resonant Hamiltoniansystems to fractional Gaussian noise （fGla） with the Hurst index 1/2〈H〈l is proposed. The averaged stochastic differential equa-tions （SDEs） for the first integrals of the associated Hamiltonian system are derived. The dimension of averaged SDEs is less thanthat of the original system. The stationary probability density and statistics of the original system are obtained approximately fromsolving the averaged SDEs numerically. Two systems are worked out to illustrate the proposed stochastic averaging method. It isshown that the results obtained by using the proposed stochastic averaging method and those from digital simulation of originalsystem agree well, and the computational time for the former results is less than that for the latter ones.

Stochastic averaging of quasi-Hamiltonian systems

A stochastic averaging method is proposed for quasi-Hamiltonian systems (Hamiltonian systems with light dampings subject to weakly stochastic excitations). Various versions of the method, depending on whether the associated Hamiltonian systems are integrable or nonintegrable, resonant or nonresonant, are discussed. It is pointed out that the standard stochastic averaging method and the stochastic averaging method of energy envelope are special cases of the stochastic averaging method of quasi-Hamiltonian systems and that the results obtained by this method for several examples prove its effectiveness.

Stochastic averaging of quasi integrable and resonant Hamiltonian systems excited by fractional Gaussian noise with Hurst index 1/2

A stochastic averaging method of quasi integrable and resonant Hamiltonian systems under excitation of fractional Gaussian noise （fGn） with the Hurst index 1/2 〈 H 〈 1 is proposed. First, the definition and the basic property of fGn and related fractional Brownian motion （iBm） are briefly introduced. Then, the averaged fractional stochastic differential equations （SDEs） for the first integrals and combinations of angle variables of the associated Hamiltonian systems are derived. The stationary probability density and statistics of the original systems are then obtained approximately by simulating the averaged SDEs numerically. An example is worked out to illustrate the proposed stochastic averaging method. It is shown that the results obtained by using the proposed stochastic averaging method and those from digital simulation of original system agree well.

Stochastic response of van der Pol oscillator with two kinds of fractional derivatives under Gaussian white noise excitation

This paper aims to investigate the stochastic response of the van der Pol （VDP） oscillator with two kinds of fractional derivatives under Gaussian white noise excitation. First, the fractional VDP oscillator is replaced by an equivalent VDP oscillator without fractional derivative terms by using the generalized harmonic balance technique. Then, the stochastic averaging method is applied to the equivalent VDP oscillator to obtain the analytical solution. Finally, the analytical solutions are validated by numerical results from the Monte Carlo simulation of the original fractional VDP oscillator. The numerical results not only demonstrate the accuracy of the proposed approach but also show that the fractional order, the fractional coefficient and the intensity of Gaussian white noise play important roles in the responses of the fractional VDP oscillator. An interesting phenomenon we found is that the effects of the fractional order of two kinds of fractional derivative items on the fractional stochastic systems are totally contrary.

Stochastic response of fractional-order van der Pol oscillator

We studied the response of fractional-order van de Pol oscillator to Gaussian white noise excitation in this letter. An equivalent integral-order nonlinear stochastic system is obtained to replace the given system based on the principle of minimum mean-square error. Through stochastic averaging, an averaged Ito equation is deduced. We obtained the Fokker–Planck–Kolmogorov equation connected to the averaged Ito equation and solved it to yield the approximate stationary response of the system. The analytical solution is confirmed by using Monte Carlo simulation.

NOISE-INDUCED CHAOTIC MOTIONS IN HAMILTONIAN SYSTEMS WITH SLOW-VARYING PARAMETERS

This paper studies chaotic motions in quasi-integrable Hamiltonian systems with slow-varying parameters under both harmonic and noise excitations. Based on the dynamic theory and some assumptions of excited noises, an extended form of the stochastic Melnikov method is presented. Using this extended method, the homoclinic bifurcations and chaotic behavior of a nonlinear Hamiltonian system with weak feed-back control under both harmonic and Gaussian white noise excitations are analyzed in detail. It is shown that the addition of stochastic excitations can make the parameter threshold value for the occurrence of chaotic motions vary in a wider region. Therefore, chaotic motions may arise easily in the system. By the Monte-Carlo method, the numerical results for the time-history and the maximum Lyapunov exponents of an example system are finally given to illustrate that the presented method is effective.

Stochastic optimal control of partially observable nonlinear quasi-integrable Hamiltonian systems

The stochastic optimal control of partially observable nonlinear quasi-integrable Hamiltonian systems is investigated. First, the stochastic optimal control problem of a partially observable nonlinear quasi-integrable Hamiltonian system is converted into that of a completely observable linear system based on a theorem due to Charalambous and Elliot. Then, the converted stochastic optimal control problem is solved by applying the stochastic averaging method and the stochastic dynamical programming principle. The response of the controlled quasi Hamiltonian system is predicted by solving the averaged Fokker-Planck-Kolmogorov equation and the Riccati equation for the estimated error of system states. As an example to illustrate the procedure and effectiveness of the proposed method, the stochastic optimal control problem of a partially observable two-degree-of-freedom quasi-integrable Hamiltonian system is worked out in detail.

宽带噪声激励下碰撞摩擦系统的随机响应和稳定性的研究

研究了宽带噪声激励下碰撞摩擦系统的随机响应和概率为1渐近稳定性.基于非光滑变换和随机平均法得到了碰撞摩擦系统响应的稳态概率密度,并通过与Monte Carlo数值模拟结果对比,验证了上述解析方法的有效性.讨论了摩擦力和碰撞恢复系数对系统稳态概率密度的影响.基于平均Itô微分方程,得到其线性化方程的最大Lyapunov指数的表达式,通过Lyapunov指数确定系统平凡解的稳定性.结果表明,改变碰撞恢复系数和摩擦系数能调整系统的随机稳定性.

宽带噪声激励下分数阶黏弹性碰撞系统的稳定性分析和随机分岔

研究基于分数阶黏弹性材料构造的Van der pol减振系统在外部宽带噪声激励下的随机稳定性和随机分岔行为.考虑约束条件的影响,引入非平滑Zhuravlev变换,将碰撞系统转化为无碰撞的动力学系统.利用一组拟周期函数近似替换分数阶微分,通过随机平均法得到系统的It8随机微分方程,根据最大Lyapunov指数法和奇异边界理论分类讨论系统的随机稳定性,利用拟Hamilton系统随机平均法分析系统在线性It8方程下的随机分岔行为,得到D-分岔的临界条件,进一步求出与系统幅值相关的稳态概率密度函数.使用MATLAB绘制稳态概率密度曲线,直观展现系统发生的稳态变化.结果表明,当分数阶阶次和噪声强度在一定阈值内变化时,可诱导系统产生P-分岔行为.

饱和非线性光学介质中带折射率项的薛定谔方程的数值模拟

首先将带折射率项的非线性薛定谔方程转化成无限维哈密尔顿系统,证明了方程的质量和能量守恒特性;再利用傅里叶拟谱方法和平均向量场方法离散方程,对离散格式中非积分项采用Boole离散进行线积分近似,得到了离散方程的能量守恒数值格式,同时给出了方程的辛格式;然后以不同振幅的入射双曲正割型光脉冲为初值条件,模拟了保能量格式和辛格式在不同参数条件下光孤子的演化过程.最后分析了不同初始光脉冲和参数对光孤子传输的影响和保方程质量和能量守恒特性.

Optimal nonlinear feedback control of quasi-Hamiltonian systems

An innovative strategy for optimal nonlinear feedback control of linear or nonlinear stochastic dynamic systems is proposed based on the stochastic averaging method for quasi-Hamiltonian systems and stochastic dynamic programming principle. Feedback control forces of a system are divided into conservative parts and dissipative parts. The conservative parts are so selected that the energy distribution in the controlled system is as requested as possible. Then the response of the system with known conservative control forces is reduced to a controlled diffusion process by using the stochastic averaging method. The dissipative parts of control forces are obtained from solving the stochastic dynamic programming equation.

Compensation for time-delayed feedback bang-bang control of quasi-integrable Hamiltonian systems

The stochastic averaging method for quasi-integrable Hamiltonian systems with time-delayed feedback bang-bang control is first introduced. Then, two time delay compensation methods, namely the method of changing control force amplitude (CFA) and the method of changing control delay time (CDT), are proposed. The conditions applicable to each compensation method are discussed. Finally, an example is worked out in detail to illustrate the application and effectiveness of the proposed methods and the two compensation methods in combination.

Optimization of time-delayed feedback control of seismically excited building structures

An optimization method for time-delayed feedback control of partially observable linear building structures subjected to seismic excitation is proposed. A time-delayed control problem of partially observable linear building structure under horizontal ground acceleration excitation is formulated and converted into that of completely observable linear structure by using separation principle. The time-delayed control forces are approximately expressed in terms of control forces without time delay. The control system is then governed by Itoe stochastic differential equations for the conditional means of system states and then transformed into those for the conditional means of modal energies by using the stochastic averaging method for quasi-Hamiltonian systems. The control law is assumed to be modal velocity feedback control with time delay and the unknown control gains are determined by the modal performance indices. A three-storey building structure is taken as example to illustrate the proposal method and the numerical results are confirmed by using Monte Carlo simulation.

Resonance response of a single-degree-of-freedom nonlinear vibro-impact system to a narrow-band random parametric excitation

The resonant response of a single-degree-of-freedom nonlinear vibro-impact oscillator with a one-sided barrier to a narrow-band random parametric excitation is investigated. The narrow-band random excitation used here is a bounded random noise. The analysis is based on a special Zhuravlev transformation, which reduces the system to one without impacts, thereby permitting the applications of random averaging over ＂fast＂ variables. The averaged equations are solved exactly and an algebraic equation of the amplitude of the response is obtained for the ease without random disorder. The methods of linearization and moment are used to obtain the formula of the mean-square amplitude approximately for the case with random disorder. The effects of damping, detuning, restitution factor, nonlinear intensity, frequency and magnitude of random excitations are analysed. The theoretical analyses are verified by numerical results. Theoretical analyses and numerical simulations show that the peak response amplitudes will reduce at large damping or large nonlinear intensity and will increase with large amplitude or frequency of the random excitations. The phenomenon of stochastic jump is observed, that is, the steady-state response of the system will jump from a trivial solution to a large non-trivial one when the amplitude of the random excitation exceeds some threshold value, or will jump from a large non-trivial solution to a trivial one when the intensity of the random disorder of the random excitation exceeds some threshold value.