Value Iteration-Based Cooperative Adaptive Optimal Control for Multi-Player Differential Games With Incomplete Information

This paper presents a novel cooperative value iteration(VI)-based adaptive dynamic programming method for multi-player differential game models with a convergence proof.The players are divided into two groups in the learning process and adapt their policies sequentially.Our method removes the dependence of admissible initial policies,which is one of the main drawbacks of the PI-based frameworks.Furthermore,this algorithm enables the players to adapt their control policies without full knowledge of others’ system parameters or control laws.The efficacy of our method is illustrated by three examples.

Fast and Accurate Predictor-Corrector Methods Using Feedback-Accelerated Picard Iteration for Strongly Nonlinear Problems

Although predictor-corrector methods have been extensively applied,they might not meet the requirements of practical applications and engineering tasks,particularly when high accuracy and efficiency are necessary.A novel class of correctors based on feedback-accelerated Picard iteration(FAPI)is proposed to further enhance computational performance.With optimal feedback terms that do not require inversion of matrices,significantly faster convergence speed and higher numerical accuracy are achieved by these correctors compared with their counterparts;however,the computational complexities are comparably low.These advantages enable nonlinear engineering problems to be solved quickly and accurately,even with rough initial guesses from elementary predictors.The proposed method offers flexibility,enabling the use of the generated correctors for either bulk processing of collocation nodes in a domain or successive corrections of a single node in a finite difference approach.In our method,the functional formulas of FAPI are discretized into numerical forms using the collocation approach.These collocated iteration formulas can directly solve nonlinear problems,but they may require significant computational resources because of the manipulation of high-dimensionalmatrices.To address this,the collocated iteration formulas are further converted into finite difference forms,enabling the design of lightweight predictor-corrector algorithms for real-time computation.The generality of the proposed method is illustrated by deriving new correctors for three commonly employed finite-difference approaches:the modified Euler approach,the Adams-Bashforth-Moulton approach,and the implicit Runge-Kutta approach.Subsequently,the updated approaches are tested in solving strongly nonlinear problems,including the Matthieu equation,the Duffing equation,and the low-earth-orbit tracking problem.The numerical findings confirm the computational accuracy and efficiency of the derived predictor-corrector algorithms.

Calculation of Mass Concrete Temperature Containing Cooling Water Pipe Based on Substructure and Iteration Algorithm

Mathematical physics equations are often utilized to describe physical phenomena in various fields of science and engineering.One such equation is the Fourier equation,which is a commonly used and effective method for evaluating the effectiveness of temperature control measures for mass concrete.One important measure for temperature control in mass concrete is the use of cooling water pipes.However,the mismatch of grids between large-scale concrete models and small-scale cooling pipe models can result in a significant waste of calculation time when using the finite element method.Moreover,the temperature of the water in the cooling pipe needs to be iteratively calculated during the thermal transfer process.The substructure method can effectively solve this problem,and it has been validated by scholars.The Abaqus/Python secondary development technology provides engineers with enough flexibility to combine the substructure method with an iteration algorithm,which enables the creation of a parametric modeling calculation for cooling water pipes.This paper proposes such a method,which involves iterating the water pipe boundary and establishing the water pipe unit substructure to numerically simulate the concrete temperature field that contains a cooling water pipe.To verify the feasibility and accuracy of the proposed method,two classic numerical examples were analyzed.The results showed that this method has good applicability in cooling pipe calculations.When the value of the iteration parameterαis 0.4,the boundary temperature of the cooling water pipes can meet the accuracy requirements after 4∼5 iterations,effectively improving the computational efficiency.Overall,this approach provides a useful tool for engineers to analyze the temperature control measures accurately and efficiently for mass concrete,such as cooling water pipes,using Abaqus/Python secondary development.

Policy Iteration for Optimal Control of Discrete-Time Time-Varying Nonlinear Systems

Aimed at infinite horizon optimal control problems of discrete time-varying nonlinear systems,in this paper,a new iterative adaptive dynamic programming algorithm,which is the discrete-time time-varying policy iteration(DTTV)algorithm,is developed.The iterative control law is designed to update the iterative value function which approximates the index function of optimal performance.The admissibility of the iterative control law is analyzed.The results show that the iterative value function is non-increasingly convergent to the Bellman-equation optimal solution.To implement the algorithm,neural networks are employed and a new implementation structure is established,which avoids solving the generalized Bellman equation in each iteration.Finally,the optimal control laws for torsional pendulum and inverted pendulum systems are obtained by using the DTTV policy iteration algorithm,where the mass and pendulum bar length are permitted to be time-varying parameters.The effectiveness of the developed method is illustrated by numerical results and comparisons.

A novel three-step implicit iteration process for threeΦ-hemicontractive mapping in the intermediate sense

In this paper,we introduce a three-step composite implicit iteration process for approximating the common fixed point of three uniformly continuous and asymptotically generalizedΦ-hemicontractive mappings in the intermediate sense.We prove that our proposed iteration process converges to the common fixed point of three finite family of asymptotically generalizedΦ-hemicontractive mappings in the intermediate sense.Our results extends,improves and complements several known results in literature.

A Novel Method to Enhance the Inversion Speed and Precision of the NMR T_(2) Spectrum by the TSVD Based Linearized Bregman Iteration

The low-field nuclear magnetic resonance(NMR)technique has been used to probe the pore size distribution and the fluid composition in geophysical prospecting and related fields.However,the speed and accuracy of the existing numerical inversion methods are still challenging due to the ill-posed nature of the first kind Fredholm integral equation and the contamination of the noises.This paper proposes a novel inversion algorithmto accelerate the convergence and enhance the precision using empirical truncated singular value decompositions(TSVD)and the linearized Bregman iteration.The L1 penalty term is applied to construct the objective function,and then the linearized Bregman iteration is utilized to obtain fast convergence.To reduce the complexity of the computation,empirical TSVD is proposed to compress the kernel matrix and determine the appropriate truncated position.This novel inversion method is validated using numerical simulations.The results indicate that the proposed novel method is significantly efficient and can achieve quick and effective data solutions with low signal-to-noise ratios.

Variational Iteration Method for Solving Time Fractional Burgers Equation Using Maple

The Time Fractional Burger equation was solved in this study using the Mabel software and the Variational Iteration approach. where a number of instances of the Time Fractional Burger Equation were handled using this technique. Tables and images were used to present the collected numerical results. The difference between the exact and numerical solutions demonstrates the effectiveness of the Mabel program’s solution, as well as the accuracy and closeness of the results this method produced. It also demonstrates the Mabel program’s ability to quickly and effectively produce the numerical solution.

Iteration dependent interval based open‐closed‐loop iterative learning control for time varying systems with vector relative degree

For linear time varying(LTV)multiple input multiple output(MIMO)systems with vector relative degree,an open‐closed‐loop iterative learning control(ILC)strategy is developed in this article,where the time interval of operation is iteration dependent.To compensate the missing tracking signal caused by iteration dependent interval,the feedback control is introduced in ILC design.As the tracking signal of many continuous iterations is lost in a certain interval,the feedback control part can employ the tracking signal of current iteration for compensation.Under the assumption that the initial state vibrates around the desired initial state uniformly in mathematical expectation sense,the expectation of ILC tracking error can converge to zero as the number of iteration tends to infinity.Under the circumstance that the initial state varies around the desired initial state with a bound,as the number of iteration tends to infinity,the expectation of ILC tracking error can be driven to a bounded range,whose upper bound is proportional to the fluctuation.It is revealed that the convergence condition is dependent on the feed-forward control gains,while the feedback control can accelerate convergence speed by selecting appropriate feedback control gains.As a special case,the controlled system with integrated high relative degree is also addressed by proposing a simplified iteration dependent interval based open‐closed‐loop ILC method.Finally,the effectiveness of the developed iteration dependent interval based open‐closed‐loop ILC is illustrated by a simulation example with two cases on initial state.

The Equivalence between the Mann and Ishikawa Iterations for Generalized Contraction Mappings in a Cone

In this paper, equivalence between the Mann and Ishikawa iterations for a generalized contraction mapping in cone subset of a real Banach space is discussed.

An Iteration Method Based on Homotopy Function for Solving Polynomial Systems and Application to Mechanisms Problems

A new iterating method based on homotopy function is developed in this paper. All solutions can be found easily without the need of choosing proper initial values. Compared to the homotopy continuation method, the solution process of the present method is simplified, and the computation efficiency as well as the reliability for obtaining all solutions is also improved. By application of the method to the mechanisms problems, the results are satisfactory.

New conditions of stability and convergence of Stokes and Newton iterations for Navier-Stokes equations

This paper considers Stokes and Newton iterations to solve stationary Navier- Stokes equations based on the finite element discretization. We obtain new sufficient conditions of stability and convergence for the two iterations. Specifically, when 0 〈 σ =N｜｜f｜｜-1/v2≤1/√2＋1 , the Stokes iteration is stable and convergent, where N is defined in the paper. When 0 〈 σ ≤5/11, the Newton iteration is stable and convergent. This work gives a more accurate admissible range of data for stability and convergence of the two schemes, which improves the previous results. A numerical test is given to verify the theory.

Variational iteration method for solving the mechanism of the Equatorial Eastern Pacific El Nino-Southern Oscillation

A class of coupled system for the E1 Nifio-Southern Oscillation （ENSO） mechanism is studied. Using the method of variational iteration for perturbation theory, the asymptotic expansions of the solution for ENSO model are obtained and the asymptotic behaviour of solution for corresponding problem is considered.

Variational iteration solving method for El Nio phenomenon atmospheric physics of nonlinear model

A class of E1 Niйo atmospheric physics oscillation model is considered. The E1 Niйo atmospheric physics oscillation is an abnormal phenomenon involved in the tropical Pacific ocean-atmosphere interactions. The conceptual oscillator model should consider the variations of both the eastern and western Pacific anomaly patterns. An E1 Niйo atmospheric physics model is proposed using a method for the variational iteration theory. Using the variational iteration method, the approximate expansions of the solution of corresponding problem are constructed. That is, firstly, introducing a set of functional and accounting their variationals, the Lagrange multiplicators are counted, and then the variational iteration is defined, finally, the approximate solution is obtained. From approximate expansions of the solution, the zonal sea surface temperature anomaly in the equatorial eastern Pacific and the thermocline depth anomaly of the sea-air oscillation for E1 Niйo atmospheric physics model can be analyzed. E1 Niйo is a very complicated natural phenomenon. Hence basic models need to be reduced for the sea-air oscillator and are solved. The variational iteration is a simple and valid approximate method.

Metamorphic Manipulating Mechanism Design for MCCB Using Index Reduced Iteration

The present research on moulded case circuit breaker（MCCB） focuses on the enhancement of current-limiting interrupting performance during short circuit, overload, under voltage and phase failure, involving electrics, magnetic, mechanics, thermal, material, friction, arc extinguishing, impact vibration, skin effect, etc. The rigid-flexible coupling of the parts and components of the metamorphic manipulating mechanism in multi-fields leads to the non-rigid, high frequency, high damping, singularity of the Euler-Lagrange equations which represents the multi-body dynamics. The small step iteration which is used for obtaining the instantaneous and short time critical interrupting performance of metamorphic mechanism appears inaccuracy. It is difficult to realize top-down design by existing CAD systems. Therefore, a metamorphic manipulating mechanism design method for MCCB using index reduced iteration（IRI） is put forward. The metamorphic manipulating mechanism of MCCB is decomposed into three mechanisms： main switch connector mechanism, electromagnet-drawbar-jump buckle mechanism, and bimetallic strip-drawbar mechanism, which is respectively described by electro-dynamic force, electromagnet force, and bimetallic strip force. The dummy part（virtual rigid） without moment of inertia and mass is employed as intermediate to join the flexible body and rigid body. The model of rigid-flexible coupling metamorphic mechanism multi-body dynamics is built. The differential algebraic equations（DAEs） of the multibody dynamics model are converted to pure ordinary differential equations（ODEs） by coordinate partition. Order reduced integration with multi-step and variable step-size is preceded based on IRI. The non-linear algebraic equations are solved in each integration step by Newton-Rapson iteration. There is no ill-condition and singularity of Jacobian matrix when step size reduces to zero. The independent prototype design system using ACIS R13, HOOPS V11.0 and Visual C＋＋.NET 2003 has been developed, which verifies the effectiveness of the proposed method. The proposed method enhances the current-limiting interrupting performance of MCCB, and has reference significance for multi-body dynamics design for similar flexible metamorphic mechanisms in multi-fields.

Low-Complexity Signal Detection Based on Relaxation Iteration Method in Massive MIMO Systems

Minimum mean square error(MMSE) detection algorithm can achieve nearly optimal performance when the number of antennas at the base station(BS) is large enough compared to the number of users. But the traditional MMSE involves complicated matrix inversion. In this paper, we propose a modified MMSE algorithm which exploits the channel characteristics occurring in massive multiple-input multipleoutput(MIMO) channels and the relaxation iteration(RI) method to avoid the matrix inversion. A proper initial solution is given to accelerate the convergence speed. In addition, we point out that the channel estimation scheme used in channel hardening-exploiting message passing(CHEMP) receiver is very appropriate for our proposed detection algorithm. Simulation results verify that the proposed algorithm can achieve very close performance of the traditional MMSE algorithm with a small number of iterations.

ON THE MONOTONE CONVERGENCE OF THE PROJECTED ITERATION METHODS FOR LINEAR COMPLEMENTARITY PROBLEMS

Under suitable conditions,the monotone convergence about the projected iteration method for solving linear complementarity problem is proved and the influence of the involved parameter matrix on the convergence rate of this method is investigated.

A New Multidimensional Time Series Forecasting Method Based on the EOF Iteration Scheme

In this paper a new .mnultidimensional time series forecasting scheme based on the empirical orthogonal function (EOF) stepwise iteration process is introduced. The scheme is tested in a series of forecast experiments of Nino3 SST anomalies and Tahiti-Darwin SO index. The results show that the scheme is feasible and ENSO predictable.

Design of quantum VQ iteration and quantum VQ encoding algorithm taking O（√N） steps for data compression

Vector quantization （VQ） is an important data compression method. The key of the encoding of VQ is to find the closest vector among N vectors for a feature vector. Many classical linear search algorithms take O（N） steps of distance computing between two vectors. The quantum VQ iteration and corresponding quantum VQ encoding algorithm that takes O（√N） steps are presented in this paper. The unitary operation of distance computing can be performed on a number of vectors simultaneously because the quantum state exists in a superposition of states. The quantum VQ iteration comprises three oracles, by contrast many quantum algorithms have only one oracle, such as Shor＇s factorization algorithm and Grover＇s algorithm. Entanglement state is generated and used, by contrast the state in Grover＇s algorithm is not an entanglement state. The quantum VQ iteration is a rotation over subspace, by contrast the Grover iteration is a rotation over global space. The quantum VQ iteration extends the Grover iteration to the more complex search that requires more oracles. The method of the quantum VQ iteration is universal.

Higher Order Aitken Extrapolation with Application to Converging and Diverging Gauss-Seidel Iterations

In this paper, Aitken’s extrapolation normally applied to convergent fixed point iteration is extended to extrapolate the solution of a divergent iteration. In addition, higher order Aitken extrapolation is introduced that enables successive decomposition of high Eigen values of the iteration matrix to enable convergence. While extrapolation of a convergent fixed point iteration using a geometric series sum is a known form of Aitken acceleration, it is shown that in this paper, the same formula can be used to estimate the solution of sets of linear equations from diverging Gauss-Seidel iterations. In both convergent and divergent iterations, the ratios of differences among the consecutive values of iteration eventually form a convergent (divergent) series with a factor equal to the largest Eigen value of the iteration matrix. Higher order Aitken extrapolation is shown to eliminate the influence of dominant Eigen values of the iteration matrix in successive order until the iteration is determined by the lowest possible Eigen values. For the convergent part of the Gauss-Seidel iteration, further acceleration is made possible by coupling of the extrapolation technique with the successive over relaxation (SOR) method. Application examples from both convergent and divergent iterations have been provided. Coupling of the extrapolation with the SOR technique is also illustrated for a steady state two dimensional heat flow problem which was solved using MATLAB programming.

A Unification of the Concepts of the Variational Iteration, Adomian Decomposition and Picard Iteration Methods;and a Local Variational Iteration Method

This paper compares the variational iteration method(VIM),the Adomian decomposition method(ADM)and the Picard iteration method(PIM)for solving a system of first o rder n onlinear o rdinary d ifferential e quations(ODEs).A unification of the concepts underlying these three methods is attempted by considering a very general iterative algorithm for VIM.It is found that all the three methods can be regarded as special cases of using a very general matrix of Lagrange multipliers in the iterative algorithm of VIM.The global variational iteration method is briefly reviewed,and further recast into a Local VIM,which is much more convenient and capable of predicting long term complex dynamic responses of nonlinear systems even if they are chaotic.