Fast and Accurate Predictor-Corrector Methods Using Feedback-Accelerated Picard Iteration for Strongly Nonlinear Problems

Although predictor-corrector methods have been extensively applied,they might not meet the requirements of practical applications and engineering tasks,particularly when high accuracy and efficiency are necessary.A novel class of correctors based on feedback-accelerated Picard iteration(FAPI)is proposed to further enhance computational performance.With optimal feedback terms that do not require inversion of matrices,significantly faster convergence speed and higher numerical accuracy are achieved by these correctors compared with their counterparts;however,the computational complexities are comparably low.These advantages enable nonlinear engineering problems to be solved quickly and accurately,even with rough initial guesses from elementary predictors.The proposed method offers flexibility,enabling the use of the generated correctors for either bulk processing of collocation nodes in a domain or successive corrections of a single node in a finite difference approach.In our method,the functional formulas of FAPI are discretized into numerical forms using the collocation approach.These collocated iteration formulas can directly solve nonlinear problems,but they may require significant computational resources because of the manipulation of high-dimensionalmatrices.To address this,the collocated iteration formulas are further converted into finite difference forms,enabling the design of lightweight predictor-corrector algorithms for real-time computation.The generality of the proposed method is illustrated by deriving new correctors for three commonly employed finite-difference approaches:the modified Euler approach,the Adams-Bashforth-Moulton approach,and the implicit Runge-Kutta approach.Subsequently,the updated approaches are tested in solving strongly nonlinear problems,including the Matthieu equation,the Duffing equation,and the low-earth-orbit tracking problem.The numerical findings confirm the computational accuracy and efficiency of the derived predictor-corrector algorithms.

A Full Predictor-Corrector Finite Element Method for the One-Dimensional Heat Equation with Time-Dependent Singularities

The energy norm convergence rate of the finite element solution of the heat equation is reduced by the time-regularity of the exact solution. This paper presents an adaptive finite element treatment of time-dependent singularities on the one-dimensional heat equation. The method is based on a Fourier decomposition of the solution and an extraction formula of the coefficients of the singularities coupled with a predictor-corrector algorithm. The method recovers the optimal convergence rate of the finite element method on a quasi-uniform mesh refinement. Numerical results are carried out to show the efficiency of the method.

Simulation of Steel Reinforcement on the Nonlinear Behaviour of Slender Glulam Beam Columns by Using the Newton-Raphson Method

The current theory in NF EN 1995-1-1/NA of Eurocode 5, which is based on maximum deflection, has been investigated on softwoods. Therefore, this theory is not adapted for slender glulam beam columns made of tropical hardwood species from the Congo Basin. This maximum deflection is caused by a set of loads applied to the structure. However, Eurocode 5 doesn’t provide how to predict this deflection in case of long-term load for such structures. This can be done by studying load-displacement (P-Δ) behaviour of these structures while taking into account second order effects. To reach this goal, a nonlinear analysis has been performed on a three-dimensional beam column embedded on both ends. Since conducting experimental investigations on large span structural products is time-consuming and expensive especially in developing countries, a numerical model has been implemented using the Newton-Raphson method to predict load-displacement (P-Δ) curve on a slender glulam beam column made of tropical hardwood species. On one hand, the beam has been analyzed without wood connection. On the other hand, the beam has been analyzed with a bolted wood connection and a slotted-in steel plate. The load cases considered include self-weight and a uniformly applied long-term load. Combinations of serviceability limit states (SLS) and ultimate limit states (ULS) have also been considered, among other factors. A finite-element software RFEM 5 has been used to implement the model. The results showed that the use of steel can reduce displacement by 20.96%. Additionally, compared to the maximum deflection provided by Eurocode 5 for softwoods, hardwoods can exhibit an increasing rate of 85.63%. By harnessing the plastic resistance of steel, the bending resistance of wood can be increased by 32.94%.

A Distributed Newton Method for Processing Signals Defined on the Large-Scale Networks

In the graph signal processing(GSP)framework,distributed algorithms are highly desirable in processing signals defined on large-scale networks.However,in most existing distributed algorithms,all nodes homogeneously perform the local computation,which calls for heavy computational and communication costs.Moreover,in many real-world networks,such as those with straggling nodes,the homogeneous manner may result in serious delay or even failure.To this end,we propose active network decomposition algorithms to select non-straggling nodes(normal nodes)that perform the main computation and communication across the network.To accommodate the decomposition in different kinds of networks,two different approaches are developed,one is centralized decomposition that leverages the adjacency of the network and the other is distributed decomposition that employs the indicator message transmission between neighboring nodes,which constitutes the main contribution of this paper.By incorporating the active decomposition scheme,a distributed Newton method is employed to solve the least squares problem in GSP,where the Hessian inverse is approximately evaluated by patching a series of inverses of local Hessian matrices each of which is governed by one normal node.The proposed algorithm inherits the fast convergence of the second-order algorithms while maintains low computational and communication cost.Numerical examples demonstrate the effectiveness of the proposed algorithm.

Numerical Methods for a Class of Quadratic Matrix Equations

Quadratic matrix equations arise in many elds of scienti c computing and engineering applications.In this paper,we consider a class of quadratic matrix equations.Under a certain condition,we rst prove the existence of minimal nonnegative solution for this quadratic matrix equation,and then propose some numerical methods for solving it.Convergence analysis and numerical examples are given to verify the theories and the numerical methods of this paper.

Rapid Springback Compensation for Age Forming Based on Quasi Newton Method

Iterative methods based on finite element simulation are effective approaches to design mold shape to compensate springback in sheet metal forming. However, convergence rate of iterative methods is difficult to improve greatly. To increase the springback compensate speed of designing age forming mold, process of calculating springback for a certain mold with finite element method is analyzed. Springback compensation is abstracted as finding a solution for a set of nonlinear functions and a springback compensation algorithm is presented on the basis of quasi Newton method. The accuracy of algorithm is verified by developing an ABAQUS secondary development program with MATLAB. Three rectangular integrated panels of dimensions 710 mmx750 mm integrated panels with intersected ribs of 10 mm are selected to perform case studies. The algorithm is used to compute mold contours for the panels with cylinder, sphere and saddle contours respectively and it takes 57%, 22% and 33% iterations as compared to that of displacement adjustment （DA） method. At the end of iterations, maximum deviations on the three panels are 0.618 4 mm, 0.624 1 mm and 0.342 0 mm that are smaller than the deviations determined by DA method （0.740 8 mm, 0.740 8 mm and 0.713 7 mm respectively）. In following experimental verification, mold contour for another integrated panel with 400 ram^380 mm size is designed by the algorithm. Then the panel is age formed in an autoclave and measured by a three dimensional digital measurement devise. Deviation between measuring results and the panel＇s design contour is less than 1 mm. Finally, the iterations with different mesh sizes （40 mm, 35 mm, 30 mm, 25 mm, 20 mm） in finite element models are compared and found no considerable difference. Another possible compensation method, Broyden-Fletcher-Shanmo method, is also presented based on the solving nonlinear fimctions idea. The Broyden-Fletcher-Shanmo method is employed to compute mold contour for the second panel. It only takes 50% iterations compared to that of DA. The proposed method can serve a faster mold contour compensation method for sheet metal forming.

A Fourth-order Covergence Newton-type Method

A fourth-order convergence method of solving roots for nonlinear equation, which is a variant of Newton＇s method given. Its convergence properties is proved. It is at least fourth-order convergence near simple roots and one order convergence near multiple roots. In the end, numerical tests are given and compared with other known Newton and Newton-type methods. The results show that the proposed method has some more advantages than others. It enriches the methods to find the roots of non-linear equations and it is important in both theory and application.

Numerical simulation of standing wave with 3D predictor-corrector finite difference method for potential flow equations

A three-dimensional （3D） predictor-corrector finite difference method for standing wave is developed. It is applied to solve the 3D nonlinear potential flow equa- tions with a free surface. The 3D irregular tank is mapped onto a fixed cubic tank through the proper coordinate transform schemes. The cubic tank is distributed by the staggered meshgrid, and the staggered meshgrid is used to denote the variables of the flow field. The predictor-corrector finite difference method is given to develop the difference equa- tions of the dynamic boundary equation and kinematic boundary equation. Experimental results show that, using the finite difference method of the predictor-corrector scheme, the numerical solutions agree well with the published results. The wave profiles of the standing wave with different amplitudes and wave lengths are studied. The numerical solutions are also analyzed and presented graphically.

A Smoothing Newton Method for the Box Constrained Variational Inequality Problems

The box constrained variational inequality problem can be reformulated as a nonsmooth equation by using median operator.In this paper,we present a smoothing Newton method for solving the box constrained variational inequality problem based on a new smoothing approximation function.The proposed algorithm is proved to be well defined and convergent globally under weaker conditions.

On Newton-Like Methods for Solving Nonlinear Equations

In this paper, we present a family of general New to n-like methods with a parametric function for finding a zero of a univariate fu nction, permitting f′(x)=0 in some points. The case of multiple roots is n ot treated. The methods are proved to be quadratically convergent provided the w eak condition. Thus the methods remove the severe condition f′(x)≠0. Based on the general form of the Newton-like methods, a family of new iterative meth ods with a variable parameter are developed.

New Predictor-Corrector Methods Based on Exponential Time Differencing forSystems of Nonlinear Differential Equations

We present the new predictor-corrector methods for systems of nonlinear differential equations, based on the method of exponential time differencing. We compare the present schemes with the explicit multistep exponential time differencing and Adams–Bashforth–Moulton method. The numerical results show that the schemes are more accurate and more efficient than Adams predictor-corrector method. The exponential time differencing method has been developed and perfected by the present studies.

3D magnetotelluric inversions with unstructured finite-element and limited-memory quasi-Newton methods

Traditional 3D Magnetotelluric(MT) forward modeling and inversions are mostly based on structured meshes that have limited accuracy when modeling undulating surfaces and arbitrary structures. By contrast, unstructured-grid-based methods can model complex underground structures with high accuracy and overcome the defects of traditional methods, such as the high computational cost for improving model accuracy and the difficulty of inverting with topography. In this paper, we used the limited-memory quasi-Newton(L-BFGS) method with an unstructured finite-element grid to perform 3D MT inversions. This method avoids explicitly calculating Hessian matrices, which greatly reduces the memory requirements. After the first iteration, the approximate inverse Hessian matrix well approximates the true one, and the Newton step(set to 1) can meet the sufficient descent condition. Only one calculation of the objective function and its gradient are needed for each iteration, which greatly improves its computational efficiency. This approach is well-suited for large-scale 3D MT inversions. We have tested our algorithm on data with and without topography, and the results matched the real models well. We can recommend performing inversions based on an unstructured finite-element method and the L-BFGS method for situations with topography and complex underground structures.

A Discrete Newton's Method for Gain Based Predistorter

Gain based predistorter (PD) is a highly effective and simple digital baseband predistorter which compensates for the nonlinear distortion of PAs. Lookup table (LUT) is the core of the gain based PD. This paper presents a discrete Newton’s method based adaptive technique to modify LUT. We simplify and convert the hardship of adaptive updating LUT to the roots finding problem for a system of two element real equations on athematics. And we deduce discrete Newton’s method based adaptive iterative formula used for updating LUT. The iterative formula of the proposed method is in real number field, but secant method previously published is in complex number field. So the proposed method reduces the number of real multiplications and is implemented with ease by hardware. Furthermore, computer simulation results verify gain based PD using discrete Newton’s method could rectify nonlinear distortion and improve system performance. Also, the simulation results reveal the proposed method reaches to the stable statement in fewer iteration times and less runtime than secant method.

Research on BP Neural Network Algorithm Based on Quasi- Newton Method

With more and more researches about improving BP algorithm, there are more improvement methods. The paper researches two improvement algorithms based on quasi-Newton method, DFP algorithm and L-BFGS algorithm. After fully analyzing the features of quasi- Newton methods, the paper improves BP neural network algorithm. And the adjustment is made for the problems in the improvement process. The paper makes empirical analysis and proves the effectiveness of BP neural network algorithm based on quasi-Newton method. The improved algorithms are compared with the traditional BP algorithm, which indicates that the imoroved BP algorithm is better.

Finite Volume Element Predictor-corrector Method for a Class of Nonlinear Parabolic Systems

A finite volume element predictor-corrector method for a class of nonlinear parabolic system of equations is presented and analyzed. Suboptimal L^2 error estimate for the finite volume element predictor-corrector method is derived. A numerical experiment shows that the numerical results are consistent with theoretical analysis.

Power System State Estimation Solution With Zero Injection Constraints Using Modified Newton Method and Fast Decoupled Method in Polar Coordinate

如何保证零注入节点的注入功率在状态估计结果中严格为0是电力系统状态估计研究中的重要问题。在直角坐标下,由于零注入约束为线性约束,可使用修正牛顿法来有效地解决这一问题。因此,借鉴直角坐标下修正牛顿法的思路,提出了极坐标下的修正牛顿法和修正快速解耦估计。这些方法的计算流程与传统的极坐标下的牛顿法和快速解耦估计非常相似,计算速度与大权重法相当,同时能够保证零注入约束严格满足。仿真结果验证了所得结论。

FPGA-based Acceleration of Davidon-Fletcher-Powell Quasi-Newton Optimization Method

Quasi-Newton methods are the most widely used methods to find local maxima and minima of functions in various engineering practices. However, they involve a large amount of matrix and vector operations, which are computationally intensive and require a long processing time. Recently, with the increasing density and arithmetic cores, field programmable gate array(FPGA) has become an attractive alternative to the acceleration of scientific computation. This paper aims to accelerate Davidon-Fletcher-Powell quasi-Newton(DFP-QN) method by proposing a customized and pipelined hardware implementation on FPGAs. Experimental results demonstrate that compared with a software implementation, a speed-up of up to 17 times can be achieved by the proposed hardware implementation.

GLOBAL COVERGENCE OF THE NON-QUASI-NEWTON METHOD FOR UNCONSTRAINED OPTIMIZATION PROBLEMS

In this paper, the non-quasi-Newton＇s family with inexact line search applied to unconstrained optimization problems is studied. A new update formula for non-quasi-Newton＇s family is proposed. It is proved that the constituted algorithm with either Wolfe-type or Armijotype line search converges globally and Q-superlinearly if the function to be minimized has Lipschitz continuous gradient.

CONVERGENCE OF INEXACT CONIC NEWTON METHODS

A conic Newton method is attractive because it converges to a local minimizzer rapidly from any sufficiently good initial guess. However, it may be expensive to solve the conic Newton equation at each iterate. In this paper we consider an inexact conic Newton method, which solves the couic Newton equation oldy approximately and in sonm unspecified manner. Furthermore, we show that such method is locally convergent and characterizes the order of convergence in terms of the rate of convergence of the relative residuals.

Modified Efficient Families of Two and Three-Step Predictor-Corrector Iterative Methods for Solving Nonlinear Equations

In this paper, we present and analyze modified families of predictor-corrector iterative methods for finding simple zeros of univariate nonlinear equations, permitting near the root. The main advantage of our methods is that they perform better and moreover, have the same efficiency indices as that of existing multipoint iterative methods. Furthermore, the convergence analysis of the new methods is discussed and several examples are given to illustrate their efficiency.