ITERATIVE REGULARIZATION METHODS FOR NONLINEAR ILL-POSED OPERATOR EQUATIONS WITH M-ACCRETIVE MAPPINGS IN BANACH SPACES

In this paper, a modified Newton type iterative method is considered for ap- proximately solving ill-posed nonlinear operator equations involving m-accretive mappings in Banach space. Convergence rate of the method is obtained based on an a priori choice of the regularization parameter. Our analysis is not based on the sequential continuity of the normalized duality mapping.

Downward continuation of airborne geomagnetic data based on two iterative regularization methods in the frequency domain

Downward continuation is a key step in processing airborne geomagnetic data. However,downward continuation is a typically ill-posed problem because its computation is unstable; thus, regularization methods are needed to realize effective continuation. According to the Poisson integral plane approximate relationship between observation and continuation data, the computation formulae combined with the fast Fourier transform（FFT）algorithm are transformed to a frequency domain for accelerating the computational speed. The iterative Tikhonov regularization method and the iterative Landweber regularization method are used in this paper to overcome instability and improve the precision of the results. The availability of these two iterative regularization methods in the frequency domain is validated by simulated geomagnetic data, and the continuation results show good precision.

New regularization method and iteratively reweighted algorithm for sparse vector recovery

Motivated by the study of regularization for sparse problems,we propose a new regularization method for sparse vector recovery.We derive sufficient conditions on the well-posedness of the new regularization,and design an iterative algorithm,namely the iteratively reweighted algorithm(IR-algorithm),for efficiently computing the sparse solutions to the proposed regularization model.The convergence of the IR-algorithm and the setting of the regularization parameters are analyzed at length.Finally,we present numerical examples to illustrate the features of the new regularization and algorithm.

Solving Severely Ill⁃Posed Linear Systems with Time Discretization Based Iterative Regularization Methods

Recently,inverse problems have attracted more and more attention in computational mathematics and become increasingly important in engineering applications.After the discretization,many of inverse problems are reduced to linear systems.Due to the typical ill-posedness of inverse problems,the reduced linear systems are often illposed,especially when their scales are large.This brings great computational difficulty.Particularly,a small perturbation in the right side of an ill-posed linear system may cause a dramatical change in the solution.Therefore,regularization methods should be adopted for stable solutions.In this paper,a new class of accelerated iterative regularization methods is applied to solve this kind of large-scale ill-posed linear systems.An iterative scheme becomes a regularization method only when the iteration is early terminated.And a Morozov’s discrepancy principle is applied for the stop criterion.Compared with the conventional Landweber iteration,the new methods have acceleration effect,and can be compared to the well-known acceleratedν-method and Nesterov method.From the numerical results,it is observed that using appropriate discretization schemes,the proposed methods even have better behavior when comparing withν-method and Nesterov method.

Two-level Bregmanized method for image interpolation with graph regularized sparse coding

A two-level Bregmanized method with graph regularized sparse coding （TBGSC） is presented for image interpolation. The outer-level Bregman iterative procedure enforces the observation data constraints, while the inner-level Bregmanized method devotes to dictionary updating and sparse represention of small overlapping image patches. The introduced constraint of graph regularized sparse coding can capture local image features effectively, and consequently enables accurate reconstruction from highly undersampled partial data. Furthermore, modified sparse coding and simple dictionary updating applied in the inner minimization make the proposed algorithm converge within a relatively small number of iterations. Experimental results demonstrate that the proposed algorithm can effectively reconstruct images and it outperforms the current state-of-the-art approaches in terms of visual comparisons and quantitative measures.

ON THE BREAKDOWNS OF THE GALERKIN AND LEAST-SQUARES METHODS

The Galerkin and least-squares methods are two classes of the most popular Krylov subspace methOds for solving large linear systems of equations. Unfortunately, both the methods may suffer from serious breakdowns of the same type: In a breakdown situation the Galerkin method is unable to calculate an approximate solution, while the least-squares method, although does not really break down, is unsucessful in reducing the norm of its residual. In this paper we first establish a unified theorem which gives a relationship between breakdowns in the two methods. We further illustrate theoretically and experimentally that if the coefficient matrix of a lienar system is of high defectiveness with the associated eigenvalues less than 1, then the restarted Galerkin and least-squares methods will be in great risks of complete breakdowns. It appears that our findings may help to understand phenomena observed practically and to derive treatments for breakdowns of this type.

Graph Regularized Sparse Coding Method for Highly Undersampled MRI Reconstruction

The imaging speed is a bottleneck for magnetic resonance imaging( MRI) since it appears. To alleviate this difficulty,a novel graph regularized sparse coding method for highly undersampled MRI reconstruction( GSCMRI) was proposed. The graph regularized sparse coding showed the potential in maintaining the geometrical information of the data. In this study, it was incorporated with two-level Bregman iterative procedure that updated the data term in outer-level and learned dictionary in innerlevel. Moreover,the graph regularized sparse coding and simple dictionary updating stages derived by the inner minimization made the proposed algorithm converge in few iterations, meanwhile achieving superior reconstruction performance. Extensive experimental results have demonstrated GSCMRI can consistently recover both real-valued MR images and complex-valued MR data efficiently,and outperform the current state-of-the-art approaches in terms of higher PSNR and lower HFEN values.

A meshless method for the nonlinear generalized regularized long wave equation

This paper presents a meshless method for the nonlinear generalized regularized long wave （GRLW） equation based on the moving least-squares approximation. The nonlinear discrete scheme of the GRLW equation is obtained and is solved using the iteration method. A theorem on the convergence of the iterative process is presented and proved using theorems of the infinity norm. Compared with numerical methods based on mesh, the meshless method for the GRLW equation only requires the.scattered nodes instead of meshing the domain of the problem. Some examples, such as the propagation of single soliton and the interaction of two solitary waves, are given to show the effectiveness of the meshless method.

Two-Level Bregman Method for MRI Reconstruction with Graph Regularized Sparse Coding

In this paper, a two-level Bregman method is presented with graph regularized sparse coding for highly undersampled magnetic resonance image reconstruction. The graph regularized sparse coding is incorporated with the two-level Bregman iterative procedure which enforces the sampled data constraints in the outer level and updates dictionary and sparse representation in the inner level. Graph regularized sparse coding and simple dictionary updating applied in the inner minimization make the proposed algorithm converge with a relatively small number of iterations. Experimental results demonstrate that the proposed algorithm can consistently reconstruct both simulated MR images and real MR data efficiently, and outperforms the current state-of-the-art approaches in terms of visual comparisons and quantitative measures.

Multilevel Iteration Methods for Solving Linear Operator Equations of the First Kind

In this paper we develop two multilevel iteration methods for solving linear systems resulting from the Galerkin method and Tikhonov regularization for linear ill-posed problems. The two algorithms and their convergence analyses are presented in an abstract framework.

MULTILEVEL ITERATION METHODS FOR SOLVING LINEAR ILL-POSED PROBLEMS

In this paper we develop multilevel iteration methods for solving linear systems resulting from the Galerkin method and Tikhonov regularization for ill-posed problems. The algorithm and its convergence analysis are presented in an abstract framework.

Weighted Nuclear Norm Minimization-Based Regularization Method for Image Restoration

Regularization methods have been substantially applied in image restoration due to the ill-posedness of the image restoration problem.Different assumptions or priors on images are applied in the construction of image regularization methods.In recent years,matrix low-rank approximation has been successfully introduced in the image denoising problem and significant denoising effects have been achieved.Low-rank matrix minimization is an NP-hard problem and it is often replaced with the matrix’s weighted nuclear norm minimization(WNNM).The assumption that an image contains an extensive amount of self-similarity is the basis for the construction of the matrix low-rank approximation-based image denoising method.In this paper,we develop a model for image restoration using the sum of block matching matrices’weighted nuclear norm to be the regularization term in the cost function.An alternating iterative algorithm is designed to solve the proposed model and the convergence analyses of the algorithm are also presented.Numerical experiments show that the proposed method can recover the images much better than the existing regularization methods in terms of both recovered quantities and visual qualities.

Optimization of Random Feature Method in the High-Precision Regime

Machine learning has been widely used for solving partial differential equations(PDEs)in recent years,among which the random feature method(RFM)exhibits spectral accuracy and can compete with traditional solvers in terms of both accuracy and efficiency.Potentially,the optimization problem in the RFM is more difficult to solve than those that arise in traditional methods.Unlike the broader machine-learning research,which frequently targets tasks within the low-precision regime,our study focuses on the high-precision regime crucial for solving PDEs.In this work,we study this problem from the following aspects:(i)we analyze the coeffcient matrix that arises in the RFM by studying the distribution of singular values;(ii)we investigate whether the continuous training causes the overfitting issue;(ii)we test direct and iterative methods as well as randomized methods for solving the optimization problem.Based on these results,we find that direct methods are superior to other methods if memory is not an issue,while iterative methods typically have low accuracy and can be improved by preconditioning to some extent.

Least-Squares Solutions of Generalized Sylvester Equation with Xi Satisfies Different Linear Constraint

In this paper, an iterative method is constructed to find the least-squares solutions of generalized Sylvester equation , where is real matrices group, and satisfies different linear constraint. By this iterative method, for any initial matrix group within a special constrained matrix set, a least squares solution group with satisfying different linear constraint can be obtained within finite iteration steps in the absence of round off errors, and the unique least norm least-squares solution can be obtained by choosing a special kind of initial matrix group. In addition, a minimization property of this iterative method is characterized. Finally, numerical experiments are reported to show the efficiency of the proposed method.

Alternating minimization for data-driven computational elasticity from experimental data: kernel method for learning constitutive manifold

Data-driven computing in elasticity attempts to directly use experimental data on material,without constructing an empirical model of the constitutive relation,to predict an equilibrium state of a structure subjected to a specified external load.Provided that a data set comprising stress-strain pairs of material is available,a data-driven method using the kernel method and the regularized least-squares was developed to extract a manifold on which the points in the data set approximately lie(Kanno 2021,Jpn.J.Ind.Appl.Math.).From the perspective of physical experiments,stress field cannot be directly measured,while displacement and force fields are measurable.In this study,we extend the previous kernel method to the situation that pairs of displacement and force,instead of pairs of stress and strain,are available as an input data set.A new regularized least-squares problem is formulated in this problem setting,and an alternating minimization algorithm is proposed to solve the problem.

大型离散不适定问题的广义G-K双对角正则化算法

不适定问题常常出现于科学和工程等诸多领域,求解此类问题的难点在于其解对扰动的高度敏感性。正则化方法由于用与原不适定问题相邻近的适定问题的解逼近原问题的解,成为求解不适定问题的一类有效算法。近来,用不同范数分别约束保真项和正则项的极小化模型求解不适定问题的正则化方法引起了广泛关注。本文针对大型离散不适定问题的不同范数约束优化模型,基于Majorization-Minimization优化算法和Golub-Kahan Lanczos双对角化过程,采用基于偏差原理的正则化参数选择策略,提出了一种求解大型离散不适定问题的广义Golub-Kahan双对角化正则化算法,并给出了所提算法的收敛性理论证明。本文对新算法进行了数值实验,并与已有算法进行了比较,数值结果表明所提算法与已有算法相比在计算效能等方面更具优势;新算法应用到图像恢复问题的算例验证了新算法在图像恢复应用中的实用性和有效性。新算法由于其更低迭代运算和更高计算效率而更具吸引力。

Landweber iterative regularization for nearfield acoustic holography

On the basis of the distributed source boundary point method (DSBPM)-based nearfield acoustic holography (NAH), Landweber iterative regularization method is proposed to stabilize the NAH reconstruction process, control the influence of measurement errors on the reconstructed results and ensure the validity of the reconstructed results. And a new method, the auxiliary surface method, is pro- posed to determine the optimal iterative number for optimizing the regularization effect. Here, the optimal number is determined by minimizing the relative error between the calculated pressure on the auxiliary surface corresponding to each iterative number and the measured pressure. An experiment on a speaker is investigated to demonstrate the high sensitivity of the reconstructed results to measurement errors and to validate the chosen method of the optimal iterative number and the Landweber iterative regularization method for controlling the influence of measurement errors on the reconstructed results.

磁流体方程全局吸引子的正则性

本文考虑磁流体方程的长时间行为,研究其全局吸引子的正则性。首先,利用分数次空间的嵌入定理和全局吸引子的存在性定理分别得到该方程在空间H 1和H 2中存在全局吸引子;然后,利用迭代方法、线性算子半群的正则性理论和全局吸引子的存在性定理,证明该方程在任意Sobolev空间H^(k)(其中k≥0)中存在全局吸引子,并以H^(k)-范数吸引空间H^(k)中的任意有界集。

一类二次矩阵方程的解

对一类源于马尔可夫链的带噪Wiener-Hopf问题的二次矩阵方程进行了研究,证明了当方程中的系数矩阵是正则M-矩阵时,方程仍然存在M-矩阵解,并通过几个数值例子对理论结果进行了验证。

基于反问题的正则化波束形成改进算法

基于反问题的正则化波束形成技术能以较高的计算效率得到稳健的声源识别结果。然而由于其正则化解中的正则化矩阵取决于低效的传统波束形成方法,使得基于反问题的正则化波束形成的声源识别结果精准度较低。为了在低信噪比环境下进一步提升其声源识别性能,基于Tikhonov正则化一般形式解提出一种双重迭代优化算法。该算法基于延时求和波束形成算法与互谱运算构造出新的正则化矩阵,并结合迭代方法对新正则化矩阵和波束输出进行优化,最终以较少的迭代步数经两次迭代运算有效提高了声源识别精度和稳定性。最后,通过数值仿真和实验算例,进一步验证了双重迭代优化算法的可行性和有效性。