Image reconstruction based on total-variation minimization and alternating direction method in linear scan computed tomography

Linear scan computed tomography （LCT） is of great benefit to online industrial scanning and security inspection due to its characteristics of straight-line source trajectory and high scanning speed. However, in practical applications of LCT, there are challenges to image reconstruction due to limited-angle and insufficient data. In this paper, a new reconstruction algorithm based on total-variation （TV） minimization is developed to reconstruct images from limited-angle and insufficient data in LCT. The main idea of our approach is to reformulate a TV problem as a linear equality constrained problem where the objective function is separable, and then minimize its augmented Lagrangian function by using alternating direction method （ADM） to solve subproblems. The proposed method is robust and efficient in the task of reconstruction by showing the convergence of ADM. The numerical simulations and real data reconstructions show that the proposed reconstruction method brings reasonable performance and outperforms some previous ones when applied to an LCT imaging problem.

Reconstruction of electrical capacitance tomography images based on fast linearized alternating direction method of multipliers for two-phase flow system

Electrical capacitance tomography(ECT)has been applied to two-phase flow measurement in recent years.Image reconstruction algorithms play an important role in the successful applications of ECT.To solve the ill-posed and nonlinear inverse problem of ECT image reconstruction,a new ECT image reconstruction method based on fast linearized alternating direction method of multipliers(FLADMM)is proposed in this paper.On the basis of theoretical analysis of compressed sensing(CS),the data acquisition of ECT is regarded as a linear measurement process of permittivity distribution signal of pipe section.A new measurement matrix is designed and L1 regularization method is used to convert ECT inverse problem to a convex relaxation problem which contains prior knowledge.A new fast alternating direction method of multipliers which contained linearized idea is employed to minimize the objective function.Simulation data and experimental results indicate that compared with other methods,the quality and speed of reconstructed images are markedly improved.Also,the dynamic experimental results indicate that the proposed algorithm can ful fill the real-time requirement of ECT systems in the application.

Alternating Direction Finite Volume Element Methods for Three-Dimensional Parabolic Equations

This paper presents alternating direction finite volume element methods for three-dimensional parabolic partial differential equations and gives four computational schemes, one is analogous to Douglas finite difference scheme with second-order splitting error, the other two schemes have third-order splitting error, and the last one is an extended LOD scheme. The L2 norm and H1 semi-norm error estimates are obtained for the first scheme and second one, respectively. Finally, two numerical examples are provided to illustrate the efficiency and accuracy of the methods.

Linearized Proximal Alternating Direction Method of Multipliers for Parallel Magnetic Resonance Imaging

In this study, we propose a linearized proximal alternating direction method with variable stepsize for solving total variation image reconstruction problems. Our method uses a linearized technique and the proximal function such that the closed form solutions of the subproblem can be easily derived.In the subproblem, we apply a variable stepsize, that is like Barzilai-Borwein stepsize, to accelerate the algorithm. Numerical results with parallel magnetic resonance imaging demonstrate the efficiency of the proposed algorithm.

Distributed MPC for Reconfigurable Architecture Systems via Alternating Direction Method of Multipliers

This paper investigates the distributed model predictive control(MPC)problem of linear systems where the network topology is changeable by the way of inserting new subsystems,disconnecting existing subsystems,or merely modifying the couplings between different subsystems.To equip live systems with a quick response ability when modifying network topology,while keeping a satisfactory dynamic performance,a novel reconfiguration control scheme based on the alternating direction method of multipliers(ADMM)is presented.In this scheme,the local controllers directly influenced by the structure realignment are redesigned in the reconfiguration control.Meanwhile,by employing the powerful ADMM algorithm,the iterative formulas for solving the reconfigured optimization problem are obtained,which significantly accelerate the computation speed and ensure a timely output of the reconfigured optimal control response.Ultimately,the presented reconfiguration scheme is applied to the level control of a benchmark four-tank plant to illustrate its effectiveness and main characteristics.

Distributed Alternating Direction Method of Multipliers for Multi-Objective Optimization

In this paper, a distributed algorithm is proposed to solve a kind of multi-objective optimization problem based on the alternating direction method of multipliers. Compared with the centralized algorithms, this algorithm does not need a central node. Therefore, it has the characteristics of low communication burden and high privacy. In addition, numerical experiments are provided to validate the effectiveness of the proposed algorithm.

Fully Distributed Learning for Deep Random Vector Functional-Link Networks

In the contemporary era, the proliferation of information technology has led to an unprecedented surge in data generation, with this data being dispersed across a multitude of mobile devices. Facing these situations and the training of deep learning model that needs great computing power support, the distributed algorithm that can carry out multi-party joint modeling has attracted everyone’s attention. The distributed training mode relieves the huge pressure of centralized model on computer computing power and communication. However, most distributed algorithms currently work in a master-slave mode, often including a central server for coordination, which to some extent will cause communication pressure, data leakage, privacy violations and other issues. To solve these problems, a decentralized fully distributed algorithm based on deep random weight neural network is proposed. The algorithm decomposes the original objective function into several sub-problems under consistency constraints, combines the decentralized average consensus (DAC) and alternating direction method of multipliers (ADMM), and achieves the goal of joint modeling and training through local calculation and communication of each node. Finally, we compare the proposed decentralized algorithm with several centralized deep neural networks with random weights, and experimental results demonstrate the effectiveness of the proposed algorithm.

Continuous-time System Identification with Nuclear Norm Minimization and GPMF-based Subspace Method

To improve the accuracy and effectiveness of continuous-time(CT) system identification, this paper introduces a novel method that incorporates the nuclear norm minimization(NNM) with the generalized Poisson moment functional(GPMF)based subspace method. The GPMF algorithm provides a simple linear mapping for subspace identification without the timederivatives of the input and output measurements to avoid amplification of measurement noise, and the NNM is a heuristic convex relaxation of the rank minimization. The Hankel matrix with minimized nuclear norm is used to determine the model order and to avoid the over-parameterization in subspace identification method(SIM). Furthermore, the algorithm to solve the NNM problem in CT case is also deduced with alternating direction methods of multipliers(ADMM). Lastly, two numerical examples are presented to evaluate the performance of the proposed method and to show the advantages of the proposed method over the existing methods.

Two-stage ADMM-based distributed optimal reactive power control method for wind farms considering wake effects

Since the connection of small-scale wind farms to distribution networks,power grid voltage stability has been reduced with increasing wind penetration in recent years,owing to the variable reactive power consumption of wind generators.In this study,a two-stage reactive power optimization method based on the alternating direction method of multipliers(ADMM)algorithm is proposed for achieving optimal reactive power dispatch in wind farm-integrated distribution systems.Unlike existing optimal reactive power control methods,the proposed method enables distributed reactive power flow optimization with a two-stage optimization structure.Furthermore,under the partition concept,the consensus protocol is not needed to solve the optimization problems.In this method,the influence of the wake effect of each wind turbine is also considered in the control design.Simulation results for a mid-voltage distribution system based on MATLAB verified the effectiveness of the proposed method.

Crank-Nicolson ADI Galerkin Finite Element Methods for Two Classes of Riesz Space Fractional Partial Differential Equations

In this paper,two classes of Riesz space fractional partial differential equations including space-fractional and space-time-fractional ones are considered.These two models can be regarded as the generalization of the classical wave equation in two space dimensions.Combining with the Crank-Nicolson method in temporal direction,efficient alternating direction implicit Galerkin finite element methods for solving these two fractional models are developed,respectively.The corresponding stability and convergence analysis of the numerical methods are discussed.Numerical results are provided to verify the theoretical analysis.

Graph Regularized Sparse Coding Method for Highly Undersampled MRI Reconstruction

The imaging speed is a bottleneck for magnetic resonance imaging( MRI) since it appears. To alleviate this difficulty,a novel graph regularized sparse coding method for highly undersampled MRI reconstruction( GSCMRI) was proposed. The graph regularized sparse coding showed the potential in maintaining the geometrical information of the data. In this study, it was incorporated with two-level Bregman iterative procedure that updated the data term in outer-level and learned dictionary in innerlevel. Moreover,the graph regularized sparse coding and simple dictionary updating stages derived by the inner minimization made the proposed algorithm converge in few iterations, meanwhile achieving superior reconstruction performance. Extensive experimental results have demonstrated GSCMRI can consistently recover both real-valued MR images and complex-valued MR data efficiently,and outperform the current state-of-the-art approaches in terms of higher PSNR and lower HFEN values.

High accuracy compact finite difference methods and their applications

Numerical simulation of complex flow fields with multi-scale structures is one of the most important and challenging branches of computational fluid dynamics. From linear analysis and numerical experiments it has been discovered that the higher-order accurate method can give reliable and efficient computational results, as well as better resolution of the complex flow fields with multi-scale structures. Compact finite difference schemes, which feature higher-order accuracy and spectral-like resolution with smaller stencils and easier application of boundary conditions, has attracted more and more interest and attention.

AN ADI GALERKIN METHOD WITH MOVING FINITE ELEMENT SPACES FOR A CLASS OF SECOND-ORDER HYPERBOLIC EQUATIONS

An alternating direction implicit (ADI) Galerkin method with moving finite element spaces is formulated for a class of second order hyperbolic equations in two space variables. A priori H 1 error estimate is derived.

An ADI Finite Volume Element Method for a Viscous Wave Equation with Variable Coefficients

Based on rectangular partition and bilinear interpolation,we construct an alternating-direction implicit(ADI)finite volume element method,which combined the merits of finite volume element method and alternating direction implicit method to solve a viscous wave equation with variable coefficients.This paper presents a general procedure to construct the alternating-direction implicit finite volume element method and gives computational schemes.Optimal error estimate in L2 norm is obtained for the schemes.Compared with the finite volume element method of the same convergence order,our method is more effective in terms of running time with the increasing of the computing scale.Numerical experiments are presented to show the efficiency of our method and numerical results are provided to support our theoretical analysis.

L1/2 -Regularized Quantile Method for Sparse Phase Retrieval

The sparse phase retrieval aims to recover the sparse signal from quadratic measurements. However, the measurements are often affected by outliers and asymmetric distribution noise. This paper introduces a novel method that combines the quantile regression and the L1/2-regularizer. It is a non-convex, non-smooth, non-Lipschitz optimization problem. We propose an efficient algorithm based on the Alternating Direction Methods of Multiplier (ADMM) to solve the corresponding optimization problem. Numerous numerical experiments show that this method can recover sparse signals with fewer measurements and is robust to dense bounded noise and Laplace noise.

An Alternating Direction Nonmonotone Approximate Newton Algorithm for Inverse Problems

In this paper, an alternating direction nonmonotone approximate Newton algorithm (ADNAN) based on nonmonotone line search is developed for solving inverse problems. It is shown that ADNAN converges to a solution of the inverse problems and numerical results provide the effectiveness of the proposed algorithm.

ADI Finite Element Method for 2D Nonlinear Time Fractional Reaction-Subdiffusion Equation

In this paper, an alternating direction Galerkin finite element method is presented for solving 2D time fractional reaction sub-diffusion equation with nonlinear source term. Firstly, one order implicit-explicit method is used for time discretization, then Galerkin finite element method is adopted for spatial discretization and obtain a fully discrete linear system. Secondly, Galerkin alternating direction procedure for the system is derived by adding an extra term. Finally, the stability and convergence of the method are analyzed rigorously. Numerical results confirm the accuracy and efficiency of the proposed method.

A Bregman-style Partially Symmetric Alternating Direction Method of Multipliers for Nonconvex Multi-block Optimization

The alternating direction method of multipliers(ADMM)is one of the most successful and powerful methods for separable minimization optimization.Based on the idea of symmetric ADMM in two-block optimization,we add an updating formula for the Lagrange multiplier without restricting its position for multiblock one.Then,combining with the Bregman distance,in this work,a Bregman-style partially symmetric ADMM is presented for nonconvex multi-block optimization with linear constraints,and the Lagrange multiplier is updated twice with different relaxation factors in the iteration scheme.Under the suitable conditions,the global convergence,strong convergence and convergence rate of the presented method are analyzed and obtained.Finally,some preliminary numerical results are reported to support the correctness of the theoretical assertions,and these show that the presented method is numerically effective.

Research on infrared dim and small target detection algorithm based on low-rank tensor recovery

In order to rapidly and accurately detect infrared small and dim targets in the infrared image of complex scene collected by virtual prototyping of space-based downward-looking multiband detection,an improved detection algorithm of infrared small and dim target is proposed in this paper.Firstly,the original infrared images are changed into a new infrared patch tensor mode through data reconstruction.Then,the infrared small and dim target detection problems are converted to low-rank tensor recovery problems based on tensor nuclear norm in accordance with patch tensor characteristics,and inverse variance weighted entropy is defined for self-adaptive adjustment of sparseness.Finally,the low-rank tensor recovery problem with noise is solved by alternating the direction method to obtain the sparse target image,and the final small target is worked out by a simple partitioning algorithm.The test results in various spacebased downward-looking complex scenes show that such method can restrain complex background well by virtue of rapid arithmetic speed with high detection probability and low false alarm rate.It is a kind of infrared small and dim target detection method with good performance.

Stochastic Accelerated Alternating Direction Method of Multipliers for Hedging Communication Noise in Combined Heat and Power Dispatch

Combined heat and power dispatch(CHPD)opens a new window for increasing operational flexibility and reducing wind power curtailment.Electric power and district heating systems are independently controlled by different system operators;therefore,a decentralized solution paradigm is necessary for CHPD,in which only minor boundary information is required to be exchanged via a communication network.However,a nonideal communication environment with noise could lead to divergence or incorrect solutions of decentralized algorithms.To bridge this gap,this paper proposes a stochastic accelerated alternating direction method of multipliers(SA-ADMM)for hedging communication noise in CHPD.This algorithm provides a general framework to address more types of constraint sets and separable objective functions than the existing stochastic ADMM.Different from the single noise sources considered in the existing stochastic approximation methods,communication noise from multiple sources is addressed in both the local calculation and the variable update stages.Case studies of two test systems validate the effectiveness and robustness of the proposed SAADMM.