Joint Multi-Domain Channel Estimation Based on Sparse Bayesian Learning for OTFS System

Since orthogonal time-frequency space(OTFS)can effectively handle the problems caused by Doppler effect in high-mobility environment,it has gradually become a promising candidate for modulation scheme in the next generation of mobile communication.However,the inter-Doppler interference(IDI)problem caused by fractional Doppler poses great challenges to channel estimation.To avoid this problem,this paper proposes a joint time and delayDoppler(DD)domain based on sparse Bayesian learning(SBL)channel estimation algorithm.Firstly,we derive the original channel response(OCR)from the time domain channel impulse response(CIR),which can reflect the channel variation during one OTFS symbol.Compare with the traditional channel model,the OCR can avoid the IDI problem.After that,the dimension of OCR is reduced by using the basis expansion model(BEM)and the relationship between the time and DD domain channel model,so that we have turned the underdetermined problem into an overdetermined problem.Finally,in terms of sparsity of channel in delay domain,SBL algorithm is used to estimate the basis coefficients in the BEM without any priori information of channel.The simulation results show the effectiveness and superiority of the proposed channel estimation algorithm.

Vector Approximate Message Passing with Sparse Bayesian Learning for Gaussian Mixture Prior

Compressed sensing(CS)aims for seeking appropriate algorithms to recover a sparse vector from noisy linear observations.Currently,various Bayesian-based algorithms such as sparse Bayesian learning(SBL)and approximate message passing(AMP)based algorithms have been proposed.For SBL,it has accurate performance with robustness while its computational complexity is high due to matrix inversion.For AMP,its performance is guaranteed by the severe restriction of the measurement matrix,which limits its application in solving CS problem.To overcome the drawbacks of the above algorithms,in this paper,we present a low complexity algorithm for the single linear model that incorporates the vector AMP(VAMP)into the SBL structure with expectation maximization(EM).Specifically,we apply the variance auto-tuning into the VAMP to implement the E step in SBL,which decrease the iterations that require to converge compared with VAMP-EM algorithm when using a Gaussian mixture(GM)prior.Simulation results show that the proposed algorithm has better performance with high robustness under various cases of difficult measurement matrices.

DOA estimation based on multi-frequency joint sparse Bayesian learning for passive radar

This paper considers multi-frequency passive radar and develops a multi-frequency joint direction of arrival(DOA)estimation algorithm to improve estimation accuracy and resolution.The developed algorithm exploits the sparsity of targets in the spatial domain.Specifically,we first extract the required frequency channel data and acquire the snapshot data through a series of preprocessing such as clutter suppression,coherent integration,beamforming,and constant false alarm rate(CFAR)detection.Then,based on the framework of sparse Bayesian learning,the target’s DOA is estimated by jointly extracting the multi-frequency data via evidence maximization.Simulation results show that the developed algorithm has better estimation accuracy and resolution than other existing multi-frequency DOA estimation algorithms,especially under the scenarios of low signalto-noise ratio(SNR)and small snapshots.Furthermore,the effectiveness is verified by the field experimental data of a multi-frequency FM-based passive radar.

EARLY CATARACT DETECTION BY DYNAMIC LIGHT SCATTERING WITH SPARSE BAYESIAN LEARNING

Dynamic light scattering(DLS)is a promising technique for early cataract detection and for studying cataractogenesis.A novel probabilistic analysis tool,the sparse Bayesian learning(SBL)algorithm,is described for reconstructing the most-probable size distribution ofα-crystallin and their aggregates in an ocular lens from the DLS data.The performance of the algorithm is evaluated by analyzing simulated correlation data from known distributions and DLS data from the ocular lenses of a fetal calf,a Rhesus monkey,and a man,so as to establish the required efficiency of the SBL algorithm for clinical studies.

Online identification of time-varying dynamical systems for industrial robots based on sparse Bayesian learning

Nowadays, industrial robots have been widely used in manufacturing, healthcare, packaging, and more. Choosing robots in these applications mainly attributes to their repeatability and precision. However, prolonged and loaded operations can deteriorate the accuracy and efficiency of industrial robots due to the unavoidable accumulated kinematical and dynamical errors. This paper resolves these aforementioned issues by proposing an online time-varying sparse Bayesian learning(SBL) method to identify dynamical systems of robots in real-time. The identification of dynamical systems for industrial robots is cast as a sparse linear regression problem. By constructing the dictionary matrix, the parameters of the robot dynamics are effectively estimated via a re-weighted1-minimization algorithm. Online recursive methods are integrated into SBL to achieve real-time system identification. By including sparsity and promoting online learning, the proposed method can handle time-varying dynamical systems and therefore improve operational stability and accuracy. Experimental results on both simulated and real selective compliance assembly robot arm(SCARA) robots have demonstrated the effectiveness of the proposed method for industrial robots.

On fast estimation of direction of arrival for underwater acoustic target based on sparse Bayesian learning

The Direction of Arrival （DOA） estimation methods for underwater acoustic target using Temporally Multiple Sparse Bayesian Learning （TMSBL） as the reconstructing algorithm have the disadvantage of slow computing speed. To solve this problem, a fast underwater acoustic target direction of arrival estimation was proposed. Analyzing the model characteristics of block-sparse Bayesian learning framework for DOA estimation, an algorithm was proposed to obtain the value of core hyper-parameter through MacKay＇s fixed-point method to estimate the DOA. By this process, it will spend less time for computation and provide more superior recovery performance than TMSBL algorithm. Simulation results verified the feasibility and effectiveness of the proposed algorithm.

DOA Estimation Based on Root Sparse Bayesian Learning Under Gain and Phase Error

The direction of arrival(DOA)is approximated by first-order Taylor expansion in most of the existing methods,which will lead to limited estimation accuracy when using coarse mesh owing to the off-grid error.In this paper,a new root sparse Bayesian learning based DOA estimation method robust to gain-phase error is proposed,which dynamically adjusts the grid angle under coarse grid spacing to compensate the off-grid error and applies the expectation maximization(EM)method to solve the respective iterative formula-based on the prior distribution of each parameter.Simulation results verify that the proposed method reduces the computational complexity through coarse grid sampling while maintaining a reasonable accuracy under gain and phase errors,as compared to the existing methods.

基于吉布斯采样的稀疏水声信道估计方法

The estimation of sparse underwater acoustic(UWA)channels can be regarded as an inference problem involving hidden variables within the Bayesian framework.While the classical sparse Bayesian learning(SBL),derived through the expectation maximization(EM)algorithm,has been widely employed for UWA channel estimation,it still differs from the real posterior expectation of channels.In this paper,we propose an approach that combines variational inference(VI)and Markov chain Monte Carlo(MCMC)methods to provide a more accurate posterior estimation.Specifically,the SBL is first re-derived with VI,allowing us to replace the posterior distribution of the hidden variables with a variational distribution.Then,we determine the full conditional probability distribution for each variable in the variational distribution and then iteratively perform random Gibbs sampling in MCMC to converge the Markov chain.The results of simulation and experiment indicate that our estimation method achieves lower mean square error and bit error rate compared to the classic SBL approach.Additionally,it demonstrates an acceptable convergence speed.

Synthetic aperture radar imaging based on attributed scatter model using sparse recovery techniques

The sparse recovery algorithms formulate synthetic aperture radar （SAR） imaging problem in terms of sparse representation （SR） of a small number of strong scatters＇ positions among a much large number of potential scatters＇ positions, and provide an effective approach to improve the SAR image resolution. Based on the attributed scatter center model, several experiments were performed with different practical considerations to evaluate the performance of five representative SR techniques, namely, sparse Bayesian learning （SBL）, fast Bayesian matching pursuit （FBMP）, smoothed 10 norm method （SL0）, sparse reconstruction by separable approximation （SpaRSA）, fast iterative shrinkage-thresholding algorithm （FISTA）, and the parameter settings in five SR algorithms were discussed. In different situations, the performances of these algorithms were also discussed. Through the comparison of MSE and failure rate in each algorithm simulation, FBMP and SpaRSA are found suitable for dealing with problems in the SAR imaging based on attributed scattering center model. Although the SBL is time-consuming, it always get better performance when related to failure rate and high SNR.

Data-Driven Discovery of Stochastic Differential Equations

Stochastic differential equations(SDEs)are mathematical models that are widely used to describe complex processes or phenomena perturbed by random noise from different sources.The identification of SDEs governing a system is often a challenge because of the inherent strong stochasticity of data and the complexity of the system’s dynamics.The practical utility of existing parametric approaches for identifying SDEs is usually limited by insufficient data resources.This study presents a novel framework for identifying SDEs by leveraging the sparse Bayesian learning(SBL)technique to search for a parsimonious,yet physically necessary representation from the space of candidate basis functions.More importantly,we use the analytical tractability of SBL to develop an efficient way to formulate the linear regression problem for the discovery of SDEs that requires considerably less time-series data.The effectiveness of the proposed framework is demonstrated using real data on stock and oil prices,bearing variation,and wind speed,as well as simulated data on well-known stochastic dynamical systems,including the generalized Wiener process and Langevin equation.This framework aims to assist specialists in extracting stochastic mathematical models from random phenomena in the natural sciences,economics,and engineering fields for analysis,prediction,and decision making.

Data-driven discovery of linear dynamical systems from noisy data

In modern science and engineering disciplines,data-driven discovery methods play a fundamental role in system modeling,as data serve as the external representations of the intrinsic mechanisms within systems.However,empirical data contaminated by process and measurement noise remain a significant obstacle for this type of modeling.In this study,we have developed a data-driven method capable of directly uncovering linear dynamical systems from noisy data.This method combines the Kalman smoothing and sparse Bayesian learning to decouple process and measurement noise under the expectation-maximization framework,presenting an analytical method for alternate state estimation and system identification.Furthermore,the discovered model explicitly characterizes the probability distribution of process and measurement noise,as they are essential for filtering,smoothing,and stochastic control.We have successfully applied the proposed algorithm to several simulation systems.Experimental results demonstrate its potential to enable linear dynamical system discovery in practical applications where noise-free data are intractable to capture.

Combined UAMP and MF Message Passing Algorithm for Multi-Target Wideband DOA Estimation with Dirichlet Process Prior

When estimating the direction of arrival (DOA) of wideband signals from multiple sources, the performance of sparse Bayesian methods is influenced by the frequency bands occupied by signals in different directions. This is particularly true when multiple signal frequency bands overlap. Message passing algorithms (MPA) with Dirichlet process (DP) prior can be employed in a sparse Bayesian learning (SBL) framework with high precision. However, existing methods suffer from either high complexity or low precision. To address this, we propose a low-complexity DOA estimation algorithm based on a factor graph. This approach introduces two strong constraints via a stretching transformation of the factor graph. The first constraint separates the observation from the DP prior, enabling the application of the unitary approximate message passing (UAMP) algorithm for simplified inference and mitigation of divergence issues. The second constraint compensates for the deviation in estimation angle caused by the grid mismatch problem. Compared to state-of-the-art algorithms, our proposed method offers higher estimation accuracy and lower complexity.

基于子空间模型的稀疏贝叶斯DOA估计

为了提高相干信源条件下的离格波达方向(direction of arrival,DOA)估计精度,提出一种基于子空间模型的稀疏贝叶斯学习(sparse Bayesian learning,SBL)的DOA估计算法。该算法首先将子空间平滑(subspace smoothing,SS)技术与加权子空间拟合(weighted subspace fitting,WSF)技术结合,然后将此子空间模型应用于SBL算法,并将离散网格点视为动态参数,用期望最大化(expectation maximization,EM)算法迭代更新网格点位置。与传统稀疏恢复算法相比,该算法在估计误差及计算复杂度上均具有明显优势,并对信源数目的估计误差具有较强的鲁棒性。

ESTIMATION AND UNCERTAINTY QUANTIFICATION FOR PIECEWISE SMOOTH SIGNAL RECOVERY

This paper presents an application of the sparse Bayesian learning(SBL)algorithm to linear inverse problems with a high order total variation(HOTV)sparsity prior.For the problem of sparse signal recovery,SBL often produces more accurate estimates than maximum a posteriori estimates,including those that useℓ1 regularization.Moreover,rather than a single signal estimate,SBL yields a full posterior density estimate which can be used for uncertainty quantification.However,SBL is only immediately applicable to problems having a direct sparsity prior,or to those that can be formed via synthesis.This paper demonstrates how a problem with an HOTV sparsity prior can be formulated via synthesis,and then utilizes SBL.This expands the class of problems available to Bayesian learning to include,e.g.,inverse problems dealing with the recovery of piecewise smooth functions or signals from data.Numerical examples are provided to demonstrate how this new technique is effectively employed.

Multi-dimensional scenario forecast for generation of multiple wind farms

A novel multi-dimensional scenario forecast approach which can capture the dynamic temporal-spatial interdependence relation among the outputs of multiple wind farms is proposed.In the proposed approach,support vector machine(SVM)is applied for the spot forecast of wind power generation.The probability density function(PDF)of the SVM forecast error is predicted by sparse Bayesian learning(SBL),and the spot forecast result is corrected according to the error expectation obtained.The copula function is estimated using a Gaussian copula-based dynamic conditional correlation matrix regression(DCCMR)model to describe the correlation among the errors.And the multidimensional scenario is generated with respect to the estimated marginal distributions and the copula function.Test results on three adjacent wind farms illustrate the effectiveness of the proposed approach.

Deep adaptive control with online identification for industrial robots

Derivation of control equations from data is a critical problem in numerous scientific and engineering fields.The inverse dynamic control of robot manipulators in the field of industrial robot research is a key example.Traditionally,researchers needed to obtain the robot dynamic model through physical modeling methods before developing controllers.However,the robot dynamic model and suitable control methods are often elusive and difficult to tune,particularly when dealing with real dynamical systems.In this paper,we combine an enhanced online sparse Bayesian learning(OSBL)algorithm and a model reference adaptive control method to obtain a data-driven modeling and control strategy from data containing noise;this strategy can be applied to dynamical systems.In particular,we use a sparse Bayesian approach,relying only on some prior knowledge of its physics,to extract an accurate mechanistic model from the measured data.Unmodeled parameters are further identified from the modeling error through a deep neural network(DNN).By combining the identification model with a model reference adaptive control approach,a general deep adaptive control(DAC)method is obtained,which can tolerate unmodeled dynamics.The adaptive update law is derived from Lyapunov’s stability criterion,which guarantees the asymptotic stability of the system.Finally,the Enhanced OSBL identification method and DAC scheme are applied on a six-degree-of-freedom industrial robot,and the effectiveness of the proposed method is verified.