Incorporating Lasso Regression to Physics-Informed Neural Network for Inverse PDE Problem

Partial Differential Equation(PDE)is among the most fundamental tools employed to model dynamic systems.Existing PDE modeling methods are typically derived from established knowledge and known phenomena,which are time-consuming and labor-intensive.Recently,discovering governing PDEs from collected actual data via Physics Informed Neural Networks(PINNs)provides a more efficient way to analyze fresh dynamic systems and establish PEDmodels.This study proposes Sequentially Threshold Least Squares-Lasso(STLasso),a module constructed by incorporating Lasso regression into the Sequentially Threshold Least Squares(STLS)algorithm,which can complete sparse regression of PDE coefficients with the constraints of l0 norm.It further introduces PINN-STLasso,a physics informed neural network combined with Lasso sparse regression,able to find underlying PDEs from data with reduced data requirements and better interpretability.In addition,this research conducts experiments on canonical inverse PDE problems and compares the results to several recent methods.The results demonstrated that the proposed PINN-STLasso outperforms other methods,achieving lower error rates even with less data.

Bi-Orthogonal fPINN:A Physics-Informed Neural Network Method for Solving Time-Dependent Stochastic Fractional PDEs

Fractional partial differential equations(FPDEs)can effectively represent anomalous transport and nonlocal interactions.However,inherent uncertainties arise naturally in real applications due to random forcing or unknown material properties.Mathematical models considering nonlocal interactions with uncertainty quantification can be formulated as stochastic fractional partial differential equations(SFPDEs).There are many challenges in solving SFPDEs numerically,especially for long-time integration since such problems are high-dimensional and nonlocal.Here,we combine the bi-orthogonal(BO)method for representing stochastic processes with physicsinformed neural networks(PINNs)for solving partial differential equations to formulate the bi-orthogonal PINN method(BO-fPINN)for solving time-dependent SFPDEs.Specifically,we introduce a deep neural network for the stochastic solution of the time-dependent SFPDEs,and include the BO constraints in the loss function following a weak formulation.Since automatic differentiation is not currently applicable to fractional derivatives,we employ discretization on a grid to compute the fractional derivatives of the neural network output.The weak formulation loss function of the BO-fPINN method can overcome some drawbacks of the BO methods and thus can be used to solve SFPDEs with eigenvalue crossings.Moreover,the BO-fPINN method can be used for inverse SFPDEs with the same framework and same computational complexity as for forward problems.We demonstrate the effectiveness of the BO-fPINN method for different benchmark problems.Specifically,we first consider an SFPDE with eigenvalue crossing and obtain good results while the original BO method fails.We then solve several forward and inverse problems governed by SFPDEs,including problems with noisy initial conditions.We study the effect of the fractional order as well as the number of the BO modes on the accuracy of the BO-fPINN method.The results demonstrate the flexibility and efficiency of the proposed method,especially for inverse problems.We also present a simple example of transfer learning(for the fractional order)that can help in accelerating the training of BO-fPINN for SFPDEs.Taken together,the simulation results show that the BO-fPINN method can be employed to effectively solve time-dependent SFPDEs and may provide a reliable computational strategy for real applications exhibiting anomalous transport.