Multi-scale physics-informed neural networks for solving high Reynolds number boundary layer flows based on matched asymptotic expansions

Multi-scale system remains a classical scientific problem in fluid dynamics,biology,etc.In the present study,a scheme of multi-scale Physics-informed neural networks is proposed to solve the boundary layer flow at high Reynolds numbers without any data.The flow is divided into several regions with different scales based on Prandtl's boundary theory.Different regions are solved with governing equations in different scales.The method of matched asymptotic expansions is used to make the flow field continuously.A flow on a semi infinite flat plate at a high Reynolds number is considered a multi-scale problem because the boundary layer scale is much smaller than the outer flow scale.The results are compared with the reference numerical solutions,which show that the msPINNs can solve the multi-scale problem of the boundary layer in high Reynolds number flows.This scheme can be developed for more multi-scale problems in the future.

A transfer learning enhanced physics-informed neural network for parameter identification in soft materials

Soft materials,with the sensitivity to various external stimuli,exhibit high flexibility and stretchability.Accurate prediction of their mechanical behaviors requires advanced hyperelastic constitutive models incorporating multiple parameters.However,identifying multiple parameters under complex deformations remains a challenge,especially with limited observed data.In this study,we develop a physics-informed neural network(PINN)framework to identify material parameters and predict mechanical fields,focusing on compressible Neo-Hookean materials and hydrogels.To improve accuracy,we utilize scaling techniques to normalize network outputs and material parameters.This framework effectively solves forward and inverse problems,extrapolating continuous mechanical fields from sparse boundary data and identifying unknown mechanical properties.We explore different approaches for imposing boundary conditions(BCs)to assess their impacts on accuracy.To enhance efficiency and generalization,we propose a transfer learning enhanced PINN(TL-PINN),allowing pre-trained networks to quickly adapt to new scenarios.The TL-PINN significantly reduces computational costs while maintaining accuracy.This work holds promise in addressing practical challenges in soft material science,and provides insights into soft material mechanics with state-of-the-art experimental methods.

A physics-informed neural network for simulation of finite deformation in hyperelastic-magnetic coupling problems

Recently,numerous studies have demonstrated that the physics-informed neural network(PINN)can effectively and accurately resolve hyperelastic finite deformation problems.In this paper,a PINN framework for tackling hyperelastic-magnetic coupling problems is proposed.Since the solution space consists of two-phase domains,two separate networks are constructed to independently predict the solution for each phase region.In addition,a conscious point allocation strategy is incorporated to enhance the prediction precision of the PINN in regions characterized by sharp gradients.With the developed framework,the magnetic fields and deformation fields of magnetorheological elastomers(MREs)are solved under the control of hyperelastic-magnetic coupling equations.Illustrative examples are provided and contrasted with the reference results to validate the predictive accuracy of the proposed framework.Moreover,the advantages of the proposed framework in solving hyperelastic-magnetic coupling problems are validated,particularly in handling small data sets,as well as its ability in swiftly and precisely forecasting magnetostrictive motion.

Chien-physics-informed neural networks for solving singularly perturbed boundary-layer problems

A physics-informed neural network(PINN)is a powerful tool for solving differential equations in solid and fluid mechanics.However,it suffers from singularly perturbed boundary-layer problems in which there exist sharp changes caused by a small perturbation parameter multiplying the highest-order derivatives.In this paper,we introduce Chien's composite expansion method into PINNs,and propose a novel architecture for the PINNs,namely,the Chien-PINN(C-PINN)method.This novel PINN method is validated by singularly perturbed differential equations,and successfully solves the wellknown thin plate bending problems.In particular,no cumbersome matching conditions are needed for the C-PINN method,compared with the previous studies based on matched asymptotic expansions.

Radiative heat transfer analysis of a concave porous fin under the local thermal non-equilibrium condition:application of the clique polynomial method and physics-informed neural networks

The heat transfer through a concave permeable fin is analyzed by the local thermal non-equilibrium(LTNE)model.The governing dimensional temperature equations for the solid and fluid phases of the porous extended surface are modeled,and then are nondimensionalized by suitable dimensionless terms.Further,the obtained nondimensional equations are solved by the clique polynomial method(CPM).The effects of several dimensionless parameters on the fin's thermal profiles are shown by graphical illustrations.Additionally,the current study implements deep neural structures to solve physics-governed coupled equations,and the best-suited hyperparameters are attained by comparison with various network combinations.The results of the CPM and physicsinformed neural network(PINN)exhibit good agreement,signifying that both methods effectively solve the thermal modeling problem.

Prediction of Porous Media Fluid Flow with Spatial Heterogeneity Using Criss-Cross Physics-Informed Convolutional Neural Networks

Recent advances in deep neural networks have shed new light on physics,engineering,and scientific computing.Reconciling the data-centered viewpoint with physical simulation is one of the research hotspots.The physicsinformedneural network(PINN)is currently the most general framework,which is more popular due to theconvenience of constructing NNs and excellent generalization ability.The automatic differentiation(AD)-basedPINN model is suitable for the homogeneous scientific problem;however,it is unclear how AD can enforce fluxcontinuity across boundaries between cells of different properties where spatial heterogeneity is represented bygrid cells with different physical properties.In this work,we propose a criss-cross physics-informed convolutionalneural network(CC-PINN)learning architecture,aiming to learn the solution of parametric PDEs with spatialheterogeneity of physical properties.To achieve the seamless enforcement of flux continuity and integration ofphysicalmeaning into CNN,a predefined 2D convolutional layer is proposed to accurately express transmissibilitybetween adjacent cells.The efficacy of the proposedmethodwas evaluated through predictions of several petroleumreservoir problems with spatial heterogeneity and compared against state-of-the-art(PINN)through numericalanalysis as a benchmark,which demonstrated the superiority of the proposed method over the PINN.

Physics-informed neural networks with residual/gradient-based adaptive sampling methods for solving partial differential equations with sharp solutions

We consider solving the forward and inverse partial differential equations(PDEs)which have sharp solutions with physics-informed neural networks(PINNs)in this work.In particular,to better capture the sharpness of the solution,we propose the adaptive sampling methods(ASMs)based on the residual and the gradient of the solution.We first present a residual only-based ASM denoted by ASMⅠ.In this approach,we first train the neural network using a small number of residual points and divide the computational domain into a certain number of sub-domains,then we add new residual points in the sub-domain which has the largest mean absolute value of the residual,and those points which have the largest absolute values of the residual in this sub-domain as new residual points.We further develop a second type of ASM(denoted by ASMⅡ)based on both the residual and the gradient of the solution due to the fact that only the residual may not be able to efficiently capture the sharpness of the solution.The procedure of ASMⅡis almost the same as that of ASMⅠ,and we add new residual points which have not only large residuals but also large gradients.To demonstrate the effectiveness of the present methods,we use both ASMⅠand ASMⅡto solve a number of PDEs,including the Burger equation,the compressible Euler equation,the Poisson equation over an Lshape domain as well as the high-dimensional Poisson equation.It has been shown from the numerical results that the sharp solutions can be well approximated by using either ASMⅠor ASMⅡ,and both methods deliver much more accurate solutions than the original PINNs with the same number of residual points.Moreover,the ASMⅡalgorithm has better performance in terms of accuracy,efficiency,and stability compared with the ASMⅠalgorithm.This means that the gradient of the solution improves the stability and efficiency of the adaptive sampling procedure as well as the accuracy of the solution.Furthermore,we also employ the similar adaptive sampling technique for the data points of boundary conditions(BCs)if the sharpness of the solution is near the boundary.The result of the L-shape Poisson problem indicates that the present method can significantly improve the efficiency,stability,and accuracy.

Effective data sampling strategies and boundary condition constraints of physics-informed neural networks for identifying material properties in solid mechanics

Material identification is critical for understanding the relationship between mechanical properties and the associated mechanical functions.However,material identification is a challenging task,especially when the characteristic of the material is highly nonlinear in nature,as is common in biological tissue.In this work,we identify unknown material properties in continuum solid mechanics via physics-informed neural networks(PINNs).To improve the accuracy and efficiency of PINNs,we develop efficient strategies to nonuniformly sample observational data.We also investigate different approaches to enforce Dirichlet-type boundary conditions(BCs)as soft or hard constraints.Finally,we apply the proposed methods to a diverse set of time-dependent and time-independent solid mechanic examples that span linear elastic and hyperelastic material space.The estimated material parameters achieve relative errors of less than 1%.As such,this work is relevant to diverse applications,including optimizing structural integrity and developing novel materials.

Physics-Informed Deep Neural Network for Bearing Prognosis with Multisensory Signals

Prognosis of bearing is critical to improve the safety,reliability,and availability of machinery systems,which provides the health condition assessment and determines how long the machine would work before failure occurs by predicting the remaining useful life(RUL).In order to overcome the drawback of pure data-driven methods and predict RUL accurately,a novel physics-informed deep neural network,named degradation consistency recurrent neural network,is proposed for RUL prediction by integrating the natural degradation knowledge of mechanical components.The degradation is monotonic over the whole life of bearings,which is characterized by temperature signals.To incorporate the knowledge of monotonic degradation,a positive increment recurrence relationship is introduced to keep the monotonicity.Thus,the proposed model is relatively well understood and capable to keep the learning process consistent with physical degradation.The effectiveness and merit of the RUL prediction using the proposed method are demonstrated through vibration signals collected from a set of run-to-failure tests.

An artificial viscosity augmented physics-informed neural network for incompressible flow

Physics-informed neural networks(PINNs)are proved methods that are effective in solving some strongly nonlinear partial differential equations(PDEs),e.g.,Navier-Stokes equations,with a small amount of boundary or interior data.However,the feasibility of applying PINNs to the flow at moderate or high Reynolds numbers has rarely been reported.The present paper proposes an artificial viscosity(AV)-based PINN for solving the forward and inverse flow problems.Specifically,the AV used in PINNs is inspired by the entropy viscosity method developed in conventional computational fluid dynamics(CFD)to stabilize the simulation of flow at high Reynolds numbers.The newly developed PINN is used to solve the forward problem of the two-dimensional steady cavity flow at Re=1000 and the inverse problem derived from two-dimensional film boiling.The results show that the AV augmented PINN can solve both problems with good accuracy and substantially reduce the inference errors in the forward problem.

Failure-Informed Adaptive Sampling for PINNs,Part Ⅱ:Combining with Re-sampling and Subset Simulation

This is the second part of our series works on failure-informed adaptive sampling for physic-informed neural networks(PINNs).In our previous work(SIAM J.Sci.Comput.45:A1971–A1994),we have presented an adaptive sampling framework by using the failure probability as the posterior error indicator,where the truncated Gaussian model has been adopted for estimating the indicator.Here,we present two extensions of that work.The first extension consists in combining with a re-sampling technique,so that the new algorithm can maintain a constant training size.This is achieved through a cosine-annealing,which gradually transforms the sampling of collocation points from uniform to adaptive via the training progress.The second extension is to present the subset simulation(SS)algorithm as the posterior model(instead of the truncated Gaussian model)for estimating the error indicator,which can more effectively estimate the failure probability and generate new effective training points in the failure region.We investigate the performance of the new approach using several challenging problems,and numerical experiments demonstrate a significant improvement over the original algorithm.

Variational inference in neural functional prior using normalizing flows: application to differential equation and operator learning problems

Physics-informed deep learning has recently emerged as an effective tool for leveraging both observational data and available physical laws.Physics-informed neural networks(PINNs)and deep operator networks(DeepONets)are two such models.The former encodes the physical laws via the automatic differentiation,while the latter learns the hidden physics from data.Generally,the noisy and limited observational data as well as the over-parameterization in neural networks(NNs)result in uncertainty in predictions from deep learning models.In paper“MENG,X.,YANG,L.,MAO,Z.,FERRANDIS,J.D.,and KARNIADAKIS,G.E.Learning functional priors and posteriors from data and physics.Journal of Computational Physics,457,111073(2022)”,a Bayesian framework based on the generative adversarial networks(GANs)has been proposed as a unified model to quantify uncertainties in predictions of PINNs as well as DeepONets.Specifically,the proposed approach in“MENG,X.,YANG,L.,MAO,Z.,FERRANDIS,J.D.,and KARNIADAKIS,G.E.Learning functional priors and posteriors from data and physics.Journal of Computational Physics,457,111073(2022)”has two stages:(i)prior learning,and(ii)posterior estimation.At the first stage,the GANs are utilized to learn a functional prior either from a prescribed function distribution,e.g.,the Gaussian process,or from historical data and available physics.At the second stage,the Hamiltonian Monte Carlo(HMC)method is utilized to estimate the posterior in the latent space of GANs.However,the vanilla HMC does not support the mini-batch training,which limits its applications in problems with big data.In the present work,we propose to use the normalizing flow(NF)models in the context of variational inference(VI),which naturally enables the mini-batch training,as the alternative to HMC for posterior estimation in the latent space of GANs.A series of numerical experiments,including a nonlinear differential equation problem and a 100-dimensional(100D)Darcy problem,are conducted to demonstrate that the NFs with full-/mini-batch training are able to achieve similar accuracy as the“gold rule”HMC.Moreover,the mini-batch training of NF makes it a promising tool for quantifying uncertainty in solving the high-dimensional partial differential equation(PDE)problems with big data.

Beyond p-y method:A review of artificial intelligence approaches for predicting lateral capacity of drilled shafts in clayey soils

In 2023,pivotal advancements in artificial intelligence(AI)have significantly experienced.With that in mind,traditional methodologies,notably the p-y approach,have struggled to accurately model the complex,nonlinear soil-structure interactions of laterally loaded large-diameter drilled shafts.This study undertakes a rigorous evaluation of machine learning(ML)and deep learning(DL)techniques,offering a comprehensive review of their application in addressing this geotechnical challenge.A thorough review and comparative analysis have been carried out to investigate various AI models such as artificial neural networks(ANNs),relevance vector machines(RVMs),and least squares support vector machines(LSSVMs).It was found that despite ML approaches outperforming classic methods in predicting the lateral behavior of piles,their‘black box'nature and reliance only on a data-driven approach made their results showcase statistical robustness rather than clear geotechnical insights,a fact underscored by the mathematical equations derived from these studies.Furthermore,the research identified a gap in the availability of drilled shaft datasets,limiting the extendibility of current findings to large-diameter piles.An extensive dataset,compiled from a series of lateral loading tests on free-head drilled shaft with varying properties and geometries,was introduced to bridge this gap.The paper concluded with a direction for future research,proposes the integration of physics-informed neural networks(PINNs),combining data-driven models with fundamental geotechnical principles to improve both the interpretability and predictive accuracy of AI applications in geotechnical engineering,marking a novel contribution to the field.

Physics-informed deep learning for incompressible laminar flows

Physics-informed deep learning has drawn tremendous interest in recent years to solve computational physics problems,whose basic concept is to embed physical laws to constrain/inform neural networks,with the need of less data for training a reliable model.This can be achieved by incorporating the residual of physics equations into the loss function.Through minimizing the loss function,the network could approximate the solution.In this paper,we propose a mixed-variable scheme of physics-informed neural network(PINN)for fluid dynamics and apply it to simulate steady and transient laminar flows at low Reynolds numbers.A parametric study indicates that the mixed-variable scheme can improve the PINN trainability and the solution accuracy.The predicted velocity and pressure fields by the proposed PINN approach are also compared with the reference numerical solutions.Simulation results demonstrate great potential of the proposed PINN for fluid flow simulation with a high accuracy.

Physics-informed neural networks for estimating stress transfer mechanics in single lap joints

With the explosive growth of computational resources and data generation,deep machine learning has been successfully employed in various applications.One important and emerging scientific application of deep learning involves solving differential equations.Here,physics-informed neural networks(PINNs)are developed to solve the differential equations associated with a specific scientific problem.As such,algorithms for solving the differential equations by embedding their initial and boundary conditions in the cost function of the artificial neural networks using algorithmic differentiation must also be developed.In this study,various PINNs are adopted to estimate the stresses in the tablets and the interphase of a single lap joint.The proposed model is represented by two fourth-order non-homogeneous coupled partial differential equations,with the axial stresses in the upper and lower tablets adopted as the dependent variables.The axial stresses are a function of the tablet length,which presents the independent variable.Therefore,the axial stresses in the tablets are estimated by solving the coupled partial differential equations when subjected to the boundary conditions,whereas the remaining stress components are expressed in terms of axial stresses.The results obtained using the developed methodology are validated using the results obtained via MAPLE software.

Deep convolutional Ritz method: parametric PDE surrogates without labeled data

The parametric surrogate models for partial differential equations(PDEs)are a necessary component for many applications in computational sciences,and the convolutional neural networks(CNNs)have proven to be an excellent tool to generate these surrogates when parametric fields are present.CNNs are commonly trained on labeled data based on one-to-one sets of parameter-input and PDE-output fields.Recently,residual-based deep convolutional physics-informed neural network(DCPINN)solvers for parametric PDEs have been proposed to build surrogates without the need for labeled data.These allow for the generation of surrogates without an expensive offline-phase.In this work,we present an alternative formulation termed deep convolutional Ritz method(DCRM)as a parametric PDE solver.The approach is based on the minimization of energy functionals,which lowers the order of the differential operators compared to residualbased methods.Based on studies involving the Poisson equation with a spatially parameterized source term and boundary conditions,we find that CNNs trained on labeled data outperform DCPINNs in convergence speed and generalization abilities.The surrogates generated from the DCRM,however,converge significantly faster than their DCPINN counterparts,and prove to generalize faster and better than the surrogates obtained from both CNNs trained on labeled data and DCPINNs.This hints that the DCRM could make PDE solution surrogates trained without labeled data possibly.

A physics-informed deep learning framework for spacecraft pursuit-evasion task assessment

Qualitative spacecraft pursuit-evasion problem which focuses on feasibility is rarely studied because of high-dimensional dynamics,intractable terminal constraints and heavy computational cost.In this paper,A physics-informed framework is proposed for the problem,providing an intuitive method for spacecraft threat relationship determination,situation assessment,mission feasibility analysis and orbital game rules summarization.For the first time,situation adjustment suggestions can be provided for the weak player in orbital game.First,a dimension-reduction dynamics is derived in the line-of-sight rotation coordinate system and the qualitative model is determined,reducing complexity and avoiding the difficulty of target set presentation caused by individual modeling.Second,the Backwards Reachable Set(BRS)of the target set is used for state space partition and capture zone presentation.Reverse-time analysis can eliminate the influence of changeable initial state and enable the proposed framework to analyze plural situations simultaneously.Third,a time-dependent Hamilton-Jacobi-Isaacs(HJI)Partial Differential Equation(PDE)is established to describe BRS evolution driven by dimension-reduction dynamics,based on level set method.Then,Physics-Informed Neural Networks(PINNs)are extended to HJI PDE final value problem,supporting orbital game rules summarization through capture zone evolution analysis.Finally,numerical results demonstrate the feasibility and efficiency of the proposed framework.

kεNet湍流模型研究及其在低雷诺数槽道流中的应用

我们提出了一种基于物理信息的深度学习网络(kεNet),可用于RANS方程中发现封闭的湍流模型.kεNet由一个传统的典型神经网络结构和若干个基于物理信息的方程组成,如雷诺应力方程、k方程和ε方程.以低雷诺数下的槽道流动的湍流模型的修正为例,通过训练基于物理信息的神经网络,模型参数得到了修正.修正后的湍流模型参数应用于OpenFOAM软件进行计算,能够非常好地预测Re_(τ)=5200和2000下的槽道流动.