Advances of Model Order Reduction Research in Large-scale System Simulation

Model Order Reduction (MOR) plays more and more imp or tant role in complex system simulation, design and control recently. For example , for the large-size space structures, VLSI and MEMS (Micro-ElectroMechanical Systems) etc., in order to shorten the development cost, increase the system co ntrolling accuracy and reduce the complexity of controllers, the reduced order model must be constructed. Even in Virtual Reality (VR), the simulation and d isplay must be in real-time, the model order must be reduced too. The recent advances of MOR research are overviewed in the article. The MOR theor y and methods may be classified as Singular Value decomposition (SVD) based, the Krylov subspace based and others. The merits and demerits of the different meth ods are analyzed, and the existed problems are pointed out. Moreover, the applic ation’s fields are overviewed, and the potential applications are forecaste d. After the existed problems analyzed, the future work is described. There are som e problems in the traditional methods such as SVD and Krylov subspace, they are that it’s difficult to (1)guarantee the stability of the original system, (2) b e adaptive to nonlinear system, and (3) control the modeling accuracy. The f uture works may be solving the above problems on the foundation of the tradition al methods, and applying other methods such as wavelet or signal compression.

An Adaptive Substructure-Based Model Order Reduction Method for Nonlinear Seismic Analysis in OpenSees

Structural components may enter an initial-elastic state,a plastic-hardening state and a residual-elastic state during strong seismic excitations.In the residual-elastic state,structural components keep in an unloading/reloading stage that is dominated by a tangent stiffness,thus structural components remain residual deformations but behave in an elastic manner.It has a great potential to make model order reduction for such structural components using the tangent-stiffness-based vibration modes as a reduced order basis.In this paper,an adaptive substructure-based model order reduction method is developed to perform nonlinear seismic analysis for structures that have a priori unknown damage distribution.This method is able to generate time-varying substructures and make nonlinear model order reduction for substructures in the residual-elastic phase.The finite element program OpenSees has been extended to provide the adaptive substructure-based nonlinear seismic analysis.At the low level of OpenSees framework,a new abstract layer is created to represent the time-varying substructures and implement the modeling process of substructures.At the high level of OpenSees framework,a new transient analysis class is created to implement the solving process of substructure-based governing equations.Compared with the conventional time step integration method,the adaptive substructure-based model order reduction method can yield comparative results with a higher computational efficiency.

Model Order Reduction for Coupled Dynamic Characterization of Torsional Micromirrors

Numerical solutions could not perform rapid system-level simulation of the behavior of micro-electro-mechanical systems（MEMS） and analytic solutions for the describing partial differential equations are only available for simple geometries.Model order reduction（MOR） can extract approximate low-order model from the original large scale system.Conventional model order reduction algorithm is based on first-order system model,however,most structure mechanical MEMS systems are naturally second-order in time.For the purpose of solving the above problem,a direct second-order system model order reduction approach based on Krylov subspace projection for the coupled dynamic study of electrostatic torsional micromirrors is presented.The block Arnoldi process is applied to create the orthonormal vectors to construct the projection matrix,which enables the extraction of the low order model from the discretized system assembled through finite element analysis.The transfer functions of the reduced order model and the original model are expanded to demonstrate the moment-matching property of the second-order model reduction algorithm.The torsion and bending effect are included in the finite element model,and the squeeze film damping effect is considered as well.An empirical method considering relative error convergence is adopted to obtain the optimal choice of the order for the reduced model.A comparison research between the full model and the reduced model is carried out.The modeling accuracy and computation efficiency of the presented second-order model reduction method are confirmed by the comparison research results.The research provides references for MOR of MEMS.

Methods in Model Order Reduction(MOR) field

Nowadays,the modeling of systems may be quite large,even up to tens of thousands orders.In spite of the increasing computational powers,direct simulation of these large-scale systems may be impractical.Thus,to industry requirements,analytically tractable and computationally cheap models must be designed.This is the essence task of Model Order Reduction(MOR).This article describes the basics of MOR optimization,various way of designing MOR,and gives the conclusion about existing methods.In addition,it proposed some heuristic footpath.

基于Ordered Probit模型的人车冲突安全影响因素研究

为探究和定量分析人车冲突严重程度的影响因素,通过采集3个信号交叉口的人车冲突视频数据,利用T-Analyst标定人车轨迹并计算冲突指标(PET),采用85%位累计频率曲线法划分人车冲突等级;从人、车、路及环境特征中选取10个因素作为变量,构建Ordered Probit模型,以确立人车冲突严重程度的显著影响因素,并通过边际效应定量分析不同显著因素的影响程度。研究结果表明:行人闯红灯情况、年龄、行人交通量、人行道占用情况、人行道起点终点、车辆速度变化及车流量是人车冲突严重程度的显著因素,相较于各自参考量,行人闯红灯、车辆加速通过冲突点、人行道起点及老年人造成严重冲突的概率分别增加8.2%,5.9%,5.1%,4.4%;相较于低流量的交通流,较高流量的车流和行人交通流使得严重冲突的概率分别增加3.7%,2.5%,但人行道占用使得严重冲突的概率下降6.8%。研究结果可为信号交叉口行人过街交通安全设施的设计和实施提供理论依据。

Fourth-Order Predictive Modelling: II. 4th-BERRU-PM Methodology for Combining Measurements with Computations to Obtain Best-Estimate Results with Reduced Uncertainties

This work presents a comprehensive fourth-order predictive modeling (PM) methodology that uses the MaxEnt principle to incorporate fourth-order moments (means, covariances, skewness, kurtosis) of model parameters, computed and measured model responses, as well as fourth (and higher) order sensitivities of computed model responses to model parameters. This new methodology is designated by the acronym 4th-BERRU-PM, which stands for “fourth-order best-estimate results with reduced uncertainties.” The results predicted by the 4th-BERRU-PM incorporates, as particular cases, the results previously predicted by the second-order predictive modeling methodology 2nd-BERRU-PM, and vastly generalizes the results produced by extant data assimilation and data adjustment procedures.

Second-Order MaxEnt Predictive Modelling Methodology. I: Deterministically Incorporated Computational Model (2nd-BERRU-PMD)

This work presents a comprehensive second-order predictive modeling (PM) methodology designated by the acronym 2nd-BERRU-PMD. The attribute “2nd” indicates that this methodology incorporates second-order uncertainties (means and covariances) and second-order sensitivities of computed model responses to model parameters. The acronym BERRU stands for “Best- Estimate Results with Reduced Uncertainties” and the last letter (“D”) in the acronym indicates “deterministic,” referring to the deterministic inclusion of the computational model responses. The 2nd-BERRU-PMD methodology is fundamentally based on the maximum entropy (MaxEnt) principle. This principle is in contradistinction to the fundamental principle that underlies the extant data assimilation and/or adjustment procedures which minimize in a least-square sense a subjective user-defined functional which is meant to represent the discrepancies between measured and computed model responses. It is shown that the 2nd-BERRU-PMD methodology generalizes and extends current data assimilation and/or data adjustment procedures while overcoming the fundamental limitations of these procedures. In the accompanying work (Part II), the alternative framework for developing the “second- order MaxEnt predictive modelling methodology” is presented by incorporating probabilistically (as opposed to “deterministically”) the computed model responses.

Second-Order MaxEnt Predictive Modelling Methodology. II: Probabilistically Incorporated Computational Model (2nd-BERRU-PMP)

This work presents a comprehensive second-order predictive modeling (PM) methodology based on the maximum entropy (MaxEnt) principle for obtaining best-estimate mean values and correlations for model responses and parameters. This methodology is designated by the acronym 2nd-BERRU-PMP, where the attribute “2nd” indicates that this methodology incorporates second- order uncertainties (means and covariances) and second (and higher) order sensitivities of computed model responses to model parameters. The acronym BERRU stands for “Best-Estimate Results with Reduced Uncertainties” and the last letter (“P”) in the acronym indicates “probabilistic,” referring to the MaxEnt probabilistic inclusion of the computational model responses. This is in contradistinction to the 2nd-BERRU-PMD methodology, which deterministically combines the computed model responses with the experimental information, as presented in the accompanying work (Part I). Although both the 2nd-BERRU-PMP and the 2nd-BERRU-PMD methodologies yield expressions that include second (and higher) order sensitivities of responses to model parameters, the respective expressions for the predicted responses, for the calibrated predicted parameters and for their predicted uncertainties (covariances), are not identical to each other. Nevertheless, the results predicted by both the 2nd-BERRU-PMP and the 2nd-BERRU-PMD methodologies encompass, as particular cases, the results produced by the extant data assimilation and data adjustment procedures, which rely on the minimization, in a least-square sense, of a user-defined functional meant to represent the discrepancies between measured and computed model responses.

Fourth-Order Predictive Modelling: I. General-Purpose Closed-Form Fourth-Order Moments-Constrained MaxEnt Distribution

This work (in two parts) will present a novel predictive modeling methodology aimed at obtaining “best-estimate results with reduced uncertainties” for the first four moments (mean values, covariance, skewness and kurtosis) of the optimally predicted distribution of model results and calibrated model parameters, by combining fourth-order experimental and computational information, including fourth (and higher) order sensitivities of computed model responses to model parameters. Underlying the construction of this fourth-order predictive modeling methodology is the “maximum entropy principle” which is initially used to obtain a novel closed-form expression of the (moments-constrained) fourth-order Maximum Entropy (MaxEnt) probability distribution constructed from the first four moments (means, covariances, skewness, kurtosis), which are assumed to be known, of an otherwise unknown distribution of a high-dimensional multivariate uncertain quantity of interest. This fourth-order MaxEnt distribution provides optimal compatibility of the available information while simultaneously ensuring minimal spurious information content, yielding an estimate of a probability density with the highest uncertainty among all densities satisfying the known moment constraints. Since this novel generic fourth-order MaxEnt distribution is of interest in its own right for applications in addition to predictive modeling, its construction is presented separately, in this first part of a two-part work. The fourth-order predictive modeling methodology that will be constructed by particularizing this generic fourth-order MaxEnt distribution will be presented in the accompanying work (Part-2).

Second-Order MaxEnt Predictive Modelling Methodology. III: Illustrative Application to a Reactor Physics Benchmark

This work illustrates the innovative results obtained by applying the recently developed the 2nd-order predictive modeling methodology called “2nd- BERRU-PM”, where the acronym BERRU denotes “best-estimate results with reduced uncertainties” and “PM” denotes “predictive modeling.” The physical system selected for this illustrative application is a polyethylene-reflected plutonium (acronym: PERP) OECD/NEA reactor physics benchmark. This benchmark is modeled using the neutron transport Boltzmann equation (involving 21,976 uncertain parameters), the solution of which is representative of “large-scale computations.” The results obtained in this work confirm the fact that the 2nd-BERRU-PM methodology predicts best-estimate results that fall in between the corresponding computed and measured values, while reducing the predicted standard deviations of the predicted results to values smaller than either the experimentally measured or the computed values of the respective standard deviations. The obtained results also indicate that 2nd-order response sensitivities must always be included to quantify the need for including (or not) the 3rd- and/or 4th-order sensitivities. When the parameters are known with high precision, the contributions of the higher-order sensitivities diminish with increasing order, so that the inclusion of the 1st- and 2nd-order sensitivities may suffice for obtaining accurate predicted best- estimate response values and best-estimate standard deviations. On the other hand, when the parameters’ standard deviations are sufficiently large to approach (or be outside of) the radius of convergence of the multivariate Taylor-series which represents the response in the phase-space of model parameters, the contributions stemming from the 3rd- and even 4th-order sensitivities are necessary to ensure consistency between the computed and measured response. In such cases, the use of only the 1st-order sensitivities erroneously indicates that the computed results are inconsistent with the respective measured response. Ongoing research aims at extending the 2nd-BERRU-PM methodology to fourth-order, thus enabling the computation of third-order response correlations (skewness) and fourth-order response correlations (kurtosis).

Introducing the nth-Order Features Adjoint Sensitivity Analysis Methodology for Nonlinear Systems (nth-FASAM-N): II. Illustrative Example

This work highlights the unparalleled efficiency of the “nth-Order Function/ Feature Adjoint Sensitivity Analysis Methodology for Nonlinear Systems” (nth-FASAM-N) by considering the well-known Nordheim-Fuchs reactor dynamics/safety model. This model describes a short-time self-limiting power excursion in a nuclear reactor system having a negative temperature coefficient in which a large amount of reactivity is suddenly inserted, either intentionally or by accident. This nonlinear paradigm model is sufficiently complex to model realistically self-limiting power excursions for short times yet admits closed-form exact expressions for the time-dependent neutron flux, temperature distribution and energy released during the transient power burst. The nth-FASAM-N methodology is compared to the extant “nth-Order Comprehensive Adjoint Sensitivity Analysis Methodology for Nonlinear Systems” (nth-CASAM-N) showing that: (i) the 1st-FASAM-N and the 1st-CASAM-N methodologies are equally efficient for computing the first-order sensitivities;each methodology requires a single large-scale computation for solving the “First-Level Adjoint Sensitivity System” (1st-LASS);(ii) the 2nd-FASAM-N methodology is considerably more efficient than the 2nd-CASAM-N methodology for computing the second-order sensitivities since the number of feature-functions is much smaller than the number of primary parameters;specifically for the Nordheim-Fuchs model, the 2nd-FASAM-N methodology requires 2 large-scale computations to obtain all of the exact expressions of the 28 distinct second-order response sensitivities with respect to the model parameters while the 2nd-CASAM-N methodology requires 7 large-scale computations for obtaining these 28 second-order sensitivities;(iii) the 3rd-FASAM-N methodology is even more efficient than the 3rd-CASAM-N methodology: only 2 large-scale computations are needed to obtain the exact expressions of the 84 distinct third-order response sensitivities with respect to the Nordheim-Fuchs model’s parameters when applying the 3rd-FASAM-N methodology, while the application of the 3rd-CASAM-N methodology requires at least 22 large-scale computations for computing the same 84 distinct third-order sensitivities. Together, the nth-FASAM-N and the nth-CASAM-N methodologies are the most practical methodologies for computing response sensitivities of any order comprehensively and accurately, overcoming the curse of dimensionality in sensitivity analysis.

AN ACCELERATED WAVEFORM RELAXATION APPROACH BASED ON MODEL ORDER REDUCTION FOR LARGE COUPLING SYSTEMS

In this paper, we present an accelerated simulation approach on waveform relaxation using Krylov subspace for a large time-dependent system composed of some subsystems. This approach first allows these subsystems to be decoupled by waveform relaxation. Then the Arnoldi procedure based on Krylov subspace is provided to accelerate the simulation of the decoupled subsystems independently. For the new approach, the convergent conditions on waveform relaxation are derived. The robust behavior is also successfully illustrated via numerical examples.

Recent Advance in Non-Krylov Subspace Model Order Reduction of Interconnect Circuits

Model order reduction of interconnect circuits is an important technique to reduce the circuit complexity and improve the efficiency of post-layout verification process in the nanometer VLSI design. Existing works using the Krylov subspace method are very efficient, but the resulting models are less compact and lack global accuracy. Also, existing methods cannot handle interconnect circuits with large input and output ports. Recent advances in reduction techniques using non-Krylov subspace techniques such as truncated balanced realization （TBR） hold some promise to solve these problems. In this paper, we first review the classic TBR-based reduction methods and then present the recent developments in fast TBR-based reduction and techniques such as PMTBR, SBPOR, and ETBR methods. These newly proposed methods try to avoid the expensive computing steps in traditional TBR methods at some cost to accuracy to boost efficiency and scalability, which is critical to reduce large interconnect parasitics modeled as RLCK circuits. The ETBR method can also reduce circuits with massive ports by considering the input signals. We show the pros and cons of each method and compare them on a set of large interconnect circuits, and finally point to some new research directions for this area.

Introducing the nth-Order Features Adjoint Sensitivity Analysis Methodology for Nonlinear Systems (nth-FASAM-N): I. Mathematical Framework

This work presents the “nth-Order Feature Adjoint Sensitivity Analysis Methodology for Nonlinear Systems” (abbreviated as “nth-FASAM-N”), which will be shown to be the most efficient methodology for computing exact expressions of sensitivities, of any order, of model responses with respect to features of model parameters and, subsequently, with respect to the model’s uncertain parameters, boundaries, and internal interfaces. The unparalleled efficiency and accuracy of the nth-FASAM-N methodology stems from the maximal reduction of the number of adjoint computations (which are considered to be “large-scale” computations) for computing high-order sensitivities. When applying the nth-FASAM-N methodology to compute the second- and higher-order sensitivities, the number of large-scale computations is proportional to the number of “model features” as opposed to being proportional to the number of model parameters (which are considerably more than the number of features).When a model has no “feature” functions of parameters, but only comprises primary parameters, the nth-FASAM-N methodology becomes identical to the extant nth CASAM-N (“nth-Order Comprehensive Adjoint Sensitivity Analysis Methodology for Nonlinear Systems”) methodology. Both the nth-FASAM-N and the nth-CASAM-N methodologies are formulated in linearly increasing higher-dimensional Hilbert spaces as opposed to exponentially increasing parameter-dimensional spaces thus overcoming the curse of dimensionality in sensitivity analysis of nonlinear systems. Both the nth-FASAM-N and the nth-CASAM-N are incomparably more efficient and more accurate than any other methods (statistical, finite differences, etc.) for computing exact expressions of response sensitivities of any order with respect to the model’s features and/or primary uncertain parameters, boundaries, and internal interfaces.

Direct adaptive regulation of unknown nonlinear systems with analysis of the model order problem

A new method for the direct adaptive regulation of unknown nonlinear dynamical systems is proposed in this paper,paying special attention to the analysis of the model order problem.The method uses a neurofuzzy (NF) modeling of the unknown system,which combines fuzzy systems (FSs) with high order neural networks (HONNs).We propose the approximation of the unknown system by a special form of an NF-dynamical system (NFDS),which,however,may assume a smaller number of states than the original unknown model.The omission of states,referred to as a model order problem,is modeled by introducing a disturbance term in the approximating equations.The development is combined with a sensitivity analysis of the closed loop and provides a comprehensive and rigorous analysis of the stability properties.An adaptive modification method,termed ‘parameter hopping’,is incorporated into the weight estimation algorithm so that the existence and boundedness of the control signal are always assured.The applicability and potency of the method are tested by simulations on well known benchmarks such as ‘DC motor’ and ‘Lorenz system’,where it is shown that it performs quite well under a reduced model order assumption.Moreover,the proposed NF approach is shown to outperform simple recurrent high order neural networks (RHONNs).

A Real-time Cutting Model Based on Finite Element and Order Reduction

Telemedicine plays an important role in Corona Virus Disease 2019(COVID-19).The virtual surgery simulation system,as a key component in telemedicine,requires to compute in real-time.Therefore,this paper proposes a realtime cutting model based on finite element and order reduction method,which improves the computational speed and ensure the real-time performance.The proposed model uses the finite element model to construct a deformation model of the virtual lung.Meanwhile,a model order reduction method combining proper orthogonal decomposition and Galerkin projection is employed to reduce the amount of deformation computation.In addition,the cutting path is formed according to the collision intersection position of the surgical instrument and the lesion area of the virtual lung.Then,the Bezier curve is adopted to draw the incision outline after the virtual lung has been cut.Finally,the simulation system is set up on the PHANTOM OMNI force haptic feedback device to realize the cutting simulation of the virtual lung.Experimental results show that the proposed model can enhance the real-time performance of telemedicine,reduce the complexity of the cutting simulation and make the incision smoother and more natural.

Subspace Trajectory Piecewise-Linear Model Order Reduction for Nonlinear Circuits

Despite the efficiency of trajectory piecewise-linear(TPWL)model order re-duction(MOR)for nonlinear circuits,it needs large amount of expansion points forlarge-scale nonlinear circuits.This will inevitably increase the model size as well as the simulation time of the resulting reduced macromodels.In this paper,subspaceTPWL-MOR approach is developed for the model order reduction of nonlinear cir-cuits.By breaking the high-dimensional state space into several subspaces with much lower dimensions,the subspace TPWL-MOR has very promising advantages of re-ducing the number of expansion points as well as increasing the effective region of thereduced-order model in the state space.As a result,the model size and the accuracy of the TWPL model can be greatly improved.The numerical results have shown dra-matic reduction in the model size as well as the improvement in accuracy by using the subspace TPWL-MOR compared with the conventional TPWL-MOR approach.

High-Order Models of Nonlinear and Dispersive Wave in Water of Varying Depth with Arbitrary Sloping Bottom

High-order models with a dissipative term for nonlinear and dispersive wave in water of varying depth with an arbitrary sloping bottom are presented in this article. First, the formal derivations to any high order of mu(= h/lambda, depth to deep-water wave length ratio) and epsilon(= a/h, wave amplitude to depth ratio) for velocity potential, particle velocity vector, pressure and the Boussinesq-type equations for surface elevation eta and horizontal velocity vector (U) over right arrow at any given level in water are given. Then, the exact explicit expressions to the fourth order of mu are derived. Finally, the linear solutions of eta, (U) over right arrow, C (phase-celerity) and C-g (group velocity) for a constant water depth are obtained. Compared with the Airy theory, excellent results can be found even for a water depth as large as the wave legnth. The present high-order models are applicable to nonlinear regular and irregular waves in water of any varying depth (from shallow to deep) and bottom slope (from mild to steep).

Adding-Point Strategy for Reduced-Order Hypersonic Aerothermodynamics Modeling Based on Fuzzy Clustering

Reduced order models（ROMs） based on the snapshots on the CFD high-fidelity simulations have been paid great attention recently due to their capability of capturing the features of the complex geometries and flow configurations. To improve the efficiency and precision of the ROMs, it is indispensable to add extra sampling points to the initial snapshots, since the number of sampling points to achieve an adequately accurate ROM is generally unknown in prior, but a large number of initial sampling points reduces the parsimony of the ROMs. A fuzzy-clustering-based adding-point strategy is proposed and the fuzzy clustering acts an indicator of the region in which the precision of ROMs is relatively low. The proposed method is applied to construct the ROMs for the benchmark mathematical examples and a numerical example of hypersonic aerothermodynamics prediction for a typical control surface. The proposed method can achieve a 34.5% improvement on the efficiency than the estimated mean squared error prediction algorithm and shows same-level prediction accuracy.