Detection of gross errors using mixed integer optimization approach in process industry

A novel mixed integer linear programming (NMILP) model for detection of gross errors is presented in this paper. Yamamura et al.(1988) designed a model for detection of gross errors and data reconciliation based on Akaike information cri- terion (AIC). But much computational cost is needed due to its combinational nature. A mixed integer linear programming (MILP) approach was performed to reduce the computational cost and enhance the robustness. But it loses the super performance of maximum likelihood estimation. To reduce the computational cost and have the merit of maximum likelihood estimation, the simultaneous data reconciliation method in an MILP framework is decomposed and replaced by an NMILP subproblem and a quadratic programming (QP) or a least squares estimation (LSE) subproblem. Simulation result of an industrial case shows the high efficiency of the method.

An NT-MT Combined Method for Gross Error Detection and Data Reconciliation

An NT-MT combined method based on nodal test (NT) and measurement test (MT) is developed for gross error detection and data reconciliation for industrial application. The NT-MT combined method makes use of both NT and MT tests and this combination helps to overcome the defects in the respective methods. It also avoids any artificial manipulation and eliminates the huge combinatorial problem that is created in the combined method based on the nodal test in the case of more than one gross error for a large process system. Serial compensation strategy is also used to avoid the decrease of the coefficient matrix rank during the computation of the proposed method. Simulation results show that the proposed method is very effective and possesses good performance.

Single Epoch GPS Deformation Signals Extraction and Gross Error Detection Technique Based on Wavelet Transform

Wavelet theory is efficient as an adequate tool for analyzing single epoch GPS deformation signal. Wavelet analysis technique on gross error detection and recovery is advanced. Criteria of wavelet function choosing and Mallat decomposition levels decision are discussed. An effective deformation signal extracting method is proposed, that is wavelet noise reduction technique considering gross error recovery, which combines wavelet multi-resolution gross error detection results. Time position recognizing of gross errors and their repairing performance are realized. In the experiment, compactly supported orthogonal wavelet with short support block is more efficient than the longer one when discerning gross errors, which can obtain more finely analyses. And the shape of discerned gross error of short support wavelet is simpler than that of the longer one. Meanwhile, the time scale is easier to identify.

Gross Error Detection and Identification Based on Parameter Estimation for Dynamic Systems

The detection and identification of gross errors, especially measurement bias, plays a vital role in data reconciliation for nonlinear dynamic systems. Although parameter estimation method has been proved to be a pow-erful tool for bias identification, without a reliable and efficient bias detection strategy, the method is limited in ef-ficiency and cannot be applied widely. In this paper, a new bias detection strategy is constructed to detect the pres-ence of measurement bias and its occurrence time. With the help of this strategy, the number of parameters to be es-timated is greatly reduced, and sequential detections and iterations are also avoided. In addition, the number of de-cision variables of the optimization model is reduced, through which the influence of the parameters estimated is reduced. By incorporating the strategy into the parameter estimation model, a new methodology named IPEBD (Improved Parameter Estimation method with Bias Detection strategy) is constructed. Simulation studies on a con-tinuous stirred tank reactor (CSTR) and the Tennessee Eastman (TE) problem show that IPEBD is efficient for eliminating random errors, measurement biases and outliers contained in dynamic process data.

Robust Principal Component Test in Gross Error Detection and Identification

Principle component analysis （PCA） based chi-square test is more sensitive to subtle gross errors and has greater power to correctly detect gross errors than classical chi-square test. However, classical principal com- ponent test （PCT） is non-robust and can be very sensitive to one or more outliers. In this paper, a Huber function liked robust weight factor was added in the collective chi-square test to eliminate the influence of gross errors on the PCT. Meanwhile, robust chi-square test was applied to modified simultaneous estimation of gross error （MSEGE） strategy to detect and identify multiple gross errors. Simulation results show that the proposed robust test can reduce the possibility of type Ⅱ errors effectively. Adding robust chi-square test into MSEGE does not obviously improve the power of multiple gross error identification, the proposed approach considers the influence of outliers on hypothesis statistic test and is more reasonable.

Improved Mixed Integer Optimization Approach for Data Rectification with Gross Error Candidates

Mixed integer linear programming （MILP） approach for simultaneous gross error detection and data reconciliation has been proved as an efficient way to adjust process data with material, energy, and other balance constrains. But the efficiency will decrease significantly when this method is applled in a large-scale problem because there are too many binary variables involved. In this article, an improved method is proposed in order to gen- erate gross error candidates with reliability factors before data rectification. Candidates are used in the MILP objec- tive function to improve the efficiency and accuracy by reducing the number of binary variables and giving accurate weights for suspected gross errors candidates. Performance of this improved method is compared and discussed by applying the algorithm in a widely used industrial example.

Ability to detect and locate gross errors on DEM matching algorithm

Digital elevation model(DEM)matching techniques have been extended to DEM deformation detection by substituting a robust estimator for the least squares estimator,in which terrain changes are treated as gross errors.However,all existing methods only emphasise their deformation detecting ability,and neglect another important aspect:only when the gross error can be detected and located,can this system be useful.This paper employs the gross error judgement matrix as a tool to make an in-depth analysis of this problem.The theoretical analyses and experimental results show that observations in the DEM matching algorithm in real applications have the ability to detect and locate gross errors.Therefore,treating the terrain changes as gross errors is theoretically feasible,allowing real DEM deformations to be detected by employing a surface matching technique.