On-Line Batch Process Monitoring Using Multiway Kernel Partial Least Squares

An approach for batch processes monitoring and fault detection based on multiway kernel partial least squares(MKPLS) was presented.It is known that conventional batch process monitoring methods,such as multiway partial least squares(MPLS),are not suitable due to their intrinsic linearity when the variations are nonlinear.To address this issue,kernel partial least squares(KPLS) was used to capture the nonlinear relationship between the latent structures and predictive variables.In addition,KPLS requires only linear algebra and does not involve any nonlinear optimization.In this paper,the application of KPLS was extended to on-line monitoring of batch processes.The proposed batch monitoring method was applied to a simulation benchmark of fed-batch penicillin fermentation process.And the results demonstrate the superior monitoring performance of MKPLS in comparison to MPLS monitoring.

Near-Infrared Spectroscopy Combined with Absorbance Upper Optimization Partial Least Squares Applied to Rapid Analysis of Polysaccharide for Proprietary Chinese Medicine Oral Solution

Near-infrared (NIR) spectroscopy was applied to reagent-free quantitative analysis of polysaccharide of a brand product of proprietary Chinese medicine (PCM) oral solution samples. A novel method, called absorbance upper optimization partial least squares (AUO-PLS), was proposed and successfully applied to the wavelength selection. Based on varied partitioning of the calibration and prediction sample sets, the parameter optimization was performed to achieve stability. On the basis of the AUO-PLS method, the selected upper bound of appropriate absorbance was 1.53 and the corresponding wavebands combination was 400 - 1880 & 2088 - 2346 nm. With the use of random validation samples excluded from the modeling process, the root-mean-square error and correlation coefficient of prediction for polysaccharide were 27.09 mg·L-1 and 0.888, respectively. The results indicate that the NIR prediction values are close to those of the measured values. NIR spectroscopy combined with AUO-PLS method provided a promising tool for quantification of the polysaccharide for PCM oral solution and this technique is rapid and simple when compared with conventional methods.

Quantum partial least squares regression algorithm for multiple correlation problem

Partial least squares(PLS) regression is an important linear regression method that efficiently addresses the multiple correlation problem by combining principal component analysis and multiple regression. In this paper, we present a quantum partial least squares(QPLS) regression algorithm. To solve the high time complexity of the PLS regression, we design a quantum eigenvector search method to speed up principal components and regression parameters construction. Meanwhile, we give a density matrix product method to avoid multiple access to quantum random access memory(QRAM)during building residual matrices. The time and space complexities of the QPLS regression are logarithmic in the independent variable dimension n, the dependent variable dimension w, and the number of variables m. This algorithm achieves exponential speed-ups over the PLS regression on n, m, and w. In addition, the QPLS regression inspires us to explore more potential quantum machine learning applications in future works.

Quantitative structure-property relationship study of cathode volume changes in lithium ion batteries using ab-initio and partial least squares analysis

In this paper,we report a method through the combination of ab-initio calculations and partial least squares(PLS)analysis to develop the Quantitative Structure eActivity Relationship(QSAR)formulations of cathode volume changes in lithium ion batteries.The PLS analysis is based on ab-initio calculation data of 14 oxide cathodes with spinel structure LiX2O4 and 14 oxide cathodes with layered-structure LiXO_(2)(X=Ti,V,Cr,Mn,Fe,Co,Ni,Nb,Mo,Ru,Rh,Pd,Ta,Ir).Five types of descriptors,describing the characteristics of each compound from crystal structure,element,composition,local distortion and electronic level,with 34 factors in total,are adopted to obtain the QSAR formulation.According to the variable importance in projection analysis,the radius of X4t ion,and the X octahedron descriptors make major contributions to the volume change of cathode during delithiation.The analysis is hopefully applied to the virtual screening and combinatorial design of low-strain cathode materials for lithium ion batteries.

Multi-loop adaptive internal model control based on a dynamic partial least squares model

A multi-loop adaptive internal model control (IMC) strategy based on a dynamic partial least squares (PLS) frame-work is proposed to account for plant model errors caused by slow aging,drift in operational conditions,or environmental changes.Since PLS decomposition structure enables multi-loop controller design within latent spaces,a multivariable adaptive control scheme can be converted easily into several independent univariable control loops in the PLS space.In each latent subspace,once the model error exceeds a specific threshold,online adaptation rules are implemented separately to correct the plant model mismatch via a recursive least squares (RLS) algorithm.Because the IMC extracts the inverse of the minimum part of the internal model as its structure,the IMC controller is self-tuned by explicitly updating the parameters,which are parts of the internal model.Both parameter convergence and system stability are briefly analyzed,and proved to be effective.Finally,the proposed control scheme is tested and evaluated using a widely-used benchmark of a multi-input multi-output (MIMO) system with pure delay.

Quick assessment of chicken spoilage based on hyperspectral NIR spectra combined with partial least squares regression

Pseudomonas spp.and Enterobacteriaceae are dominant spoilage bacteria in chicken during cold storage(0°C-4°C).In this study,high resolution spectra in the range of 900-1700 nm were acquired and preprocessed using Savitzky-Golay convolution smoothing(SGCS),standard normal variate(SNV)and multiplicative scatter correction(MSC),respectively,and then mined using partial least squares(PLS)algorithm to relate to the total counts of Pseudomonas spp.and Enterobacteriaceae(PEC)of fresh chicken breasts to predict PEC rapidly.The results showed that with full 900-1700 nm range wavelength,MSC-PLS model built with MSC spectra performed better than PLS models with other spectra(RAW-PLS,SGCS-PLS,SNV-PLS),with correlation coefficient(RP)of 0.954,root mean square error of prediction(RMSEP)of 0.396 log10 CFU/g and residual predictive deviation(RPD)of 3.33 in prediction set.Based on the 12 optimal wavelengths(902.2 nm,905.5 nm,923.6 nm,938.4 nm,946.7 nm,1025.7 nm,1124.4 nm,1211.6 nm,1269.2 nm,1653.7 nm,1691.8 nm and 1693.4 nm)selected from MSC spectra by successive projections algorithm(SPA),SPA-MSC-PLS model had RP of 0.954,RMSEP of 0.397 log10 CFU/g and RPD of 3.32,similar to MSC-PLS model.The overall study indicated that NIR spectra combined with PLS algorithm could be used to detect the PEC of chicken flesh in a rapid and non-destructive way.

Partial Least Squares Method for Treatment Effect in Observational Studies with Censored Outcomes

为了估计真处理，在处理任务在观察研究，潜力惊讶效果和复杂异质在审查结果上完成不得不适当地被调整。在这篇文章，我们证明部分最少的广场方法能是一个珍贵工具在这方面。这被显示出部分最少的广场方法能足够地不仅在处理赋值说明异质，而且对处理赋值模型错误说明柔韧。数字结果证明部分最少的广场评估者更有效、柔韧。一个真实数据集合被分析说明建议方法。

Development a Spectrophotometric of Fe(Ⅲ), Al(Ⅲ) and Cu(Ⅱ) Using Eriochrome Cyanine R Ligand and Assessment of the Obtained Data by Partial Least-Squares and Artificial Neural Network Method-Application to Natural Waters

Simultaneous determination of heavy metal cations and accurate quantitative prediction of them are of great interest in analytical chemistry.This work has focused on a comprehensive comparison of partial least squares(PLS-1)and artificial neural networks(ANN)as two types of chemometric methods.For this purpose,aluminum,iron and copper were studied as three analytes whose UV-Vis absorption spectra highly overlap each other.Accordance with determined parameters(ligand concentration,pH,waiting times,the relationship between absorbance and concentration of metal ion effect and foreign ions)are provided and the optimum conditions.After establishing the optimum conditions for Fe^(3+),Al^(3+) and Cu^(2+) containing mixtures spectrophotometric determinations and the data calibration method of least squares(PLS-1)regression,and artificial neural network(ANN)methods were used.Chemometric methods are applied in a fast,simple,and the results are applicable.

Quantitative Analysis of Methanol in Methanol Gasoline by Calibration Transfer Strategy Based on Kernel Domain Adaptive Partial Least Squares(kda-PLS)

The application of near-infrared(NIR)spectroscopy combined with multivariate calibration methods can achieve the rapid analysis of methanol gasoline.However,instrumental or environmental differences found for spectra make it impossible to continuously apply the previously developed calibration model.Therefore,the calibration transfer technique would be required to solve the time-consuming and laborious problem of reestablishing a new model.In this work,a calibration transfer method named kernel domain adaptive partial least squares(kda-PLS)was applied to the calibration transfer from the primary instrument to the secondary ones.Firstly,wavelet transform(WT)and variable importance in projection(VIP)were employed to enhance the predictive performance of the kda-PLS transfer model.Then,the results found for the calibration transfer by piecewise direct standardization(PDS)and domain adaptive partial least squares(da-PLS)were compared to verify the calibration transfer(CT)effect of kda-PLS.The results point that the kda-PLS method can transfer the PLS model developed on the primary instrument to the secondary ones,and achieve results comparable to the those of reestablishing a new PLS model on the secondary instrument,with R_(P)^(2)=0.9979(R_(P)^(2):coefficients of determination of the prediction set),RMSEP=0.0040(RMSEP:root mean square error of the prediction set),and MREP=3.03%(MREP:mean relative error of the prediction set).Therefore,kda-PLS will provide a new method for quantitative analysis of methanol content in methanol gasoline.

Partial least squares based identification of Duchenne muscular dystrophy specific genes#

Large-scale parallel gene expression analysis has provided a greater ease for investigating the underlying mechanisms of Duchenne muscular dystrophy(DMD).Previous studies typically implemented variance/regression analysis,which would be fundamentally flawed when unaccounted sources of variability in the arrays existed.Here we aim to identify genes that contribute to the pathology of DMD using partial least squares(PLS)based analysis.We carried out PLS-based analysis with two datasets downloaded from the Gene Expression Omnibus(GEO)database to identify genes contributing to the pathology of DMD.Except for the genes related to inflammation,muscle regeneration and extracellular matrix(ECM)modeling,we found some genes with high fold change,which have not been identified by previous studies,such as SRPX,GPNMB,SAT1,and LYZ.In addition,downregulation of the fatty acid metabolism pathway was found,which may be related to the progressive muscle wasting process.Our results provide a better understanding for the downstream mechanisms of DMD.

Quality-related monitoring of papermaking wastewater treatment processes using dynamic multiblock partial least squares

Environmental problems have attracted much attention in recent years,especially for papermak-ing wastewater discharge.To reduce the loss of effluence discharge violation,quality-related multivariate statistical methods have been successfully applied to achieve a robust wastewater treatment system.In this work,a new dynamic multiblock partial least squares(DMBPLS)is pro-posed to extract the time-varying information in a large-scale papermaking wastewater treatment process.By introducing augmented matrices to input and output data,the proposed method not only handles the dynamic characteristic of data and reduces the time delay of fault detection,but enhances the interpretability of model.In addition,the DMBPLS provides a capability of fault location,which has certain guiding significance for fault recovery.In comparison with other mod-els,the DMBPLS has a superior fault detection result.Specifically,the maximum fault detection rate of the DMBPLS is improved by 35.93%and 12.5%for bias and drifting faults,respectively,in comparison with partial least squares(PLS).

Characteristics of laser-induced breakdown spectroscopy of liquid slag

Rapid online analysis of liquid slag is essential for optimizing the quality and energy efficiency of steel production. To investigate the key factors that affect the online measurement of refined slag using laser-induced breakdown spectroscopy(LIBS), this study examined the effects of slag composition and temperature on the intensity and stability of the LIBS spectra. The experimental temperature was controlled at three levels: 1350℃, 1400℃, and 1450℃. The results showed that slag composition and temperature significantly affected the intensity and stability of the LIBS spectra. Increasing the Fe content and temperature in the slag reduces its viscosity, resulting in an enhanced intensity and stability of the LIBS spectra. Additionally, 42 refined slag samples were quantitatively analyzed for Fe, Si, Ca, Mg, Al, and Mn at 1350℃, 1400℃, and 1450℃.The normalized full spectrum combined with partial least squares(PLS) quantification modeling was used, using the Ca Ⅱ 317.91 nm spectral line as an internal standard. The results show that using the internal standard normalization method can significantly reduce the influence of spectral fluctuations. Meanwhile, a temperature of 1450℃ has been found to yield superior results compared to both 1350℃ and 1400℃, and it is advantageous to conduct a quantitative analysis of the slag when it is in a “water-like” state with low viscosity.

Near Infrared Spectroscopy (NIRS) Model-Based Prediction for Protein Content in Cowpea

Cowpea (Vigna unguiculata L. Walp) is a multi-purpose legume with high quality protein for human consumption and livestock. The objective of this work was to develop near-infrared spectroscopy (NIRS) prediction models to estimate protein content in cowpea. A total of 116 cowpea breeding lines with a wide range of protein contents (19.28 % to 32.04%) were selected to build the model using whole seed and ground seed samples. Partial least-squares discriminant analysis (PLS-DA) regression technique with different pre-treatments (derivatives, standard normal variate, and multiplicative scatter correction) were carried out to develop the protein prediction model. Results showed: 1) spectral plots of both the whole seed and ground seed showed higher spectral scatter at higher wavelengths (>1450 nm), 2) data pre-processing affects prediction accuracy for bot whole seed and ground seed samples, 3) prediction using ground seed samples (0.64 R2 0.85) is better than the whole seed (0.33 R2 0.78), and 4) the data pre-processing second derivative with standard normal variate has the best prediction (R2_whole seed = 0.78, R2_ground seed = 0.85). The results will be of interest in cowpea breeding programs aimed at improving total seed protein content.

A novel procedure for identifying a hybrid QTL-allele system for hybrid-vigor improvement, with a case study in soybean(Glycine max)yield

“Breeding by design” for pure lines may be achieved by construction of an additive QTL-allele matrix in a germplasm panel or breeding population, but this option is not available for hybrids, where both additive and dominance QTL-allele matrices must be constructed. In this study, a hybrid-QTL identification approach, designated PLSRGA, using partial least squares regression(PLSR) for model fitting integrated with a genetic algorithm(GA) for variable selection based on a multi-locus, multi-allele model is described for additive and dominance QTL-allele detection in a diallel hybrid population(DHP). The PLSRGA was shown by simulation experiments to be superior to single-marker analysis and was then used for QTL-allele identification in a soybean DPH yield experiment with eight parents. Twenty-eight main-effect QTL with 138 alleles and nine QTL × environment QTL with 46 alleles were identified, with respective contributions of 61.8% and 23.5% of phenotypic variation. Main-effect additive and dominance QTL-allele matrices were established as a compact form of the DHP genetic structure. The mechanism of heterosis superior-to-parents(or superior-to-parents heterosis, SPH) was explored and might be explained by a complementary locus-set composed of OD+(showing positive over-dominance, most often), PD+(showing positive partial-to-complete dominance, less often) and HA+(showing positive homozygous additivity, occasionally) loci, depending on the parental materials. Any locus-type, whether OD+, PD + and HA+, could be the best genotype of a locus. All hybrids showed various numbers of better or best genotypes at many but not necessarily all loci, indicating further SPH improvement. Based on the additive/dominance QTL-allele matrices, the best hybrid genotype was predicted, and a hybrid improvement approach is suggested. PLSRGA is powerful for hybrid QTL-allele detection and cross-SPH improvement.

Feasibility study of assessing cotton fiber maturity from near infrared hyperspectral imaging technique

Background Fiber maturity is a key cotton quality property,and its variability in a sample impacts fiber processing and dyeing performance.Currently,the maturity is determined by using established protocols in laboratories under a controlled environment.There is an increasing need to measure fiber maturity using low-cost(in general less than $20000)and small portable systems.In this study,a laboratory feasibility was performed to assess the ability of the shortwave infrared hyperspectral imaging(SWIR HSI)technique for determining the conditioned fiber maturity,and as a comparison,a bench-top commercial and expensive(in general greater than $60000)near infrared(NIR)instrument was used.Results Although SWIR HSI and NIR represent different measurement technologies,consistent spectral characteristics were observed between the two instruments when they were used to measure the maturity of the locule fiber samples in seed cotton and of the well-defined fiber samples,respectively.Partial least squares(PLS)models were established using different spectral preprocessing parameters to predict fiber maturity.The high prediction precision was observed by a lower root mean square error of prediction(RMSEP)(<0.046),higher R_(p)^(2)(>0.518),and greater percentage(97.0%)of samples within the 95% agreement range in the entire NIR region(1000-2500 nm)without the moisture band at 1940 nm.Conclusion SWIR HSI has a good potential for assessing cotton fiber maturity in a laboratory environment.

Retrieval of Winter Wheat Canopy Carotenoid Content with Ground-and Airborne-Based Hyperspectral Data

Accurate assessment of canopy carotenoid content(CC_(x+c)C)in crops is central to monitor physiological conditions in plants and vegetation stress,and consequently supporting agronomic decisions.However,due to the overlap of absorption peaks of carotenoid(C_(x+c))and chlorophyll(C_(a+b)),accurate estimation of carotenoid using reflectance where carotenoid absorb is challenging.The objective of present study was to assess CC_(x+c)C in winter wheat(Triticum aestivum L.)with ground-and aircraft-based hyperspectral measurements in the visible and near-infrared spectrum.In-situ hyperspectral reflectance were measured and airborne hyperspectral data were acquired during major growth stages of winter wheat in five consecutive field experiments.At the canopy level,a remarkable linear relationship(R^(2)=0.95,p<0.001)existed between C_(x+c) and Ca+b,and correlation between CC_(x+c)C and wavelengths within 400 to 1000 nm range indicated that CC_(x+c)C could be estimated using reflectance ranging from visible to near-infrared wavebands.Results of Cx+c assessment based on chlorophyll and carotenoid indices showed that red edge chlorophyll index(CI red edge)performed with the highest accuracy(R^(2)=0.77,RMSE=22.27μg/cm^(2),MAE=4.97μg/cm^(2)).Applying partial least square regression(PLSR)in CC_(x+c)C retrieval emphasized the significance of reflectance within 700 to 750 nm range in CC_(x+c)C assessment.Based on CI red edge index,use of airborne hyperspectral imagery achieved satisfactory results in mapping the spatial distribution of CC_(x+c)C.This study demonstrates that it is feasible to accurately assess CC_(x+c)C in winter wheat with red edge chlorophyll index provided that C_(x+c) correlated well with C_(a+b) at the canopy scale.it is therefore a promising method for CC_(x+c)C retrieval at regional scale from aerial hyperspectral imagery.

Estimating the Texture of Purple Soils Using Vis-NIR Spectroscopy and Optimized Conversion Models

Soil texture is an indicator of soil physical structure which delivers many ecological functions of soils such as thermal regime, plant growth, and soil quality. However, traditional methods for soil texture measurement are time-consuming and labor-intensive. This study attempts to explore an indirect method for rapid estimating the texture of three subgroups of purple soils (i.e. calcareous, neutral, and acidic). 190 topsoil (0 - 10 cm) samples were collected from sloping croplands in Tongnan and Beibei Districts of Chongqing Municipality in China. Vis-NIR spectrum was measured and processed, and stepwise multiple linear regression (SMLR), partial least squares regression (PLSR), and back propagation neural network (BPNN) models were constructed to inform the soil texture. The clay fractions ranged from 4.40% to 27.12% while sand fractions ranged from 0.34% to 36.57%, hereby soil samples encompass three textural classes (i.e. silt, silt loam, and silty clay loam). For the original spectrum, the texture of calcareous and neutral purple soils was not significantly correlated with spectral reflectance and linear models (SMLR and PLSR) exhibited low prediction accuracy. The correlation coefficients and the goodness-of-fits between soil texture and the transformed spectra of all soil groups increased by continuum-removal (CR), first-order differential (R'), and second-order differential (R") transformations. Among them, the R" had the best performance in terms of improving the correlation coefficients and the goodness-of-fits. For the calcareous purple soil, the SMLR exceeds PLSR and BPNN with a higher coefficient of determination (R2) and the ratio of performance to inter-quartile distance (RPIQ) values and lower root mean square error of validation (RMSEV), but for the neutral and acidic purple soils, the PLSR model has a better prediction accuracy. In summary, the linear methods (SMLR and PLSR) are more reliable in estimating the texture of the three purple soil groups when using Vis-NIR spectroscopy inversion.

A novel NIRS modelling method with OPLS-SPA and MIX-PLS for timber evaluation

The identification of timber properties is important for safe application.Near Infrared Spectroscopy(NIRS)technology is widely-used because of its simplicity,efficiency,and positive environmental attributes.However,in its application,weak signals are extracted from complex,overlapping and changing information.This study focused on the stability of NIR modeling.The Orthogonal Partial Least Squares(OPLS)and Successive Projections Algorithm(SPA)eliminates noise and extracts effective spectra,and an ensemble learning method MIX-PLS,is applied to establish the model.The elastic modulus of timber is taken as an example,and 201 wood samples of three species,Xylosmacongesta(Lour.)Merr.,Acer pictum subsp.mono,and Betula pendula,samples were divided into three groups to investigate modelling performance.The results show that OPLS can preprocess the near-infrared spectroscopy information according to the target object in the face of the system error and reduce errors to minimum.SPA finally selects 13 spectral bands,simplifies the NIR spectral data and improves model accuracy.The Pearson's correlation coefficient of Calibration(Rc)and the Pearson's correlation coefficient of Prediction(Rp)of Mix Partial Least Squares(MIX-PLS)were 0.95 and 0.90,and Root Mean Square Error of Calibration(RMSEC)and Root Mean Square Error of Prediction(RMSEP)are 2.075 and 6.001,respectively,which shows the model has good generalization abilities.

Identifying camellia oil adulteration with selected vegetable oils by characteristic near-infrared spectral regions

In this paper,a methodology based on characteristic spectral bands of near infrared spectroscopy(1000-2500 nm)and multivariate analysis was proposed to identify camellia oil adulteration withvegetable oils,Sunflower,peanut and corn oils were selected to conduct the test.Pure camlia oiland that adulterated with varying concentrations(1-10%with the gradient of 1%,10-40%withthe gradient of 5%,40-100%with the gradient of 10%)of each type of the three vegetable oilswere prepared,respectively.For each type of adulterated oil,full-spectrum partial least squarespartial least squares(PLS)models and synergy interval partial least squares(SI-PLS)modelswere developed.Parameters of these models were optimized simultaneously by cross-validation,The SI-PLS models were proved to be better than the full-spectrum PLS models.In SI-PLSmodels,the correlation coefficients of predition set(Rp)were 0.9992,0.9998 and 0.9999 foradulteration with sunflower oil,peanut oiloil seperately;the corresponding root meansquare errors of prediction set(RMSEP).66nd 0.37.Furthermore,a new genericPLS model was built based on the chalselected from the intervals of thethree SI-PLS models to identify the oil adulterantsardless of the adultrated oil types.Themodel achieved with Rp=0.9988 and RMSEP==1.52,These results indicated that the charac-teristic near infrared spectral regions could determine the level of adulteration in the camllia oil.

AO-MW-PLS method applied to rapid quantification of teicoplanin with near-infrared spectroscopy

Teicoplanin(TCP)is an important lipoglycopeptide antibiotic produced by fermenting Acti-noplanes teichomyceticus.The change in TCP concentration is important to measure in the fermentation process.In this study,a reagent-free and rapid quantification method for TCP in the TCP-Tris-HCl mixture samples was developed using near infrared(NIR)spectroscopy by focusing our attention on the fermentation process for TCP.The absorbance optimization(AO)partial least squares(PLS)was proposed and integrated with the moving window(MW)PLS,which is called AO-MW-PLS method,to select appropriate wavebands.Amodel set that includes various wavebands that were equivalent to the optimal AO-MW-PLS waveband was,proposed based on statistical considerations.The public region of all equivalent wavebands was just one of the equivalent wavebands.The obtained public regions were 1540-1868 nm for TCP and 1114-1310 nm for Tris.The root-mean-square error and correlation coeficient for leave-one-out cross validation were 0.046 mg mL^(-1)and 0.9998 mg mL^(-1)for TCP,and 0.235 mg mL^(-1)and 0.9986 mg mL^(-1)for Tris,respectively.All the models achieved highly accurate prediction effects,and the selected wavebands provided valuable references for designing specialized spectrometers.This study provided a valuable reference for further application of the proposed methods to TCP fermentation broth and to other spectroscopic analysis fields.