A Deep Residual PLS for Data-Driven Quality Prediction Modeling in Industrial Process

Partial least squares(PLS)model is the most typical data-driven method for quality-related industrial tasks like soft sensor.However,only linear relations are captured between the input and output data in the PLS.It is difficult to obtain the remaining nonlinear information in the residual subspaces,which may deteriorate the prediction performance in complex industrial processes.To fully utilize data information in PLS residual subspaces,a deep residual PLS(DRPLS)framework is proposed for quality prediction in this paper.Inspired by deep learning,DRPLS is designed by stacking a number of PLSs successively,in which the input residuals of the previous PLS are used as the layer connection.To enhance representation,nonlinear function is applied to the input residuals before using them for stacking highlevel PLS.For each PLS,the output parts are just the output residuals from its previous PLS.Finally,the output prediction is obtained by adding the results of each PLS.The effectiveness of the proposed DRPLS is validated on an industrial hydrocracking process.

Product quality prediction based on RBF optimized by firefly algorithm

With the development of information technology,a large number of product quality data in the entire manufacturing process is accumulated,but it is not explored and used effectively.The traditional product quality prediction models have many disadvantages,such as high complexity and low accuracy.To overcome the above problems,we propose an optimized data equalization method to pre-process dataset and design a simple but effective product quality prediction model:radial basis function model optimized by the firefly algorithm with Levy flight mechanism(RBFFALM).First,the new data equalization method is introduced to pre-process the dataset,which reduces the dimension of the data,removes redundant features,and improves the data distribution.Then the RBFFALFM is used to predict product quality.Comprehensive expe riments conducted on real-world product quality datasets validate that the new model RBFFALFM combining with the new data pre-processing method outperforms other previous me thods on predicting product quality.

Study Progress Analysis of Effluent Quality Prediction in Activated Sludge Process Based on CiteSpace

In this paper, CiteSpace, a bibliometrics software, was adopted to collect research papers published on the Web of Science, which are relevant to biological model and effluent quality prediction in activated sludge process in the wastewater treatment. By the way of trend map, keyword knowledge map, and co-cited knowledge map, specific visualization analysis and identification of the authors, institutions and regions were concluded. Furthermore, the topics and hotspots of water quality prediction in activated sludge process through the literature-co-citation-based cluster analysis and literature citation burst analysis were also determined, which not only reflected the historical evolution progress to a certain extent, but also provided the direction and insight of the knowledge structure of water quality prediction and activated sludge process for future research.

Yarn Quality Prediction for Small Samples Based on AdaBoost Algorithm

In order to solve the problems of weak prediction stability and generalization ability of a neural network algorithm model in the yarn quality prediction research for small samples,a prediction model based on an AdaBoost algorithm(AdaBoost model) was established.A prediction model based on a linear regression algorithm(LR model) and a prediction model based on a multi-layer perceptron neural network algorithm(MLP model) were established for comparison.The prediction experiments of the yarn evenness and the yarn strength were implemented.Determination coefficients and prediction errors were used to evaluate the prediction accuracy of these models,and the K-fold cross validation was used to evaluate the generalization ability of these models.In the prediction experiments,the determination coefficient of the yarn evenness prediction result of the AdaBoost model is 76% and 87% higher than that of the LR model and the MLP model,respectively.The determination coefficient of the yarn strength prediction result of the AdaBoost model is slightly higher than that of the other two models.Considering that the yarn evenness dataset has a weaker linear relationship with the cotton dataset than that of the yarn strength dataset in this paper,the AdaBoost model has the best adaptability for the nonlinear dataset among the three models.In addition,the AdaBoost model shows generally better results in the cross-validation experiments and the series of prediction experiments at eight different training set sample sizes.It is proved that the AdaBoost model not only has good prediction accuracy but also has good prediction stability and generalization ability for small samples.

Application of Time Serial Model in Water Quality Predicting

Water resources are an indispensable and valuable resource for human survival and development.Water quality predicting plays an important role in the protection and development of water resources.It is difficult to predictwater quality due to its random and trend changes.Therefore,amethod of predicting water quality which combines Auto Regressive Integrated Moving Average(ARIMA)and clusteringmodelwas proposed in this paper.By taking thewater qualitymonitoring data of a certain river basin as a sample,thewater quality Total Phosphorus(TP)index was selected as the prediction object.Firstly,the sample data was cleaned,stationary analyzed,and white noise analyzed.Secondly,the appropriate parameters were selected according to the Bayesian Information Criterion(BIC)principle,and the trend component characteristics were obtained by using ARIMA to conduct water quality predicting.Thirdly,the relationship between the precipitation and the TP index in themonitoring water field was analyzed by the K-means clusteringmethod,and the random incremental characteristics of precipitation on water quality changes were calculated.Finally,by combining with the trend component characteristics and the random incremental characteristics,the water quality prediction results were calculated.Compared with the ARIMA water quality prediction method,experiments showed that the proposed method has higher accuracy,and its Mean Absolute Error(MAE),Mean Square Error(MSE),and Mean Absolute Percentage Error(MAPE)were respectively reduced by 44.6%,56.8%,and 45.8%.

Are yarn quality prediction tools useful in the breeding of high yielding and better fibre quality cotton(Gossypium hirsutum L.)?

Results The population had large variations for lint yield,fibre properties,predicted yarn properties,and composite fibre quality values.Lint yield with all fibre quality traits was not correlated.When the selection was conducted first to keep those with improved fibre quality,and followed for high yields,a large proportion in the resultant populations was the same between selections based on Cottonspec predicted yarn quality and HVI-measured fibre properties.They both exceeded the selection based on FQI and Background The approach of directly testing yarn quality to define fibre quality breeding objectives and progress the selection is attractive but difficult when considering the need for time and labour.The question remains whether yarn prediction tools from textile research can serve as an alternative.In this study,using a dataset from three seasons of field testing recombinant inbred line population,Cottonspec,a software developed by the Commonwealth Scientific and Industrial Research Organisation(CSIRO)for predicting ring spun yarn quality from fibre properties measured by High Volume Instrument(HVI),was used to select improved fibre quality and lint yield in the population.The population was derived from an advanced generation inter-crossing of four CSIRO conventional commercial varieties.The Cottonspec program was able to provide an integrated index of the fibre qualities affecting yarn properties.That was compared with selection based on HVI-measured fibre properties,and two composite fibre quality variables,namely,fibre quality index(FQI),and premium and discount(PD)points.The latter represents the net points of fibre length,strength,and micronaire based on the Premiums and Discounts Schedule used in the market while modified by the inclusion of elongation.PD points.Conclusions The population contained elite segregants with improved yield and fibre properties,and Cottonspec predicted yarn quality is useful to effectively capture these elites.There is a need to further develop yarn quality prediction tools through collaborative efforts with textile mills,to draw better connectedness between fibre and yarn quality.This connection will support the entire cotton value chain research and evolution.

Quality prediction of freshly-harvested wheat using Gluto Peak during postharvest maturation

Much recent researches have demonstrated that the quality of freshly-harvested wheat could be improved during postharvest maturation by determinating the rheological properties.However,this process is time-consuming and complex.This study aimed to provide a rapid and convenient method for predicting wheat quality during postharvest maturation by use of Gluto Peak device.Farinograph and Extensograph were used to determine the rheological properties of four wheat samples(WT1,WT2,WT3,WT4)stored under different conditions(WT1:15℃,50%RH;WT2:20℃65%RH;WT3:28℃75%RH;WT4:35℃85%RH)for a total of 10 weeks,and Gluto Peak test was used to determine the gluten aggregation properties of the four samples.Correlation analysis was also conducted between the rheological properties and the gluten aggregation properties.Results of rheological properties showed that all Extensographic properties(dough extensibility,resistance,maximum resistance and area)of the four samples increased along with the storage time,and the Farinographic properties(water absorption,dough development time,dough stability time,and farinograph quality number(FQN))had the same tendency,indicating that the rheological properties were improved considerably with storage time extending.The Gluto Peak curves revealed that Peak Maximum Time(PMT),Brabender Equivalents Maximum(BEM)and Energy to Maximum Torque(En MT)of wheat flour of the four samples varied greatly,particularly the PMT and En MT of the samples WT3 and WT4 increased remarkably.Results of correlation analysis showed that En MT had significant correlation with water absorption and area(P<0.05)for sample WT1,and also showed significant correlation with dough development time(P<0.05)for sample WT2.For sample WT3,PMT was significantly correlated with the dough development time,extensibility,area(P<0.05),and FQN(P<0.01);and En MT was in significant correction with water absorption(P<0.01),and dough stability time,FQN,extensibility,maximum resistance and area(P<0.05).For sample WT4,both PMT and En MT had significant correction with area(P<0.05).The study indicated that the Gluto Peak test is effective in quality prediction for the freshly-harvested wheat during postharvest maturation,making it possible to realize rapid wheat quality detection and evaluation in storage period.

Improved Quality Prediction Model for Multistage Machining Process Based on Geometric Constraint Equation

Product variation reduction is critical to improve process efficiency and product quality, especially for multistage machining process（MMP）. However, due to the variation accumulation and propagation, it becomes quite difficult to predict and reduce product variation for MMP. While the method of statistical process control can be used to control product quality, it is used mainly to monitor the process change rather than to analyze the cause of product variation. In this paper, based on a differential description of the contact kinematics of locators and part surfaces, and the geometric constraints equation defined by the locating scheme, an improved analytical variation propagation model for MMP is presented. In which the influence of both locator position and machining error on part quality is considered while, in traditional model, it usually focuses on datum error and fixture error. Coordinate transformation theory is used to reflect the generation and transmission laws of error in the establishment of the model. The concept of deviation matrix is heavily applied to establish an explicit mapping between the geometric deviation of part and the process error sources. In each machining stage, the part deviation is formulized as three separated components corresponding to three different kinds of error sources, which can be further applied to fault identification and design optimization for complicated machining process. An example part for MMP is given out to validate the effectiveness of the methodology. The experiment results show that the model prediction and the actual measurement match well. This paper provides a method to predict part deviation under the influence of fixture error, datum error and machining error, and it enriches the way of quality prediction for MMP.

Development and application of a GIS-based artificial neural network system for water quality prediction: a case study at the Lake Champlain area

Artificial Neural Network(ANN)models have been extensively applied in the prediction of water resource variables,and Geographical Information System(GIS)includes powerful functions to visualize spatial data.In order to provide an efficient tool for environmental assessment and management that combines the advantages of these two modules,a GIS-based ANN water quality prediction system was developed in the present study.The ANN module and ArcGIS Engine module,along with a dynamic database,were imbedded in the system,which integrates water quality prediction via the ANN model and spatial presentation of the model results.The structure of the ANN model could be modified through the graphical user interface to optimize the model performance.The developed system was applied to a real case study for the prediction of the total phosphorus concentration in the Lake Champlain area.The prediction results were verified with the monitoring data,and the performance of the developed model was further evaluated through graphical techniques and quantitative statistical methods.Overall,the developed system provided satisfactory prediction results,and spatial distribution maps of the predicted results were obtained,which coincided with the monitored values.The developed GIS-based ANN water quality prediction system could serve as an efficient tool for engineers and decision makers.

Parameter selecting and quality predicting of spot welding based on artificial neural networks

This paper proposes a procedure for using artificial neural networks (ANN) in spot welding , and establishes spot welding parameter selecting ANN systems and spot welding joint quality predicting ANN systems . It has been proved that the ANN systems have high prediction precision , providing a new way of parameter selecting and quality predicting in spot welding .

Yarn Quality Prediction and Diagnosis Based on Rough Set and Knowledge-Based Artificial Neural Network

In the spinning process, some key process parameters( i. e.,raw material index inputs) have very strong relationship with the quality of finished products. The abnormal changes of these process parameters could result in various categories of faulty products. In this paper, a hybrid learning-based model was developed for on-line intelligent monitoring and diagnosis of the spinning process. In the proposed model, a knowledge-based artificial neural network( KBANN) was developed for monitoring the spinning process and recognizing faulty quality categories of yarn. In addition,a rough set( RS)-based rule extraction approach named RSRule was developed to discover the causal relationship between textile parameters and yarn quality. These extracted rules were applied in diagnosis of the spinning process, provided guidelines on improving yarn quality,and were used to construct KBANN. Experiments show that the proposed model significantly improve the learning efficiency, and its prediction precision is improved by about 5. 4% compared with the BP neural network model.

Air Quality Prediction Based on Kohonen Clustering and ReliefF Feature Selection

Air quality prediction is an important part of environmental governance.The accuracy of the air quality prediction also affects the planning of people’s outdoor activities.How to mine effective information from historical data of air pollution and reduce unimportant factors to predict the law of pollution change is of great significance for pollution prevention,pollution control and pollution early warning.In this paper,we take into account that there are different trends in air pollutants and that different climatic factors have different effects on air pollutants.Firstly,the data of air pollutants in different cities are collected by a sliding window technology,and the data of different cities in the sliding window are clustered by Kohonen method to find the same tends in air pollutants.On this basis,combined with the weather data,we use the ReliefF method to extract the characteristics of climate factors that helpful for prediction.Finally,different types of air pollutants and corresponding extracted the characteristics of climate factors are used to train different sub models.The experimental results of different algorithms with different air pollutants show that this method not only improves the accuracy of air quality prediction,but also improves the operation efficiency.

Combined Method of Chaotic Theory and Neural Networks for Water Quality Prediction

Chaos theory was introduced for water quality, prediction, and the model of water quality prediction was established by combining phase space reconstruction theory and BP neural network forecasting method. Through the phase space reconstruction, the one-dimensional water quality time series were mapped to be multi-dimensional sequence, which enriched the spatial information of water quality change and expanded mapping region of training samples of BP neural network. Established model of combining chaos theory and BP neural network were applied to forecast turbidity time series of a certain reservoir. Contrast to BP neural network method, the relative error and the mean squared error of the combined method had all varying degrees of lower. Results indicated the neural network model with chaos theory had the higher prediction accuracy, at the same time, it had better fault-tolerant capability and generalization performance .

Brain-inspired multimodal approach for effluent quality prediction using wastewater surface images and water quality data

Efficiently predicting effluent quality through data-driven analysis presents a significant advancement for consistent wastewater treatment operations.In this study,we aimed to develop an integrated method for predicting effluent COD and NH3 levels.We employed a 200 L pilot-scale sequencing batch reactor(SBR)to gather multimodal data from urban sewage over 40 d.Then we collected data on critical parameters like COD,DO,pH,NH_(3),EC,ORP,SS,and water temperature,alongside wastewater surface images,resulting in a data set of approximately 40246 points.Then we proposed a brain-inspired image and temporal fusion model integrated with a CNN-LSTM network(BITF-CL)using this data.This innovative model synergized sewage imagery with water quality data,enhancing prediction accuracy.As a result,the BITF-CL model reduced prediction error by over 23%compared to traditional methods and still performed comparably to conventional techniques even without using DO and SS sensor data.Consequently,this research presents a cost-effective and precise prediction system for sewage treatment,demonstrating the potential of brain-inspired models.

A benchmark-based method for evaluating hyperparameter optimization techniques of neural networks for surface water quality prediction

Neural networks(NNs)have been used extensively in surface water prediction tasks due to computing algorithm improvements and data accumulation.An essential step in developing an NN is the hyperparameter selection.In practice,it is common to manually determine hyperparameters in the studies of NNs in water resources tasks.This may result in considerable randomness and require significant computation time;therefore,hyperparameter optimization(HPO)is essential.This study adopted five representatives of the HPO techniques in the surface water quality prediction tasks,including the grid sampling(GS),random search(RS),genetic algorithm(GA),Bayesian optimization(BO)based on the Gaussian process(GP),and the tree Parzen estimator(TPE).For the evaluation of these techniques,this study proposed a method:first,the optimal hyperparameter value sets achieved by GS were regarded as the benchmark;then,the other HPO techniques were evaluated and compared with the benchmark in convergence,optimization orientation,and consistency of the optimized values.The results indicated that the TPE-based BO algorithm was recommended because it yielded stable convergence,reasonable optimization orientation,and the highest consistency rates with the benchmark values.The optimization consistency rates via TPE for the hyperparameters hidden layers,hidden dimension,learning rate,and batch size were 86.7%,73.3%,73.3%,and 80.0%,respectively.Unlike the evaluation of HPO techniques directly based on the prediction performance of the optimized NN in a single HPO test,the proposed benchmark-based HPO evaluation approach is feasible and robust.

A Hybrid Air Quality Prediction Model Based on Empirical Mode Decomposition

Air pollution is a severe environmental problem in urban areas.Accurate air quality prediction can help governments and individuals make proper decisions to cope with potential air pollution.As a classic time series forecasting model,the AutoRegressive Integrated Moving Average(ARIMA)has been widely adopted in air quality prediction.However,because of the volatility of air quality and the lack of additional context information,i.e.,the spatial relationships among monitor stations,traditional ARIMA models suffer from unstable prediction performance.Though some deep networks can achieve higher accuracy,a mass of training data,heavy computing,and time cost are required.In this paper,we propose a hybrid model to simultaneously predict seven air pollution indicators from multiple monitoring stations.The proposed model consists of three components:(1)an extended ARIMA to predict matrix series of multiple air quality indicators from several adjacent monitoring stations;(2)the Empirical Mode Decomposition(EMD)to decompose the air quality time series data into multiple smooth sub-series;and(3)the truncated Singular Value Decomposition(SvD)to compress and denoise the expanded matrix.Experimental results on the public dataset show that our proposed model outperforms the state-of-art air quality forecasting models in both accuracy and time cost.

Multiconditional machining process quality prediction using deep transfer learning network

The quality prediction of machining processes is essential for maintaining process stability and improving component quality. The prediction accuracy of conventional methods relies on a significant amount of process signals under the same operating conditions. However, obtaining sufficient data during the machining process is difficult under most operating conditions, and conventional prediction methods require a certain amount of training data. Herein, a new multiconditional machining quality prediction model based on a deep transfer learning network is proposed. A process quality prediction model is built under multiple operating conditions. A deep convolutional neural network (CNN) is used to investigate the connections between multidimensional process signals and quality under source operating conditions. Three strategies, namely structure transfer, parameter transfer, and weight transfer, are used to transfer the trained CNN network to the target operating conditions. The machining quality prediction model predicts the machining quality of the target operating conditions using limited data. A multiconditional forging process is designed to validate the effectiveness of the proposed method. Compared with other data-driven methods, the proposed deep transfer learning network offers enhanced performance in terms of prediction accuracy under different conditions.

Artificial Intelligence in Internet of Things System for Predicting Water Quality in Aquaculture Fishponds

Aquaculture has long been a critical economic sector in Taiwan.Since a key factor in aquaculture production efficiency is water quality,an effective means of monitoring the dissolved oxygen content(DOC)of aquaculture water is essential.This study developed an internet of things system for monitoring DOC by collecting essential data related to water quality.Artificial intelligence technology was used to construct a water quality prediction model for use in a complete system for managing water quality.Since aquaculture water quality depends on a continuous interaction among multiple factors,and the current state is correlated with the previous state,a model with time series is required.Therefore,this study used recurrent neural networks(RNNs)with sequential characteristics.Commonly used RNNs such as long short-term memory model and gated recurrent unit(GRU)model have a memory function that appropriately retains previous results for use in processing current results.To construct a suitable RNN model,this study used Taguchi method to optimize hyperparameters(including hidden layer neuron count,iteration count,batch size,learning rate,and dropout ratio).Additionally,optimization performance was also compared between 5-layer and 7-layer network architectures.The experimental results revealed that the 7-layer GRU was more suitable for the application considered in this study.The values obtained in tests of prediction performance were mean absolute percentage error of 3.7134%,root mean square error of 0.0638,and R-value of 0.9984.Therefore,thewater qualitymanagement system developed in this study can quickly provide practitioners with highly accurate data,which is essential for a timely response to water quality issues.This study was performed in collaboration with the Taiwan Industrial Technology Research Institute and a local fishery company.Practical application of the system by the fishery company confirmed that the monitoring system is effective in improving the survival rate of farmed fish by providing data needed to maintain DOC higher than the standard value.

Data-driven casting defect prediction model for sand casting based on random forest classification algorithm

The complex sand-casting process combined with the interactions between process parameters makes it difficult to control the casting quality,resulting in a high scrap rate.A strategy based on a data-driven model was proposed to reduce casting defects and improve production efficiency,which includes the random forest(RF)classification model,the feature importance analysis,and the process parameters optimization with Monte Carlo simulation.The collected data includes four types of defects and corresponding process parameters were used to construct the RF model.Classification results show a recall rate above 90% for all categories.The Gini Index was used to assess the importance of the process parameters in the formation of various defects in the RF model.Finally,the classification model was applied to different production conditions for quality prediction.In the case of process parameters optimization for gas porosity defects,this model serves as an experimental process in the Monte Carlo method to estimate a better temperature distribution.The prediction model,when applied to the factory,greatly improved the efficiency of defect detection.Results show that the scrap rate decreased from 10.16% to 6.68%.

Micro-Locational Fine Dust Prediction Utilizing Machine Learning and Deep Learning Models

Given the increasing number of countries reporting degraded air quality,effective air quality monitoring has become a critical issue in today’s world.However,the current air quality observatory systems are often prohibitively expensive,resulting in a lack of observatories in many regions within a country.Consequently,a significant problem arises where not every region receives the same level of air quality information.This disparity occurs because some locations have to rely on information from observatories located far away from their regions,even if they may be the closest available options.To address this challenge,a novel approach that leverages machine learning and deep learning techniques to forecast fine dust concentrations was proposed.Specifically,continuous location features in the form of latitude and longitude values were incorporated into our models.By utilizing a comprehensive dataset comprising weather conditions,air quality measurements,and location properties,various machine learning models,including Random Forest Regression,XGBoost Regression,AdaBoost Regression,and a deep learning model known as Long Short-Term Memory(LSTM)were trained.Our experimental results demonstrated that the LSTM model outperforms the other models,achieving the best score with a root mean squared error of 23.48 in predicting fine dust(PM10)concentrations on an hourly basis.Furthermore,the fact that incorporating location properties,such as longitude and latitude values,enhances the overall quality of the regression models was discovered.Additionally,the implications and contributions of our research were discussed.By implementing our approach,the cost associated with relying solely on existing observatories can be substantially reduced.This reduction in costs can pave the way for economically efficient fine dust observation systems,ensuring more widespread and accurate air quality monitoring across different regions.