Reinforcement Learning in Process Industries:Review and Perspective

This survey paper provides a review and perspective on intermediate and advanced reinforcement learning(RL)techniques in process industries. It offers a holistic approach by covering all levels of the process control hierarchy. The survey paper presents a comprehensive overview of RL algorithms,including fundamental concepts like Markov decision processes and different approaches to RL, such as value-based, policy-based, and actor-critic methods, while also discussing the relationship between classical control and RL. It further reviews the wide-ranging applications of RL in process industries, such as soft sensors, low-level control, high-level control, distributed process control, fault detection and fault tolerant control, optimization,planning, scheduling, and supply chain. The survey paper discusses the limitations and advantages, trends and new applications, and opportunities and future prospects for RL in process industries. Moreover, it highlights the need for a holistic approach in complex systems due to the growing importance of digitalization in the process industries.

Process design and intensification of multicomponent azeotropes special distillation separation via molecular simulation and system optimization

This work provides an overview of distillation processes,including process design for different distillation processes,selection of entrainers for special distillation processes,system integration and intensification of distillation processes,optimization of process parameters for distillation processes and recent research progress in dynamic control strategies.Firstly,the feasibility of using thermodynamic topological theories such as residual curve,phase equilibrium line and distillation boundary line to analyze different separation regions is discussed,and the rationality of distillation process design is discussed by using its feasibility.Secondly,the application of molecular simulation methods such as molecular dynamics simulation and quantum chemical calculation in the screening of entrainer is discussed for the extractive distillation process.The thermal coupling mechanism of different distillation processes is used to explore the process of different process intensifications.Next,a mixed integer nonlinear optimization strategy for the distillation process based on different algorithms is introduced.Finally,the improvement of dynamic control strategies for different distillation processes in recent years is summarized.This work focuses on the application of process intensification and system optimization in the design of distillation process,and analyzes the challenges,prospects,and development trends of distillation technology in the separation of multicomponent azeotropes.

NADARAYA-WATSON ESTIMATORS FOR REFLECTED STOCHASTIC PROCESSES

We study the Nadaraya-Watson estimators for the drift function of two-sided reflected stochastic differential equations.The estimates,based on either the continuously observed process or the discretely observed process,are considered.Under certain conditions,we prove the strong consistency and the asymptotic normality of the two estimators.Our method is also suitable for one-sided reflected stochastic differential equations.Simulation results demonstrate that the performance of our estimator is superior to that of the estimator proposed by Cholaquidis et al.(Stat Sin,2021,31:29-51).Several real data sets of the currency exchange rate are used to illustrate our proposed methodology.

Detection of Oscillations in Process Control Loops From Visual Image Space Using Deep Convolutional Networks

Oscillation detection has been a hot research topic in industries due to the high incidence of oscillation loops and their negative impact on plant profitability.Although numerous automatic detection techniques have been proposed,most of them can only address part of the practical difficulties.An oscillation is heuristically defined as a visually apparent periodic variation.However,manual visual inspection is labor-intensive and prone to missed detection.Convolutional neural networks(CNNs),inspired by animal visual systems,have been raised with powerful feature extraction capabilities.In this work,an exploration of the typical CNN models for visual oscillation detection is performed.Specifically,we tested MobileNet-V1,ShuffleNet-V2,Efficient Net-B0,and GhostNet models,and found that such a visual framework is well-suited for oscillation detection.The feasibility and validity of this framework are verified utilizing extensive numerical and industrial cases.Compared with state-of-theart oscillation detectors,the suggested framework is more straightforward and more robust to noise and mean-nonstationarity.In addition,this framework generalizes well and is capable of handling features that are not present in the training data,such as multiple oscillations and outliers.

Operational optimization of copper flotation process based on the weighted Gaussian process regression and index-oriented adaptive differential evolution algorithm

Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.

An Interpretable Light Attention-Convolution-Gate Recurrent Unit Architecture for the Highly Accurate Modeling of Actual Chemical Dynamic Processes

To equip data-driven dynamic chemical process models with strong interpretability,we develop a light attention–convolution–gate recurrent unit(LACG)architecture with three sub-modules—a basic module,a brand-new light attention module,and a residue module—that are specially designed to learn the general dynamic behavior,transient disturbances,and other input factors of chemical processes,respectively.Combined with a hyperparameter optimization framework,Optuna,the effectiveness of the proposed LACG is tested by distributed control system data-driven modeling experiments on the discharge flowrate of an actual deethanization process.The LACG model provides significant advantages in prediction accuracy and model generalization compared with other models,including the feedforward neural network,convolution neural network,long short-term memory(LSTM),and attention-LSTM.Moreover,compared with the simulation results of a deethanization model built using Aspen Plus Dynamics V12.1,the LACG parameters are demonstrated to be interpretable,and more details on the variable interactions can be observed from the model parameters in comparison with the traditional interpretable model attention-LSTM.This contribution enriches interpretable machine learning knowledge and provides a reliable method with high accuracy for actual chemical process modeling,paving a route to intelligent manufacturing.

Cookie Baking Process Optimization and Quality Analysis Based on Food 3D Printing

In order to obtain better quality cookies, food 3D printing technology was employed to prepare cookies. The texture, color, deformation, moisture content, and temperature of the cookie as evaluation indicators, the influences of baking process parameters, such as baking time, surface heating temperature and bottom heating temperature, on the quality of the cookie were studied to optimize the baking process parameters. The results showed that the baking process parameters had obvious effects on the texture, color, deformation, moisture content, and temperature of the cookie. All of the roasting surface heating temperature, bottom heating temperature and baking time had positive influences on the hardness, crunchiness, crispiness, and the total color difference(ΔE) of the cookie. When the heating temperatures of the surfac and bottom increased, the diameter and thickness deformation rate of the cookie increased. However,with the extension of baking time, the diameter and thickness deformation rate of the cookie first increased and then decreased. With the surface heating temperature of 180 ℃, the bottom heating temperature of 150 ℃, and baking time of 15 min, the cookie was crisp and moderate with moderate deformation and uniform color. There was no burnt phenomenon with the desired quality. Research results provided a theoretical basis for cookie manufactory based on food 3D printing technology.

THE EXTREMES OF DEPENDENT CHI-PROCESSES ATTRACTED BY THE BROWN-RESNICK PROCESS

Motivated by some recent works on the topic of the Brown-Resnick process, we study the functional limit theorem for normalized pointwise maxima of dependent chi-processes. It is proven that the properly normalized pointwise maxima of those processes are attracted by the Brown-Resnick process.

Fresh Processing Technology in Polygonatum odoratum Production Area and Its Comparison with Traditional Processing

[Objectives]To compare the effects of traditional processing and fresh processing on the quality of Polygonatum odoratum decoction piece.[Methods]The effects of fresh processing and traditional processing on the quality of P.odoratum decoction piece were compared and analyzed with appearance characteristics,total ash content,extract content,total polysaccharides content,and total flavonoids content as the evaluation indexes.[Results]Fresh processing method in different production areas has different effects on P.odoratum decoction piece.P.odoratum was dried in oven of 50℃.When moisture content was 41.44%-59.67%,it was cut.After complete drying at 50℃,the moisture content of dried P.odoratum was 8.94%-9.60%,and ethanol-soluble extract content was 77.29%-78.20%,and water-soluble extract was 77.7%-78.14%.At this time,the appearance characteristics of section of P.odoratum decoction piece were better than that of traditional processing,which was yellowish white.The total polysaccharide content was higher than that of traditional processing,and the content of total flavonoids was statistically significant different from that of traditional processing.[Conclusions]The quality of P.odoratum decoction piece by fresh processing is better than that of the traditional processing,and it is feasible to use fresh processing.

A Comparative Study on the Processing of Emojis and Faces in Human Communication

In the digital era,emojis have enriched the way people communicate and research on emojis explosively increased in recent years.However,few noticed their functions from the neurocognitive perspective,especially their similarities and differences with facial expressions in traditional face-to-face communication.To fill this gap,we conducted a Meta-analysis with 25 independent effect sizes from previous experimental studies.The present study shows that emojis have slight advantages in processing efficiency,which might be attributed to their simplicity in design,namely the omission of complex facial features,but the difference between emoji and face processing is not significant.In addition,emotional valence and experimental methods do not have significant influences,which suggests that emojis are equally effective as human faces in emotional expression.The current research contributes to the knowledge in digital communication and the crucial role played by emojis therein.

Study on the Interactivity of Controlled and Automatic Information Processing in L2 Reading

L2 reading is not only an important channel for people to obtain information and knowledge,but also the main way for people to learn a foreign language.Reading information processing can be divided into controlled processing and automatic processing.Controlled information processing is a conscious and resource-intensive processing model,while automatic information processing is an unconscious and automatic processing model.This study investigates the characteristics and interactivity of controlled and automatic information processing in L2 reading,and explores the roles of controlled and automatic information processing strategies in improving L2 reading ability.The findings are as follows:(a)controlled and automatic information processing is interactive in L2 reading;and(b)the uses of controlled and automatic information processing strategies are beneficial to the improvement of the reading ability of L2 learners.This study has important theoretical and practical value in improving the efficiency of L2 reading teaching and learning.

BAR:a branch-alternation-resorting algorithm for locality exploration in graph processing

Unstructured and irregular graph data causes strong randomness and poor locality of data accesses in graph processing.This paper optimizes the depth-branch-resorting algorithm(DBR),and proposes a branch-alternation-resorting algorithm(BAR).In order to make the algorithm run in parallel and improve the efficiency of algorithm operation,the BAR algorithm is mapped onto the reconfigurable array processor(APR-16)to achieve vertex reordering,effectively improving the locality of graph data.This paper validates the BAR algorithm on the GraphBIG framework,by utilizing the reordered dataset with BAR on breadth-first search(BFS),single source shortest paht(SSSP)and betweenness centrality(BC)algorithms for traversal.The results show that compared with DBR and Corder algorithms,BAR can reduce execution time by up to 33.00%,and 51.00%seperatively.In terms of data movement,the BAR algorithm has a maximum reduction of 39.00%compared with the DBR algorithm and 29.66%compared with Corder algorithm.In terms of computational complexity,the BAR algorithm has a maximum reduction of 32.56%compared with DBR algorithm and53.05%compared with Corder algorithm.

Parallel Image Processing: Taking Grayscale Conversion Using OpenMP as an Example

In recent years, the widespread adoption of parallel computing, especially in multi-core processors and high-performance computing environments, ushered in a new era of efficiency and speed. This trend was particularly noteworthy in the field of image processing, which witnessed significant advancements. This parallel computing project explored the field of parallel image processing, with a focus on the grayscale conversion of colorful images. Our approach involved integrating OpenMP into our framework for parallelization to execute a critical image processing task: grayscale conversion. By using OpenMP, we strategically enhanced the overall performance of the conversion process by distributing the workload across multiple threads. The primary objectives of our project revolved around optimizing computation time and improving overall efficiency, particularly in the task of grayscale conversion of colorful images. Utilizing OpenMP for concurrent processing across multiple cores significantly reduced execution times through the effective distribution of tasks among these cores. The speedup values for various image sizes highlighted the efficacy of parallel processing, especially for large images. However, a detailed examination revealed a potential decline in parallelization efficiency with an increasing number of cores. This underscored the importance of a carefully optimized parallelization strategy, considering factors like load balancing and minimizing communication overhead. Despite challenges, the overall scalability and efficiency achieved with parallel image processing underscored OpenMP’s effectiveness in accelerating image manipulation tasks.

Construction Method of Civil Aircraft Airborne⁃system Supplier Development Process System

Based on the analysis of the development process system status of domestic and foreign civil aircraft airborne system suppliers,this paper proposes the overall construction idea of"a set of civil aircraft process system"based on IPD(Integrated product development)in the organization.The development stage,process,activity and task are the logical framework elements of the system construction."Based on process decomposition,vertical stratification,horizontal segmentation,combination of special and common,process customized to tools,role and process integration,giving full consideration to the interface between supplier management and process modules"etc.are the concrete ideas.Moreover,formulate top⁃level system construction standards,implemented by process system management tool platform,so that the process system and development work can be effectively integrated to effectively guide the development work of airborne system suppliers,and meet the quality and airworthiness requirements of civil aircraft development.Through the development application of a certain type of flight control system,the process system and tool platform were verified and optimized in practice.

基于Arduino与Processing的心率检测计设计研究

随着社会经济的高速发展,人们的物质生活也有了极大的提高,但同时也伴随着各种疾病的到来,身体健康已经成为人们普遍关注的焦点,因此,心率检测仪、血压计、血糖仪等各种家用医疗监测仪器已经逐渐融入日常生活。心脏病是人们难以预防的突发致命疾病之一,本文介绍的是一款基于Arduino【是基于易用硬件和软件的原型开源平台,包由可编程的电路板(简称微控制器),以及集成开发环境(称为Arduino IDE)的现成软件组成】Processing(开源编程语言,包括编辑器、编译器、展示器)的简易心率检测计系统,其功能实用、操作简单,可以测量心率,当超出正常心率范围时及时预警,是一款便携的实时心率测试仪。

A new insight into LPSO phase transformation and mechanical properties uniformity of large-scale Mg-Gd-Y-Zn-Zr alloy prepared by multi-pass friction stir processing

A large-scale fine-grained Mg-Gd-Y-Zn-Zr alloy plate with high strength and ductility was successfully prepared by multi-pass friction stir processing(MFSP)technology in this work.The structure of grains and long period stacking ordered(LPSO)phase were characterized,and the mechanical properties uniformity was investigated.Moreover,a quantitative relationship between the microstructure and tensile yield strength was established.The results showed that the grains in the processed zone(PZ)and interfacial zone(IZ)were refined from 50μm to 3μm and 4μm,respectively,and numerous original LPSO phases were broken.In IZ,some block-shaped 18R LPSO phases were transformed into needle-like 14H LPSO phases due to stacking faults and the short-range diffusion of solute atoms.The severe shear deformation in the form of kinetic energy caused profuse stacking fault to be generated and move rapidly,greatly increasing the transformation rate of LPSO phase.After MFSP,the ultimate tensile strength,yield strength and elongation to failure of the large-scale plate were 367 MPa,305 MPa and 18.0% respectively.Grain refinement and LPSO phase strengthening were the major strengthening mechanisms for the MFSP sample.In particularly,the strength of IZ was comparable to that of PZ because the strength contribution of the 14H LPSO phase offsets the lack of grain refinement strengthening in IZ.This result opposes the widely accepted notion that IZ is a weak region in MFSP-prepared large-scale fine-grained plate.

Recent developments in selective laser processes for wearable devices

Recently,the increasing interest in wearable technology for personal healthcare and smart virtual/augmented reality applications has led to the development of facile fabrication methods.Lasers have long been used to develop original solutions to such challenging technological problems due to their remote,sterile,rapid,and site-selective processing of materials.In this review,recent developments in relevant laser processes are summarized under two separate categories.First,transformative approaches,such as for laser-induced graphene,are introduced.In addition to design optimization and the alteration of a native substrate,the latest advances under a transformative approach now enable more complex material compositions and multilayer device configurations through the simultaneous transformation of heterogeneous precursors,or the sequential addition of functional layers coupled with other electronic elements.In addition,the more conventional laser techniques,such as ablation,sintering,and synthesis,can still be used to enhance the functionality of an entire system through the expansion of applicable materials and the adoption of new mechanisms.Later,various wearable device components developed through the corresponding laser processes are discussed,with an emphasis on chemical/physical sensors and energy devices.In addition,special attention is given to applications that use multiple laser sources or processes,which lay the foundation for the all-laser fabrication of wearable devices.

Effect of bubble morphology and behavior on power consumption in non-Newtonian fluids’aeration process

Due to a prolonged operation time and low mass transfer efficiency, the primary challenge in the aeration process of non-Newtonian fluids is the high energy consumption, which is closely related to the form and rate of impeller, ventilation, rheological properties and bubble morphology in the reactor. In this perspective, through optimal computational fluid dynamics models and experiments, the relationship between power consumption, volumetric mass transfer rate(kLa) and initial bubble size(d0) was constructed to establish an efficient operation mode for the aeration process of non-Newtonian fluids. It was found that reducing the d0could significantly increase the oxygen mass transfer rate, resulting in an obvious decrease in the ventilation volume and impeller speed. When d0was regulated within 2-5 mm,an optimal kLa could be achieved, and 21% of power consumption could be saved, compared to the case of bubbles with a diameter of 10 mm.

Cascading multi-segment rupture process of the 2023 Turkish earthquake doublet on a complex fault system revealed by teleseismic P wave back projection method

In this study,the vertical components of broadband teleseismic P wave data recorded by China Earthquake Network are used to image the rupture processes of the February 6th,2023 Turkish earthquake doublet via back projection analysis.Data in two frequency bands(0.5-2 Hz and 1-3 Hz)are used in the imaging processes.The results show that the rupture of the first event extends about 200 km to the northeast and about 150 km to the southwest,lasting~90 s in total.The southwestern rupture is triggered by the northeastern rupture,demonstrating a sequential bidirectional unilateral rupture pattern.The rupture of the second event extends approximately 80 km in both northeast and west directions,lasting~35 s in total and demonstrates a typical bilateral rupture feature.The cascading ruptures on both sides also reflect the occurrence of selective rupture behaviors on bifurcated faults.In addition,we observe super-shear ruptures on certain fault sections with relatively straight fault structures and sparse aftershocks.

Multimodal Data-Driven Reinforcement Learning for Operational Decision-Making in Industrial Processes

Dear Editor, This letter proposes a multimodal data-driven reinforcement learning-based method for operational decision-making in industrial processes. Due to the frequent fluctuations of feedstock properties and operating conditions in the industrial processes, existing data-driven methods cannot effectively adjust the operational variables. In addition, multimodal data such as images, audio.