A deep reinforcement learning approach to gasoline blending real-time optimization under uncertainty

The gasoline inline blending process has widely used real-time optimization techniques to achieve optimization objectives,such as minimizing the cost of production.However,the effectiveness of real-time optimization in gasoline blending relies on accurate blending models and is challenged by stochastic disturbances.Thus,we propose a real-time optimization algorithm based on the soft actor-critic(SAC)deep reinforcement learning strategy to optimize gasoline blending without relying on a single blending model and to be robust against disturbances.Our approach constructs the environment using nonlinear blending models and feedstocks with disturbances.The algorithm incorporates the Lagrange multiplier and path constraints in reward design to manage sparse product constraints.Carefully abstracted states facilitate algorithm convergence,and the normalized action vector in each optimization period allows the agent to generalize to some extent across different target production scenarios.Through these well-designed components,the algorithm based on the SAC outperforms real-time optimization methods based on either nonlinear or linear programming.It even demonstrates comparable performance with the time-horizon based real-time optimization method,which requires knowledge of uncertainty models,confirming its capability to handle uncertainty without accurate models.Our simulation illustrates a promising approach to free real-time optimization of the gasoline blending process from uncertainty models that are difficult to acquire in practice.

Operational optimization of copper flotation process based on the weighted Gaussian process regression and index-oriented adaptive differential evolution algorithm

Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.

Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection

Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention.Various constrained multi-objective optimization evolutionary algorithms(CMOEAs)have been developed with the use of different algorithmic strategies,evolutionary operators,and constraint-handling techniques.The performance of CMOEAs may be heavily dependent on the operators used,however,it is usually difficult to select suitable operators for the problem at hand.Hence,improving operator selection is promising and necessary for CMOEAs.This work proposes an online operator selection framework assisted by Deep Reinforcement Learning.The dynamics of the population,including convergence,diversity,and feasibility,are regarded as the state;the candidate operators are considered as actions;and the improvement of the population state is treated as the reward.By using a Q-network to learn a policy to estimate the Q-values of all actions,the proposed approach can adaptively select an operator that maximizes the improvement of the population according to the current state and thereby improve the algorithmic performance.The framework is embedded into four popular CMOEAs and assessed on 42 benchmark problems.The experimental results reveal that the proposed Deep Reinforcement Learning-assisted operator selection significantly improves the performance of these CMOEAs and the resulting algorithm obtains better versatility compared to nine state-of-the-art CMOEAs.

A Multi-Objective Optimization for Locating Maintenance Stations and Operator Dispatching of Corrective Maintenance

In this study,we introduce a novel multi-objective optimization model tailored for modern manufacturing,aiming to mitigate the cost impacts of operational disruptions through optimized corrective maintenance.Central to our approach is the strategic placement of maintenance stations and the efficient allocation of personnel,addressing a crucial gap in the integration of maintenance personnel dispatching and station selection.Our model uniquely combines the spatial distribution of machinery with the expertise of operators to achieve a harmonious balance between maintenance efficiency and cost-effectiveness.The core of our methodology is the NSGA Ⅲ+Dispatch,an advanced adaptation of the Non-Dominated Sorting Genetic Algorithm Ⅲ(NSGA-Ⅲ),meticulously designed for the selection of maintenance stations and effective operator dispatching.This method integrates a comprehensive coding process,crossover operator,and mutation operator to efficiently manage multiple objectives.Rigorous empirical testing,including a detailed analysis from a taiwan region electronic equipment manufacturer,validated the effectiveness of our approach across various scenarios of machine failure frequencies and operator configurations.The findings reveal that the proposed model significantly outperforms current practices by reducing response times by up to 23%in low-frequency and 28.23%in high-frequency machine failure scenarios,leading to notable improvements in efficiency and cost reduction.Additionally,it demonstrates significant improvements in oper-ational efficiency,particularly in selective high-frequency failure contexts,while ensuring substantial manpower cost savings without compromising on operational effectiveness.This research significantly advances maintenance strategies in production environments,providing the manufacturing industry with practical,optimized solutions for diverse machine malfunction situations.Furthermore,the methodologies and principles developed in this study have potential applications in various other sectors,including healthcare,transportation,and energy,where maintenance efficiency and resource optimization are equally critical.

Evolutionary-assisted reinforcement learning for reservoir real-time production optimization under uncertainty

Production optimization has gained increasing attention from the smart oilfield community because it can increase economic benefits and oil recovery substantially.While existing methods could produce high-optimality results,they cannot be applied to real-time optimization for large-scale reservoirs due to high computational demands.In addition,most methods generally assume that the reservoir model is deterministic and ignore the uncertainty of the subsurface environment,making the obtained scheme unreliable for practical deployment.In this work,an efficient and robust method,namely evolutionaryassisted reinforcement learning(EARL),is proposed to achieve real-time production optimization under uncertainty.Specifically,the production optimization problem is modeled as a Markov decision process in which a reinforcement learning agent interacts with the reservoir simulator to train a control policy that maximizes the specified goals.To deal with the problems of brittle convergence properties and lack of efficient exploration strategies of reinforcement learning approaches,a population-based evolutionary algorithm is introduced to assist the training of agents,which provides diverse exploration experiences and promotes stability and robustness due to its inherent redundancy.Compared with prior methods that only optimize a solution for a particular scenario,the proposed approach trains a policy that can adapt to uncertain environments and make real-time decisions to cope with unknown changes.The trained policy,represented by a deep convolutional neural network,can adaptively adjust the well controls based on different reservoir states.Simulation results on two reservoir models show that the proposed approach not only outperforms the RL and EA methods in terms of optimization efficiency but also has strong robustness and real-time decision capacity.

ROS2 Real-time Performance Optimization and Evaluation

Real-time interaction with uncertain and dynamic environments is essential for robotic systems to achieve functions such as visual perception,force interaction,spatial obstacle avoidance,and motion planning.To ensure the reliability and determinism of system execution,a flexible real-time control system architecture and interaction algorithm are required.The ROS framework was designed to improve the reusability of robotic software development by providing a distributed structure,hardware abstraction,message-passing mechanism,and application prototypes.Rich ecosystems for robotic development have been built around ROS1 and ROS2 architectures based on the Linux system.However,because of the fairness scheduling principle of the default Linux system design and the complexity of the kernel,the system does not have real-time computing.To achieve a balance between real-time and non-real-time computing,this paper uses the transmission mechanism of ROS2,combines it with the scheduling mechanism of the Linux operating system,and uses Preempt_RT to enhance the real-time computing of ROS1 and ROS2.The real-time performance evaluation of ROS1 and ROS2 is conducted from multiple perspectives,including throughput,transmission mode,QoS service quality,frequency,number of subscription nodes and EtherCAT master.This paper makes two significant contributions:firstly,it employs Preempt_RT to optimize the native ROS2 system,effectively enhancing the real-time performance of native ROS2 message transmission;secondly,it conducts a comprehensive evaluation of the real-time performance of both native and optimized ROS2 systems.This comparison elucidates the benefits of the optimized ROS2 architecture regarding real-time performance,with results vividly demonstrated through illustrative figures.

Interpretable machine learning optimization(InterOpt)for operational parameters:A case study of highly-efficient shale gas development

An algorithm named InterOpt for optimizing operational parameters is proposed based on interpretable machine learning,and is demonstrated via optimization of shale gas development.InterOpt consists of three parts:a neural network is used to construct an emulator of the actual drilling and hydraulic fracturing process in the vector space(i.e.,virtual environment);:the Sharpley value method in inter-pretable machine learning is applied to analyzing the impact of geological and operational parameters in each well(i.e.,single well feature impact analysis):and ensemble randomized maximum likelihood(EnRML)is conducted to optimize the operational parameters to comprehensively improve the efficiency of shale gas development and reduce the average cost.In the experiment,InterOpt provides different drilling and fracturing plans for each well according to its specific geological conditions,and finally achieves an average cost reduction of 9.7%for a case study with 104 wells.

Assessing environmental impact:Micro-energy network optimization in a Chinese industrial park

Micro-energy systems contribute significantly to environmental improvement by reducing dependence on power grids through the utilization of multiple renewable energy sources.This study quantified the environmental impact of a micro-energy network system in an industrial park through a life cycle assessment using the operation of the micro-energy network over a year as the functional unit and“cradle-to-gate”as the system boundary.Based on the baseline scenario,a natural gas generator set was added to replace central heating,and the light pipes were expanded to constitute the optimized scenario.The results showed that the key impact categories for both scenarios were global warming,fine particulate matter formation,human carcinogenic toxicity,and human non-carcinogenic toxicity.The overall environmental impact of the optimized scenario was reduced by 68%compared to the baseline scenario.A sensitivity analysis of the key factors showed that electricity from the power grid was the key impact factor in both scenarios,followed by central heating and natural gas.Therefore,to reduce the environmental impact of network systems,it is necessary to further optimize the grid power structure.The research approach can be used to optimize micro-energy networks and evaluate the environmental impact of different energy systems.

Efficient Route Planning for Real-Time Demand-Responsive Transit

Demand Responsive Transit (DRT) responds to the dynamic users’ requests without any fixed routes and timetablesand determines the stop and the start according to the demands. This study explores the optimization of dynamicvehicle scheduling and real-time route planning in urban public transportation systems, with a focus on busservices. It addresses the limitations of current shared mobility routing algorithms, which are primarily designedfor simpler, single origin/destination scenarios, and do not meet the complex demands of bus transit systems. Theresearch introduces an route planning algorithm designed to dynamically accommodate passenger travel needsand enable real-time route modifications. Unlike traditional methods, this algorithm leverages a queue-based,multi-objective heuristic A∗ approach, offering a solution to the inflexibility and limited coverage of suburbanbus routes. Also, this study conducts a comparative analysis of the proposed algorithm with solutions based onGenetic Algorithm (GA) and Ant Colony Optimization Algorithm (ACO), focusing on calculation time, routelength, passenger waiting time, boarding time, and detour rate. The findings demonstrate that the proposedalgorithmsignificantly enhances route planning speed, achieving an 80–100-fold increase in efficiency over existingmodels, thereby supporting the real-time demands of Demand-Responsive Transportation (DRT) systems. Thestudy concludes that this algorithm not only optimizes route planning in bus transit but also presents a scalablesolution for improving urban mobility.

Accelerated Primal-Dual Projection Neurodynamic Approach With Time Scaling for Linear and Set Constrained Convex Optimization Problems

The Nesterov accelerated dynamical approach serves as an essential tool for addressing convex optimization problems with accelerated convergence rates.Most previous studies in this field have primarily concentrated on unconstrained smooth con-vex optimization problems.In this paper,on the basis of primal-dual dynamical approach,Nesterov accelerated dynamical approach,projection operator and directional gradient,we present two accelerated primal-dual projection neurodynamic approaches with time scaling to address convex optimization problems with smooth and nonsmooth objective functions subject to linear and set constraints,which consist of a second-order ODE(ordinary differential equation)or differential conclusion system for the primal variables and a first-order ODE for the dual vari-ables.By satisfying specific conditions for time scaling,we demonstrate that the proposed approaches have a faster conver-gence rate.This only requires assuming convexity of the objective function.We validate the effectiveness of our proposed two accel-erated primal-dual projection neurodynamic approaches through numerical experiments.

The Impact of Optimizing Details in the Operating Room on the Level of Knowledge, Attitude, and Practice of Hospital Infection Prevention and Control by Surgeons, as Well as the Effectiveness of Infection Control

Objective: This paper aims to explore the impact of optimizing details in the operating room on the level of knowledge, attitude, and practice of hospital infection prevention and control by surgeons, as well as the effectiveness of infection control. Methods: From January 2022 to June 2023, a total of 120 patients were screened and randomly divided into a control group (routine care and hospital infection management) and a study group (optimizing details in the operating room). Results: Significant differences were found between the two groups in the data of surgeons’ level of knowledge, attitude, and practice in hospital infection prevention and control, infection rates, and nursing satisfaction, with the study group showing better results (P Conclusion: The use of optimizing details in the operating room among surgeons can effectively improve surgeons’ level of knowledge, attitude, and practice in hospital infection prevention and control, reduce infection occurrence, and is worth promoting.

Combining Entropy Optimization and Sobel Operator for Medical Image Fusion

Fusing medical images is a topic of interest in processing medical images.This is achieved to through fusing information from multimodality images for the purpose of increasing the clinical diagnosis accuracy.This fusion aims to improve the image quality and preserve the specific features.The methods of medical image fusion generally use knowledge in many differentfields such as clinical medicine,computer vision,digital imaging,machine learning,pattern recognition to fuse different medical images.There are two main approaches in fusing image,including spatial domain approach and transform domain approachs.This paper proposes a new algorithm to fusion multimodal images.This algorithm is based on Entropy optimization and the Sobel operator.Wavelet transform is used to split the input images into components over the low and high frequency domains.Then,two fusion rules are used for obtaining the fusing images.Thefirst rule,based on the Sobel operator,is used for high frequency components.The second rule,based on Entropy optimization by using Particle Swarm Optimization(PSO)algorithm,is used for low frequency components.Proposed algorithm is implemented on the images related to central nervous system diseases.The experimental results of the paper show that the proposed algorithm is better than some recent methods in term of brightness level,the contrast,the entropy,the gradient and visual informationfidelity for fusion(VIFF),Feature Mutual Information(FMI)indices.

Research on Optimal Configuration of Energy Storage in Wind-Solar Microgrid Considering Real-Time Electricity Price

Capacity allocation and energy management strategies for energy storage are critical to the safety and economical operation of microgrids.In this paper,an improved energymanagement strategy based on real-time electricity price combined with state of charge is proposed to optimize the economic operation of wind and solar microgrids,and the optimal allocation of energy storage capacity is carried out by using this strategy.Firstly,the structure and model of microgrid are analyzed,and the outputmodel of wind power,photovoltaic and energy storage is established.Then,considering the interactive power cost between the microgrid and the main grid and the charge-discharge penalty cost of energy storage,an optimization objective function is established,and an improved energy management strategy is proposed on this basis.Finally,a physicalmodel is built inMATLAB/Simulink for simulation verification,and the energy management strategy is compared and analyzed on sunny and rainy days.The initial configuration cost function of energy storage is added to optimize the allocation of energy storage capacity.The simulation results show that the improved energy management strategy can make the battery charge-discharge response to real-time electricity price and state of charge better than the traditional strategy on sunny or rainy days,reduce the interactive power cost between the microgrid system and the power grid.After analyzing the change of energy storage power with cost,we obtain the best energy storage capacity and energy storage power.

IOPS:computational graph optimization based on inter-operators parallel scheduling

To improve the inference efficiency of convolutional neural networks(CNN),the existing neural networks mainly adopt heuristic and dynamic programming algorithms to realize parallel scheduling among operators.Heuristic scheduling algorithms can generate local optima easily,while the dynamic programming algorithm has a long convergence time for complex structural models.This paper mainly studies the parallel scheduling between operators and proposes an inter-operator parallelism schedule(IOPS)scheduling algorithm that guarantees the minimum similar execution delay.Firstly,a graph partitioning algorithm based on the largest block is designed to split the neural network model into multiple subgraphs.Then,the operators that meet the conditions is replaced according to the defined operator replacement rules.Finally,the optimal scheduling method based on backtracking is used to schedule the computational graph.Network models such as Inception-v3,ResNet-50,and RandWire are selected for testing.The experimental results show that the algorithm designed in this paper can achieve a 1.6×speedup compared with the existing sequential execution methods.

Data network traffic analysis and optimization strategy of real-time power grid dynamic monitoring system for wide-frequency measurements

The application and development of a wide-area measurement system(WAMS)has enabled many applications and led to several requirements based on dynamic measurement data.Such data are transmitted as big data information flow.To ensure effective transmission of wide-frequency electrical information by the communication protocol of a WAMS,this study performs real-time traffic monitoring and analysis of the data network of a power information system,and establishes corresponding network optimization strategies to solve existing transmission problems.This study utilizes the traffic analysis results obtained using the current real-time dynamic monitoring system to design an optimization strategy,covering the optimization in three progressive levels:the underlying communication protocol,source data,and transmission process.Optimization of the system structure and scheduling optimization of data information are validated to be feasible and practical via tests.

A Novel Real-time Optimization Methodology for Chemical Plants

In this paper, a novel approach termed process goose queue (PGQ) is suggested to deal with real-time optimization (RTO) of chemical plants. Taking advantage of the ad-hoc structure of PGQ which imitates biologic nature of flying wild geese, a chemical plant optimization problem can be re-formulated as a combination of a multi-layer PGQ and a PGQ-Objective according to the relationship among process variables involved in the objective and constraints. Subsequently, chemical plant RTO solutions are converted into coordination issues among PGQs which could be dealt with in a novel way. Accordingly, theoretical definitions, adjustment rule and implementing procedures associated with the approach are explicitly introduced together with corresponding enabling algorithms. Finally, an exemplary chemical plant is employed to demonstrate the feasibility and validity of the contribution.

Multi-objective Optimization of Multi-Agent Elevator Group Control System Based on Real-time Particle Swarm Optimization Algorithm

In order to get a globally optimized solution for the Elevator Group Control System (EGCS) scheduling problem, an algorithm with an overall optimization function is needed. In this study, Real-time Particle Swarm Optimization (RPSO) is proposed to find an optimal solution to the EGCS scheduling problem. Different traffic patterns and controller mechanisms for EGCS are analyzed. This study focuses on up-peak traffic because of its critical importance to modern office buildings. Simulation results show that EGCS based on Multi-Agent Systems (MAS) using RPSO gives good results for up-peak EGCS scheduling problem. Besides, the elevator real-time scheduling and reallocation functions are realized based on RPSO in case new information is available or the elevator becomes busy because it is unavailable or full. This study contributes a new scheduling algorithm for EGCS, and expands the application of PSO.

Real-Time Optimization Model for Continuous Reforming Regenerator

An approach for the simulation and optimization of continuous catalyst-regenerative process of reforming is proposed in this paper.Compared to traditional method such as finite difference method,the orthogonal collocation method is less time-consuming and more accurate,which can meet the requirement of real-time optimization(RTO).In this paper,the equation-oriented method combined with the orthogonal collocation method and the finite difference method is adopted to build the RTO model for catalytic reforming regenerator.The orthogonal collocation method was adopted to discretize the differential equations and sequential quadratic programming(SQP)algorithm was used to solve the algebraic equations.The rate constants,active energy and reaction order were estimated,with the sum of relative errors between actual value and simulated value serving as optimization objective function.The model can quickly predict the fields of component concentration,temperature and pressure inside the regenerator under different conditions,as well as the real-time optimized conditions for industrial reforming regenerator.

Low-Power Operational Amplifier for Real-Time Signal Processing System of Micro Air Vehicle

A low-power complementary metal oxide semiconductor（CMOS） operational amplifier （op-amp） for real-time signal processing of micro air vehicle （MAV） is designed in this paper.Traditional folded cascode architecture with positive channel metal oxide semiconductor（PMOS） differential input transistors and sub-threshold technology are applied under the low supply voltage.Simulation results show that this amplifier has significantly low power,while maintaining almost the same gain,bandwidth and other key performances.The power required is only 0.12 mW,which is applicable to low-power and low-voltage real-time signal acquisition and processing system.

Eureka Webair： Web-Based Air Quality Management, Real-Time Forecasting and Emission Control Optimization

For the assessment and management of regional to local air quality, an integrated environmental management information system was built within the multi national Eureka project 3266 Webair, http：//www.ess.co.at/WEBAIR. The system combines data bases and GIS and a range of coupled models and analytical tools that address a range of typical management problems and cover several levels of nesting from regional to city level and street canyons. The main functions are to support regulatory tasks, compliance monitoring, operational forecasting and reporting, impact assessment EIA （environmental impact assessment）, SEA （strategic environmental assessment） and public information within one consistent framework. A major objective is the improvement of air quality through emission control. The integrated model system together with its shared data bases provides a reliable, consistent basis for the non-linear techno-economic and multi-criteria optimization of emission control strategies （including greenhouse gases and energy efficiency）. A real-time expert system drives, supports and monitors the autonomous and interactive operations, and provides embedded QA/QC （quality assurance/quality control） functions for reliable operations and ease of use.