Policy Gradient Adaptive Dynamic Programming for Model-Free Multi-Objective Optimal Control

Dear Editor,In this letter,the multi-objective optimal control problem of nonlinear discrete-time systems is investigated.A data-driven policy gradient algorithm is proposed in which the action-state value function is used to evaluate the policy.In the policy improvement process,the policy gradient based method is employed.

Optimal Location and Sizing ofMulti-Resource Distributed Generator Based onMulti-Objective Artificial Bee Colony Algorithm

Distribution generation(DG)technology based on a variety of renewable energy technologies has developed rapidly.A large number of multi-type DG are connected to the distribution network(DN),resulting in a decline in the stability of DN operation.It is urgent to find a method that can effectively connect multi-energy DG to DN.photovoltaic(PV),wind power generation(WPG),fuel cell(FC),and micro gas turbine(MGT)are considered in this paper.A multi-objective optimization model was established based on the life cycle cost(LCC)of DG,voltage quality,voltage fluctuation,system network loss,power deviation of the tie-line,DG pollution emission index,and meteorological index weight of DN.Multi-objective artificial bee colony algorithm(MOABC)was used to determine the optimal location and capacity of the four kinds of DG access DN,and compared with the other three heuristic algorithms.Simulation tests based on IEEE 33 test node and IEEE 69 test node show that in IEEE 33 test node,the total voltage deviation,voltage fluctuation,and system network loss of DN decreased by 49.67%,7.47%and 48.12%,respectively,compared with that without DG configuration.In the IEEE 69 test node,the total voltage deviation,voltage fluctuation and system network loss of DN in the MOABC configuration scheme decreased by 54.98%,35.93%and 75.17%,respectively,compared with that without DG configuration,indicating that MOABC can reasonably plan the capacity and location of DG.Achieve the maximum trade-off between DG economy and DN operation stability.

Multi-objective optimization and evaluation of supercritical CO_(2) Brayton cycle for nuclear power generation

The supercritical CO_(2) Brayton cycle is considered a promising energy conversion system for Generation IV reactors for its simple layout,compact structure,and high cycle efficiency.Mathematical models of four Brayton cycle layouts are developed in this study for different reactors to reduce the cost and increase the thermohydraulic performance of nuclear power generation to promote the commercialization of nuclear energy.Parametric analysis,multi-objective optimizations,and four decision-making methods are applied to obtain each Brayton scheme’s optimal thermohydraulic and economic indexes.Results show that for the same design thermal power scale of reactors,the higher the core’s exit temperature,the better the Brayton cycle’s thermo-economic performance.Among the four-cycle layouts,the recompression cycle(RC)has the best overall performance,followed by the simple recuperation cycle(SR)and the intercooling cycle(IC),and the worst is the reheating cycle(RH).However,RH has the lowest total cost of investment(C_(tot))of$1619.85 million,and IC has the lowest levelized cost of energy(LCOE)of 0.012$/(kWh).The nuclear Brayton cycle system’s overall performance has been improved due to optimization.The performance of the molten salt reactor combined with the intercooling cycle(MSR-IC)scheme has the greatest improvement,with the net output power(W_(net)),thermal efficiencyη_(t),and exergy efficiency(η_(e))improved by 8.58%,8.58%,and 11.21%,respectively.The performance of the lead-cooled fast reactor combined with the simple recuperation cycle scheme was optimized to increase C_(tot) by 27.78%.In comparison,the internal rate of return(IRR)increased by only 7.8%,which is not friendly to investors with limited funds.For the nuclear Brayton cycle,the molten salt reactor combined with the recompression cycle scheme should receive priority,and the gas-cooled fast reactor combined with the reheating cycle scheme should be considered carefully.

Multi-Strategy Assisted Multi-Objective Whale Optimization Algorithm for Feature Selection

In classification problems,datasets often contain a large amount of features,but not all of them are relevant for accurate classification.In fact,irrelevant features may even hinder classification accuracy.Feature selection aims to alleviate this issue by minimizing the number of features in the subset while simultaneously minimizing the classification error rate.Single-objective optimization approaches employ an evaluation function designed as an aggregate function with a parameter,but the results obtained depend on the value of the parameter.To eliminate this parameter’s influence,the problem can be reformulated as a multi-objective optimization problem.The Whale Optimization Algorithm(WOA)is widely used in optimization problems because of its simplicity and easy implementation.In this paper,we propose a multi-strategy assisted multi-objective WOA(MSMOWOA)to address feature selection.To enhance the algorithm’s search ability,we integrate multiple strategies such as Levy flight,Grey Wolf Optimizer,and adaptive mutation into it.Additionally,we utilize an external repository to store non-dominant solution sets and grid technology is used to maintain diversity.Results on fourteen University of California Irvine(UCI)datasets demonstrate that our proposed method effectively removes redundant features and improves classification performance.The source code can be accessed from the website:https://github.com/zc0315/MSMOWOA.

基于D-optimal法优化香菇菌种培养基质配方的研究

为了筛选和优化香菇原种及栽培种的培养基质配方,采用D-optimal设计方法,以麦粒和木屑不同配比为原料优化香菇原种培养基质,以木屑、玉米芯、麸皮不同配比为原料优化香菇栽培种培养基质,以香菇品种L808作为供试菌种,分别以其菌丝萌发期、菌丝长速、满袋期为评价指标,通过对各评价指标的测量,建立了各配比基质与香菇培养基质配方响应值之间的回归模型,从而科学的优化出香菇原种及栽培种栽培基质的配方。试验结果表明,香菇原种栽培基质最优配方为50%麦粒+50%木屑;香菇栽培种栽培基质最优配方为37.69%玉米芯+23.33%麸皮+38.98%木屑。在以上2个配方的栽培基质接种后,香菇菌丝的生长旺盛,萌发期短、满袋期短,且理化性质较优,说明优化得到的栽培基质配方具有较高的可行性,该设计方法也在优化培养料配比上是科学并且可行的。

A reduced combustion mechanism of ammonia/diesel optimized with multi-objective genetic algorithm

For the deep understanding on combustion of ammonia/diesel,this study develops a reduced mechanism of ammonia/diesel with 227 species and 937 reactions.The sub-mechanism on ammonia/interactions of N-based and C-based species(N—C)/NOx is optimized using the Non-dominated Sorting Genetic Algorithm II(NSGA-II)with 200 generations.The optimized mechanism(named as 937b)is validated against combustion characteristics of ammonia/methane(which is used to examine the accuracy of N—C interactions)and ammonia/diesel blends.The ignition delay times(IDTs),the laminar flame speeds and most of key intermediate species during the combustion of ammonia/methane blends can be accurately simulated by 937b under a wide range of conditions.As for ammonia/diesel blends with various diesel energy fractions,reasonable predictions on the IDTs under pressures from 1.0 MPa to5.0 MPa as well as the laminar flame speeds are also achieved by 937b.In particular,with regard to the IDT simulations of ammonia/diesel blends,937b makes progress in both aspects of overall accuracy and computational efficiency,compared to a detailed ammonia/diesel mechanism.Further kinetic analysis reveals that the reaction pathway of ammonia during the combustion of ammonia/diesel blend mainly differs in the tendencies of oxygen additions to NH_2 and NH with different equivalence ratios.

A Hybrid Multi-Objective Evolutionary Algorithm for Optimal Groundwater Management under Variable Density Conditions

In this paper, a new hybrid multi-objective evolutionary algorithm （MOEA）, the niched Pareto tabu search combined with a genetic algorithm （NPTSGA）, is proposed for the management of groundwater resources under variable density conditions. Relatively few MOEAs can possess global search ability contenting with intensified search in a local area. Moreover, the overall searching ability of tabu search （TS） based MOEAs is very sensitive to the neighborhood step size. The NPTSGA is developed on the thought of integrating the genetic algorithm （GA） with a TS based MOEA, the niched Pareto tabu search （NPTS）, which helps to alleviate both of the above difficulties. Here, the global search ability of the NPTS is improved by the diversification of candidate solutions arising from the evolving genetic algorithm population. Furthermore, the proposed methodology coupled with a density-dependent groundwater flow and solute transport simulator, SEAWAT, is developed and its performance is evaluated through a synthetic seawater intrusion management problem. Optimization results indicate that the NPTSGA offers a tradeoff between the two conflicting objectives. A key conclusion of this study is that the NPTSGA keeps the balance between the intensification of nondomination and the diversification of near Pareto-optimal solutions along the tradeoff curves and is a stable and robust method for implementing the multi-objective design of variable-density groundwater resources.

A modified back analysis method for deep excavation with multi-objective optimization procedure

Real-time prediction of excavation-induced displacement of retaining pile during the deep excavation process is crucial for construction safety.This paper proposes a modified back analysis method with multi-objective optimization procedure,which enables a real-time prediction of horizontal displacement of retaining pile during construction.As opposed to the traditional stage-by-stage back analysis,time series monitoring data till the current excavation stage are utilized to form a multi-objective function.Then,the multi-objective particle swarm optimization (MOPSO) algorithm is applied for parameter identification.The optimized model parameters are immediately adopted to predict the excavation-induced pile deformation in the continuous construction stages.To achieve efficient parameter optimization and real-time prediction of system behavior,the back propagation neural network (BPNN) is established to substitute the finite element model,which is further implemented together with MOPSO for automatic operation.The proposed approach is applied in the Taihu tunnel excavation project,where the effectiveness of the method is demonstrated via the comparisons with the site monitoring data.The method is reliable with a prediction accuracy of more than 90%.Moreover,different optimization algorithms,including non-dominated sorting genetic algorithm (NSGA-II),Pareto Envelope-based Selection Algorithm II (PESA-II) and MOPSO,are compared,and their influences on the prediction accuracy at different excavation stages are studied.The results show that MOPSO has the best performance for high dimensional optimization task.

Even Search in a Promising Region for Constrained Multi-Objective Optimization

In recent years, a large number of approaches to constrained multi-objective optimization problems(CMOPs) have been proposed, focusing on developing tweaked strategies and techniques for handling constraints. However, an overly finetuned strategy or technique might overfit some problem types,resulting in a lack of versatility. In this article, we propose a generic search strategy that performs an even search in a promising region. The promising region, determined by obtained feasible non-dominated solutions, possesses two general properties.First, the constrained Pareto front(CPF) is included in the promising region. Second, as the number of feasible solutions increases or the convergence performance(i.e., approximation to the CPF) of these solutions improves, the promising region shrinks. Then we develop a new strategy named even search,which utilizes the non-dominated solutions to accelerate convergence and escape from local optima, and the feasible solutions under a constraint relaxation condition to exploit and detect feasible regions. Finally, a diversity measure is adopted to make sure that the individuals in the population evenly cover the valuable areas in the promising region. Experimental results on 45 instances from four benchmark test suites and 14 real-world CMOPs have demonstrated that searching evenly in the promising region can achieve competitive performance and excellent versatility compared to 11 most state-of-the-art methods tailored for CMOPs.

Multi-Objective Optimization of VBHF in Deep Drawing Based on the Improved QO-Jaya Algorithm

Blank holder force(BHF)is a crucial parameter in deep drawing,having close relation with the forming quality of sheet metal.However,there are different BHFs maintaining the best forming effect in different stages of deep drawing.The variable blank holder force(VBHF)varying with the drawing stage can overcome this problem at an extent.The optimization of VBHF is to determine the optimal BHF in every deep drawing stage.In this paper,a new heuristic optimization algorithm named Jaya is introduced to solve the optimization efficiently.An improved“Quasi-oppositional”strategy is added to Jaya algorithm for improving population diversity.Meanwhile,an innovated stop criterion is added for better convergence.Firstly,the quality evaluation criteria for wrinkling and tearing are built.Secondly,the Kriging models are developed to approximate and quantify the relation between VBHF and forming defects under random sampling.Finally,the optimization models are established and solved by the improved QO-Jaya algorithm.A VBHF optimization example of component with complicated shape and thin wall is studied to prove the effectiveness of the improved Jaya algorithm.The optimization results are compared with that obtained by other algorithms based on the TOPSIS method.

Multi-Objective Optimization of the Ultrasonic Scalpel Rod and Tip with Improved Performance:Vibration Frequency,Amplitude,and Service Life

Ultrasonic scalpel design for minimally invasive surgical procedures is mainly focused on optimizing cutting performance.However,an important issue is the low fatigue life of traditional ultrasonic scalpels,which affects their long-term reliability and effectiveness and creates hidden dangers for surgery.In this study,a multi-objective optimal design for the cutting performance and fatigue life of ultrasonic scalpels was proposed using finite element analysis and fatigue simulation.The optimal design parameters of resonance frequency and amplitude were determined.By setting the transition fillet and keeping the gain structure away from the node position to enable the scalpel to have a high service life with excellent cutting performance.The frequency modulation method of setting the vibration node bosses at the node position and setting the vibration antinode grooves at the antinode position was compared.Then,the mechanism of the influence of various design elements,such as tip,shank,node position,and antinode position,on the resonance frequency,amplitude,and fatigue life of the ultrasonic scalpel was analyzed,and the optimal design principles of the ultrasonic scalpel were obtained.The proposed ultrasonic scalpel design was confirmed by simulations,impedance measurements,and liver tissue cutting experiments,demonstrating its feasibility and enhanced performance.This research introduces innovative design strategies to improve the fatigue life and performance of ultrasonic scalpels to address an important issue in minimally invasive surgery.

Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection

Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention.Various constrained multi-objective optimization evolutionary algorithms(CMOEAs)have been developed with the use of different algorithmic strategies,evolutionary operators,and constraint-handling techniques.The performance of CMOEAs may be heavily dependent on the operators used,however,it is usually difficult to select suitable operators for the problem at hand.Hence,improving operator selection is promising and necessary for CMOEAs.This work proposes an online operator selection framework assisted by Deep Reinforcement Learning.The dynamics of the population,including convergence,diversity,and feasibility,are regarded as the state;the candidate operators are considered as actions;and the improvement of the population state is treated as the reward.By using a Q-network to learn a policy to estimate the Q-values of all actions,the proposed approach can adaptively select an operator that maximizes the improvement of the population according to the current state and thereby improve the algorithmic performance.The framework is embedded into four popular CMOEAs and assessed on 42 benchmark problems.The experimental results reveal that the proposed Deep Reinforcement Learning-assisted operator selection significantly improves the performance of these CMOEAs and the resulting algorithm obtains better versatility compared to nine state-of-the-art CMOEAs.

Optimal Design of the Modular Joint Drive Train for Enhancing Cobot Load Capacity and Dynamic Performance

Automation advancements prompts the extensive integration of collaborative robot(cobot)across a range of industries.Compared to the commonly used design approach of increasing the payload-to-weight ratio of cobot to enhance load capacity,equal attention should be paid to the dynamic response characteristics of cobot during the design process to make the cobot more flexible.In this paper,a new method for designing the drive train parameters of cobot is proposed.Firstly,based on the analysis of factors influencing the load capacity and dynamic response characteristics,design criteria for both aspects are established for cobot with all optimization design criteria normalized within the design domain.Secondly,with the cobot in the horizontal pose,the motor design scheme is discretized and it takes the joint motor diameter and gearbox speed ratio as optimization design variables.Finally,all the discrete values of the optimization objectives are obtained through the enumeration method and the Pareto front is used to select the optimal solution through multi-objective optimization.Base on the cobot design method proposed in this paper,a six-axis cobot is designed and compared with the commercial cobot.The result shows that the load capacity of the designed cobot in this paper reaches 8.4 kg,surpassing the 5 kg load capacity commercial cobot which is used as a benchmark.The minimum resonance frequency of the joints is 42.70 Hz.

Constraints Separation Based Evolutionary Multitasking for Constrained Multi-Objective Optimization Problems

Constrained multi-objective optimization problems(CMOPs)generally contain multiple constraints,which not only form multiple discrete feasible regions but also reduce the size of optimal feasible regions,thus they propose serious challenges for solvers.Among all constraints,some constraints are highly correlated with optimal feasible regions;thus they can provide effective help to find feasible Pareto front.However,most of the existing constrained multi-objective evolutionary algorithms tackle constraints by regarding all constraints as a whole or directly ignoring all constraints,and do not consider judging the relations among constraints and do not utilize the information from promising single constraints.Therefore,this paper attempts to identify promising single constraints and utilize them to help solve CMOPs.To be specific,a CMOP is transformed into a multitasking optimization problem,where multiple auxiliary tasks are created to search for the Pareto fronts that only consider a single constraint respectively.Besides,an auxiliary task priority method is designed to identify and retain some high-related auxiliary tasks according to the information of relative positions and dominance relationships.Moreover,an improved tentative method is designed to find and transfer useful knowledge among tasks.Experimental results on three benchmark test suites and 11 realworld problems with different numbers of constraints show better or competitive performance of the proposed method when compared with eight state-of-the-art peer methods.

Crashworthiness Design and Multi-Objective Optimization of Bionic Thin-Walled Hybrid Tube Structures

Thin-walled structures are widely used in cars due to their lightweight construction and energy-absorbing properties.However,issues such as high initial stress and lowenergy-absorbing efficiency arise.This study proposes a novel energy-absorbing structure inwhich a straight tube is combinedwith a conical tube and a bamboo-inspired bulkhead structure is introduced.This configuration allows the conical tube to flip outward first and then fold together with the straight tube.This deformation mode absorbs more energy and less peak force than the conical tube sinking and flipping inward.Through finite element numerical simulation,the specific energy absorption capacity of the structure is increased by 26%compared to that of a regular circular cross-section tube.Finally,the impact resistance of the bionic straight tapered tube structure is further improved through multi-objective optimization,promoting the engineering application and lightweight design of hybrid cross-section tubes.

A Multi-Objective Optimization for Locating Maintenance Stations and Operator Dispatching of Corrective Maintenance

In this study,we introduce a novel multi-objective optimization model tailored for modern manufacturing,aiming to mitigate the cost impacts of operational disruptions through optimized corrective maintenance.Central to our approach is the strategic placement of maintenance stations and the efficient allocation of personnel,addressing a crucial gap in the integration of maintenance personnel dispatching and station selection.Our model uniquely combines the spatial distribution of machinery with the expertise of operators to achieve a harmonious balance between maintenance efficiency and cost-effectiveness.The core of our methodology is the NSGA Ⅲ+Dispatch,an advanced adaptation of the Non-Dominated Sorting Genetic Algorithm Ⅲ(NSGA-Ⅲ),meticulously designed for the selection of maintenance stations and effective operator dispatching.This method integrates a comprehensive coding process,crossover operator,and mutation operator to efficiently manage multiple objectives.Rigorous empirical testing,including a detailed analysis from a taiwan region electronic equipment manufacturer,validated the effectiveness of our approach across various scenarios of machine failure frequencies and operator configurations.The findings reveal that the proposed model significantly outperforms current practices by reducing response times by up to 23%in low-frequency and 28.23%in high-frequency machine failure scenarios,leading to notable improvements in efficiency and cost reduction.Additionally,it demonstrates significant improvements in oper-ational efficiency,particularly in selective high-frequency failure contexts,while ensuring substantial manpower cost savings without compromising on operational effectiveness.This research significantly advances maintenance strategies in production environments,providing the manufacturing industry with practical,optimized solutions for diverse machine malfunction situations.Furthermore,the methodologies and principles developed in this study have potential applications in various other sectors,including healthcare,transportation,and energy,where maintenance efficiency and resource optimization are equally critical.

MOALG: A Metaheuristic Hybrid of Multi-Objective Ant Lion Optimizer and Genetic Algorithm for Solving Design Problems

This study proposes a hybridization of two efficient algorithm’s Multi-objective Ant Lion Optimizer Algorithm(MOALO)which is a multi-objective enhanced version of the Ant Lion Optimizer Algorithm(ALO)and the Genetic Algorithm(GA).MOALO version has been employed to address those problems containing many objectives and an archive has been employed for retaining the non-dominated solutions.The uniqueness of the hybrid is that the operators like mutation and crossover of GA are employed in the archive to update the solutions and later those solutions go through the process of MOALO.A first-time hybrid of these algorithms is employed to solve multi-objective problems.The hybrid algorithm overcomes the limitation of ALO of getting caught in the local optimum and the requirement of more computational effort to converge GA.To evaluate the hybridized algorithm’s performance,a set of constrained,unconstrained test problems and engineering design problems were employed and compared with five well-known computational algorithms-MOALO,Multi-objective Crystal Structure Algorithm(MOCryStAl),Multi-objective Particle Swarm Optimization(MOPSO),Multi-objective Multiverse Optimization Algorithm(MOMVO),Multi-objective Salp Swarm Algorithm(MSSA).The outcomes of five performance metrics are statistically analyzed and the most efficient Pareto fronts comparison has been obtained.The proposed hybrid surpasses MOALO based on the results of hypervolume(HV),Spread,and Spacing.So primary objective of developing this hybrid approach has been achieved successfully.The proposed approach demonstrates superior performance on the test functions,showcasing robust convergence and comprehensive coverage that surpasses other existing algorithms.

Large-Scale Multi-Objective Optimization Algorithm Based on Weighted Overlapping Grouping of Decision Variables

The large-scale multi-objective optimization algorithm(LSMOA),based on the grouping of decision variables,is an advanced method for handling high-dimensional decision variables.However,in practical problems,the interaction among decision variables is intricate,leading to large group sizes and suboptimal optimization effects;hence a large-scale multi-objective optimization algorithm based on weighted overlapping grouping of decision variables(MOEAWOD)is proposed in this paper.Initially,the decision variables are perturbed and categorized into convergence and diversity variables;subsequently,the convergence variables are subdivided into groups based on the interactions among different decision variables.If the size of a group surpasses the set threshold,that group undergoes a process of weighting and overlapping grouping.Specifically,the interaction strength is evaluated based on the interaction frequency and number of objectives among various decision variables.The decision variable with the highest interaction in the group is identified and disregarded,and the remaining variables are then reclassified into subgroups.Finally,the decision variable with the strongest interaction is added to each subgroup.MOEAWOD minimizes the interactivity between different groups and maximizes the interactivity of decision variables within groups,which contributed to the optimized direction of convergence and diversity exploration with different groups.MOEAWOD was subjected to testing on 18 benchmark large-scale optimization problems,and the experimental results demonstrate the effectiveness of our methods.Compared with the other algorithms,our method is still at an advantage.

Research on the Mechanism of Multi-Sensor Fusion Configuration Based on the Optimal Principle of the Vehicle

In order to address the issue of sensor configuration redundancy in intelligent driving,this paper constructs a multi-objective optimization model that considers cost,coverage ability,and perception performance.And then,combining a specific set of parameters,the NSGA-II algorithm is used to solve the multi-objective model established in this paper,and a Pareto front containing 24 typical configuration schemes is extracted after considering empirical constraints.Finally,using the decision preference method proposed in this paper that combines subjective and objective factors,decision scores are calculated and ranked for various configuration schemes from both cost and performance preferences.The research results indicate that the multi-objective optimization model established in this paper can screen and optimize various configuration schemes from the optimal principle of the vehicle,and the optimized configuration schemes can be quantitatively ranked to obtain the decision results for the vehicle under different preference tendencies.

Multi-objective global optimization approach predicted quasi-layered ternary TiOS crystals with promising photocatalytic properties

Titanium dioxide(TiO_(2))has attracted considerable research attentions for its promising applications in solar cells and photocatalytic devices.However,the intrinsic challenge lies in the relatively low energy conversion efficiency of TiO_(2),primarily attributed to the substantial band gaps(exceeding 3.0 eV)associated with its rutile and anatase phases.Leveraging multi-objective global optimization,we have identified two quasi-layered ternary Ti-O-S crystals,composed of titanium,oxygen,and sulfur.The calculations of formation energy,phonon dispersions,and thermal stability confirm the chemical,dynamical and thermal stability of these newly discovered phases.Employing the state-of-art hybrid density functional approach and many-body perturbation theory(quasiparticle GW approach and Bethe-Salpeter equation),we calculate the optical properties of both the TiOS phases.Significantly,both phases show favorable photocatalytic characteristics,featuring band gaps suitable for visible optical absorption and appropriate band alignments with water for effective charge carrier separation.Therefore,ternary compound TiOS holds the potential for achieving high-efficiency photochemical conversion,showing our multi-objective global optimization provides a new approach for novel environmental and energy materials design with multicomponent compounds.