Energy-Saving Distributed Flexible Job Shop Scheduling Optimization with Dual Resource Constraints Based on Integrated Q-Learning Multi-Objective Grey Wolf Optimizer

The distributed flexible job shop scheduling problem(DFJSP)has attracted great attention with the growth of the global manufacturing industry.General DFJSP research only considers machine constraints and ignores worker constraints.As one critical factor of production,effective utilization of worker resources can increase productivity.Meanwhile,energy consumption is a growing concern due to the increasingly serious environmental issues.Therefore,the distributed flexible job shop scheduling problem with dual resource constraints(DFJSP-DRC)for minimizing makespan and total energy consumption is studied in this paper.To solve the problem,we present a multi-objective mathematical model for DFJSP-DRC and propose a Q-learning-based multi-objective grey wolf optimizer(Q-MOGWO).In Q-MOGWO,high-quality initial solutions are generated by a hybrid initialization strategy,and an improved active decoding strategy is designed to obtain the scheduling schemes.To further enhance the local search capability and expand the solution space,two wolf predation strategies and three critical factory neighborhood structures based on Q-learning are proposed.These strategies and structures enable Q-MOGWO to explore the solution space more efficiently and thus find better Pareto solutions.The effectiveness of Q-MOGWO in addressing DFJSP-DRC is verified through comparison with four algorithms using 45 instances.The results reveal that Q-MOGWO outperforms comparison algorithms in terms of solution quality.

Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection

Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention.Various constrained multi-objective optimization evolutionary algorithms(CMOEAs)have been developed with the use of different algorithmic strategies,evolutionary operators,and constraint-handling techniques.The performance of CMOEAs may be heavily dependent on the operators used,however,it is usually difficult to select suitable operators for the problem at hand.Hence,improving operator selection is promising and necessary for CMOEAs.This work proposes an online operator selection framework assisted by Deep Reinforcement Learning.The dynamics of the population,including convergence,diversity,and feasibility,are regarded as the state;the candidate operators are considered as actions;and the improvement of the population state is treated as the reward.By using a Q-network to learn a policy to estimate the Q-values of all actions,the proposed approach can adaptively select an operator that maximizes the improvement of the population according to the current state and thereby improve the algorithmic performance.The framework is embedded into four popular CMOEAs and assessed on 42 benchmark problems.The experimental results reveal that the proposed Deep Reinforcement Learning-assisted operator selection significantly improves the performance of these CMOEAs and the resulting algorithm obtains better versatility compared to nine state-of-the-art CMOEAs.

A Multi-Objective Optimization for Locating Maintenance Stations and Operator Dispatching of Corrective Maintenance

In this study,we introduce a novel multi-objective optimization model tailored for modern manufacturing,aiming to mitigate the cost impacts of operational disruptions through optimized corrective maintenance.Central to our approach is the strategic placement of maintenance stations and the efficient allocation of personnel,addressing a crucial gap in the integration of maintenance personnel dispatching and station selection.Our model uniquely combines the spatial distribution of machinery with the expertise of operators to achieve a harmonious balance between maintenance efficiency and cost-effectiveness.The core of our methodology is the NSGA Ⅲ+Dispatch,an advanced adaptation of the Non-Dominated Sorting Genetic Algorithm Ⅲ(NSGA-Ⅲ),meticulously designed for the selection of maintenance stations and effective operator dispatching.This method integrates a comprehensive coding process,crossover operator,and mutation operator to efficiently manage multiple objectives.Rigorous empirical testing,including a detailed analysis from a taiwan region electronic equipment manufacturer,validated the effectiveness of our approach across various scenarios of machine failure frequencies and operator configurations.The findings reveal that the proposed model significantly outperforms current practices by reducing response times by up to 23%in low-frequency and 28.23%in high-frequency machine failure scenarios,leading to notable improvements in efficiency and cost reduction.Additionally,it demonstrates significant improvements in oper-ational efficiency,particularly in selective high-frequency failure contexts,while ensuring substantial manpower cost savings without compromising on operational effectiveness.This research significantly advances maintenance strategies in production environments,providing the manufacturing industry with practical,optimized solutions for diverse machine malfunction situations.Furthermore,the methodologies and principles developed in this study have potential applications in various other sectors,including healthcare,transportation,and energy,where maintenance efficiency and resource optimization are equally critical.

A Novel Collaborative Evolutionary Algorithm with Two-Population for Multi-Objective Flexible Job Shop Scheduling

Job shop scheduling(JS)is an important technology for modern manufacturing.Flexible job shop scheduling(FJS)is critical in JS,and it has been widely employed in many industries,including aerospace and energy.FJS enables any machine from a certain set to handle an operation,and this is an NP-hard problem.Furthermore,due to the requirements in real-world cases,multi-objective FJS is increasingly widespread,thus increasing the challenge of solving the FJS problems.As a result,it is necessary to develop a novel method to address this challenge.To achieve this goal,a novel collaborative evolutionary algorithmwith two-population based on Pareto optimality is proposed for FJS,which improves the solutions of FJS by interacting in each generation.In addition,several experimental results have demonstrated that the proposed method is promising and effective for multi-objective FJS,which has discovered some new Pareto solutions in the well-known benchmark problems,and some solutions can dominate the solutions of some other methods.

Operation Control Method of Relay Protection in Flexible DC Distribution Network Compatible with Distributed Power Supply

A novel operation control method for relay protection in flexible DC distribution networks with distributed power supply is proposed to address the issue of inaccurate fault location during relay protection,leading to poor performance.The method combines a fault-tolerant fault location method based on long-term and short-term memory networks to accurately locate the fault section.Then,an operation control method for relay protection based on adaptive weight and whale optimization algorithm(WOA)is used to construct an objective function considering the shortest relay protection action time and the smallest impulse current.The adaptive weight and WOA are employed to obtain the optimal strategy for relay protection operation control,reducing the action time and impulse current.Experimental results demonstrate the effectiveness of the proposed method in accurately locating faults and improving relay protection performance.The longest operation time is reduced by 4.7023 s,and the maximum impulse current is limited to 0.3 A,effectively controlling the impact of large impulse currents and enhancing control efficiency.

Multi-objective reservoir operation using particle swarm optimization with adaptive random inertia weights

Based on conventional particle swarm optimization(PSO),this paper presents an efficient and reliable heuristic approach using PSO with an adaptive random inertia weight(ARIW)strategy,referred to as the ARIW-PSO algorithm,to build a multi-objective optimization model for reservoir operation.Using the triangular probability density function,the inertia weight is randomly generated,and the probability density function is automatically adjusted to make the inertia weight generally greater in the initial stage of evolution,which is suitable for global searches.In the evolution process,the inertia weight gradually decreases,which is beneficial to local searches.The performance of the ARIWPSO algorithm was investigated with some classical test functions,and the results were compared with those of the genetic algorithm(GA),the conventional PSO,and other improved PSO methods.Then,the ARIW-PSO algorithm was applied to multi-objective optimal dispatch of the Panjiakou Reservoir and multi-objective flood control operation of a reservoir group on the Luanhe River in China,including the Panjiakou Reservoir,Daheiting Reservoir,and Taolinkou Reservoir.The validity of the multi-objective optimization model for multi-reservoir systems based on the ARIW-PSO algorithm was verified.

Initiative Optimization Operation Strategy and Multi-objective Energy Management Method for Combined Cooling Heating and Power

This paper proposed an initiative optimization operation strategy and multi-objective energy management method for combined cooling heating and power(CCHP) with storage systems.Initially,the initiative optimization operation strategy of CCHP system in the cooling season,the heating season and the transition season was formulated.The energy management of CCHP system was optimized by the multi-objective optimization model with maximum daily energy efficiency,minimum daily carbon emissions and minimum daily operation cost based on the proposed initiative optimization operation strategy.Furthermore,the pareto optimal solution set was solved by using the niche particle swarm multi-objective optimization algorithm.Ultimately,the most satisfactory energy management scheme was obtained by using the technique for order preference by similarity to ideal solution(TOPSIS) method.A case study of CCHP system used in a hospital in the north of China validated the effectiveness of this method.The results showed that the satisfactory energy management scheme of CCHP system was obtained based on this initiative optimization operation strategy and multi-objective energy management method.The CCHP system has achieved better energy efficiency,environmental protection and economic benefits.

Multi-objective optimization of operation loop recommendation for kill web

In order to improve our military ’s level of intelligent accusation decision-making in future intelligent joint warfare, this paper studies operation loop recommendation methods for kill web based on the fundamental combat form of the future, i.e.,“web-based kill,” and the operation loop theory. Firstly, we pioneer the operation loop recommendation problem with operation ring quality as the objective and closed-loop time as the constraint, and construct the corresponding planning model.Secondly, considering the case where there are multiple decision objectives for the combat ring recommendation problem,we propose for the first time a multi-objective optimization algorithm, the multi-objective ant colony evolutionary algorithm based on decomposition(MOACEA/D), which integrates the multi-objective evolutionary algorithm based on decomposition(MOEA/D) with the ant colony algorithm. The MOACEA/D can converge the optimal solutions of multiple single objectives nondominated solution set for the multi-objective problem. Finally,compared with other classical multi-objective optimization algorithms, the MOACEA/D is superior to other algorithms superior in terms of the hyper volume(HV), which verifies the effectiveness of the method and greatly improves the quality and efficiency of commanders’ decision-making.

An improved multi-objective optimization algorithm for solving flexible job shop scheduling problem with variable batches

In order to solve the flexible job shop scheduling problem with variable batches,we propose an improved multiobjective optimization algorithm,which combines the idea of inverse scheduling.First,a flexible job shop problem with the variable batches scheduling model is formulated.Second,we propose a batch optimization algorithm with inverse scheduling in which the batch size is adjusted by the dynamic feedback batch adjusting method.Moreover,in order to increase the diversity of the population,two methods are developed.One is the threshold to control the neighborhood updating,and the other is the dynamic clustering algorithm to update the population.Finally,a group of experiments are carried out.The results show that the improved multi-objective optimization algorithm can ensure the diversity of Pareto solutions effectively,and has effective performance in solving the flexible job shop scheduling problem with variable batches.

Study on Optimization of Urban Rail Train Operation Control Curve Based on Improved Multi-Objective Genetic Algorithm

A multi-objective improved genetic algorithm is constructed to solve the train operation simulation model of urban rail train and find the optimal operation curve.In the train control system,the conversion point of operating mode is the basic of gene encoding and the chromosome composed of multiple genes represents a control scheme,and the initial population can be formed by the way.The fitness function can be designed by the design requirements of the train control stop error,time error and energy consumption.the effectiveness of new individual can be ensured by checking the validity of the original individual when its in the process of selection,crossover and mutation,and the optimal algorithm will be joined all the operators to make the new group not eliminate on the best individual of the last generation.The simulation result shows that the proposed genetic algorithm comparing with the optimized multi-particle simulation model can reduce more than 10%energy consumption,it can provide a large amount of sub-optimal solution and has obvious optimization effect.

Optimal Location and Sizing of Distributed Generator via Improved Multi-Objective Particle Swarm Optimization in Active Distribution Network Considering Multi-Resource

In the framework of vigorous promotion of low-carbon power system growth as well as economic globalization,multi-resource penetration in active distribution networks has been advancing fiercely.In particular,distributed generation(DG)based on renewable energy is critical for active distribution network operation enhancement.To comprehensively analyze the accessing impact of DG in distribution networks from various parts,this paper establishes an optimal DG location and sizing planning model based on active power losses,voltage profile,pollution emissions,and the economics of DG costs as well as meteorological conditions.Subsequently,multiobjective particle swarm optimization(MOPSO)is applied to obtain the optimal Pareto front.Besides,for the sake of avoiding the influence of the subjective setting of the weight coefficient,the decisionmethod based on amodified ideal point is applied to execute a Pareto front decision.Finally,simulation tests based on IEEE33 and IEEE69 nodes are designed.The experimental results show thatMOPSO can achieve wider and more uniformPareto front distribution.In the IEEE33 node test system,power loss,and voltage deviation decreased by 52.23%,and 38.89%,respectively,while taking the economy into account.In the IEEE69 test system,the three indexes decreased by 19.67%,and 58.96%,respectively.

Do Search and Selection Operators Play Important Roles in Multi-Objective Evolutionary Algorithms:A Case Study

Multi-objective Evolutionary Algorithm (MOEA) is becoming a hot research area and quite a few aspects of MOEAs have been studied and discussed. However there are still few literatures discussing the roles of search and selection operators in MOEAs. This paper studied their roles by solving a case of discrete Multi-objective Optimization Problem (MOP): Multi-objective TSP with a new MOEA. In the new MOEA, We adopt an efficient search operator, which has the properties of both crossover and mutation, to generate the new individuals and chose two selection operators: Family Competition and Population Competition with probabilities to realize selection. The simulation experiments showed that this new MOEA could get good uniform solutions representing the Pareto Front and outperformed SPEA in almost every simulation run on this problem. Furthermore, we analyzed its convergence property using finite Markov chain and proved that it could converge to Pareto Front with probability 1. We also find that the convergence property of MOEAs has much relationship with search and selection operators.

Research on Flexible Transfer Line Schematic Design Using Hierarchical Process Planning

Flexible transfer line(FTL)is now widely used in ma ny manufacturing domains to realize efficiently,high quantity and economic prod uction.These manufacturing domains include automobile,tractor,internal-combu stion engine,and so on.In today’s competitive business environment,it is vit ally important for machine tool manufacturers to design flexible transfer line m ore effectively and efficiently according to a wider variety of customer demand s.This paper proposes an approach to a bidding-based flexible transfer line sc hematic design system.By analyzing manual FTL design process,the architecture o f flexible transfer line schematic design system(FTLSDS)is established.The syst em consists:of four processes:part feature modeling,process planning,FTL fac i lity layout and FTL evaluation. For FTL schematic design.a five-level proces s planning strategy named hierarchical process planning method is proposed.This method includes selection of manufacturing feature machining operation;part se t-up planning,feature sequencing,operation sequencing and process plan genera ting.The major decision relies on setup planning.According to the proceeding o f the hierarchical process planning,the structure of reasoning is proposed base d on blackboard.Under this paradigm,a cooperative effort between a hybrid coll ection of knowledge sources is possible.Total reasoning task can be divided int o some subtasks,and recursive-reasoning system is formed.It is convenient for process planning with step-by-step solution.Meanwhile,the blackboard is use d as the global data exchange area during all reasoning process.By using modula r technology,special purpose machine tools can be designed more efficiently and rapidly.The framework of machine modular design system to support machine requ irement design for FTL is established.By synthesizing the FTL evaluation criter ia.five evaluation criteria of flexible transfer 1ine schematic design are take n into account.An exampie is supplied to demonstrate and verify the validity an d feasibility of flexible transfer line schematic design approach.

Optimization operation model of electricity market considering renewable energy accommodation and flexibility requirement

The renewable portfolio standard has been promoted in parallel with the reform of the electricity market,and the flexibility requirement of the power system has rapidly increased.To promote renewable energy consumption and improve power system flexibility,a bi-level optimal operation model of the electricity market is proposed.A probabilistic model of the flexibility requirement is established,considering the correlation between wind power,photovoltaic power,and load.A bi-level optimization model is established for the multi-markets;the upper and lower models represent the intra-provincial market and inter-provincial market models,respectively.To efficiently solve the model,it is transformed into a mixed-integer linear programming model using the Karush–Kuhn–Tucker condition and Lagrangian duality theory.The economy and flexibility of the model are verified using a provincial power grid as an example.

Multi-objective reconfigurable production line scheduling for smart home appliances

In a typical discrete manufacturing process,a new type of reconfigurable production line is introduced,which aims to help small-and mid-size enterprises to improve machine utilization and reduce production cost.In order to effectively handle the production scheduling problem for the manufacturing system,an improved multi-objective particle swarm optimization algorithm based on Brownian motion(MOPSO-BM)is proposed.Since the existing MOPSO algorithms are easily stuck in the local optimum,the global search ability of the proposed method is enhanced based on the random motion mechanism of the BM.To further strengthen the global search capacity,a strategy of fitting the inertia weight with the piecewise Gaussian cumulative distribution function(GCDF)is included,which helps to maintain an excellent convergence rate of the algorithm.Based on the commonly used indicators generational distance(GD)and hypervolume(HV),we compare the MOPSO-BM with several other latest algorithms on the benchmark functions,and it shows a better overall performance.Furthermore,for a real reconfigurable production line of smart home appliances,three algorithms,namely non-dominated sorting genetic algorithm-II(NSGA-II),decomposition-based MOPSO(dMOPSO)and MOPSO-BM,are applied to tackle the scheduling problem.It is demonstrated that MOPSO-BM outperforms the others in terms of convergence rate and quality of solutions.

Multi-objective Optimization of Geothermal Extraction from the Enhanced Geothermal System in Qiabuqia Geothermal Field, Gonghe Basin

A geothermal demonstration exploitation area will be established in the Enhanced Geothermal System of the Qiabuqia field, Gonghe Basin, Qinghai–Xizang Plateau in China. Selection of operational parameters for geothermal field extraction is thus of great significance to realize the best production performance. A novel integrated method of finite element and multi-objective optimization has been employed to obtain the optimal scheme for thermal extraction from the Gonghe Basin. A thermal-hydraulic-mechanical coupling model(THM) is established to analyze the thermal performance. From this it has been found that there exists a contraction among different heat extraction indexes. Parametric study indicates that injection mass rate(Q_(in)) is the most sensitive parameter to the heat extraction, followed by well spacing(WS) and injection temperature(T_(in)). The least sensitive parameter is production pressure(p_(out)). The optimal combination of operational parameters acquired is such that(T_(in), p_(out), Q_(in), WS) equals(72.72°C, 30.56 MPa, 18.32 kg/s, 327.82 m). Results indicate that the maximum electrical power is 1.41 MW for the optimal case over 20 years. The thermal break has been relieved and the pressure difference reduced by 8 MPa compared with the base case. The optimal case would extract 50% more energy than that of a previous case and the outcome will provide a remarkable reference for the construction of Gonghe project.

A Multi-Objective Optimal Evolutionary Algorithm Based on Tree-Ranking

Multi-objective optimal evolutionary algorithms (MOEAs) are a kind of new effective algorithms to solve Multi-objective optimal problem (MOP). Because ranking, a method which is used by most MOEAs to solve MOP, has some shortcoming s, in this paper, we proposed a new method using tree structure to express the relationship of solutions. Experiments prove that the method can reach the Pare-to front, retain the diversity of the population, and use less time.

Multi-function terahertz wave manipulation utilizing Fourier convolution operation metasurface

We propose a novel metasurface based on a combined pattern of outer C-shaped ring and inner rectangular ring.By Fourier convolution operation to generating different predesigned sequences of metasurfaces,we realize various functionalities to flexible manipulate terahertz waves including vortex terahertz beam splitting,anomalous vortex terahertz wave deflection,vortex terahertz wave splitting and deflection simultaneously.The incident terahertz wave can be flexibly controlled in a single metasurface.The designed metasurface has an extensive application prospect in the field of future terahertz communication and sensing.

Research on Optimization of Freight Train ATO Based on Elite Competition Multi-Objective Particle Swarm Optimization

In view of the complex problems that freight train ATO (automatic train operation) needs to comprehensively consider punctuality, energy saving and safety, a dynamics model of the freight train operation process is established based on the safety and the freight train dynamics model in the process of its operation. The algorithm of combining elite competition strategy with multi-objective particle swarm optimization technology is introduced, and the winning particles are obtained through the competition between two elite particles to guide the update of other particles, so as to balance the convergence and distribution of multi-objective particle swarm optimization. The performance comparison experimental results verify the superiority of the proposed algorithm. The simulation experiments of the actual line verify the feasibility of the model and the effectiveness of the proposed algorithm.

New operation strategy and multi-objective optimization of hybrid solar-fuel CCHP system with fuel thermochemical conversion and source-loads matching

Multi-energy hybrid energy systems are a promising option to mitigate fluctuations in the renewable energy supply and are crucial in achieving carbon neutrality.Solar-fuel thermochemical hybrid utilization upgrades solar energy to fuel chemical energy,thereby achieving the efficient utilization of solar energy,reducing CO_(2)emission,and improving operation stability.For hybrid solar-fuel thermochemical CCHP systems,conventional integration optimization methods and operation modes do not account for the instability of solar energy,thermochemical conversion,and solar fuel storage.To improve the utilization efficiency of solar energy and fuel and achieve favorable economic and environmental performance,a new operation strategy and the optimization of a mid-and-low temperature solar-fuel thermochemical hybrid CCHP system are proposed herein.The system operation modes for various supply-demand scenarios of solar energy input and thermal-power outputs are analyzed,and a new operation strategy that accounts for the effect of solar energy is proposed,which is superior to conventional CCHP system strategies that primarily focus on the balance between system outputs and user loads.To alleviate the challenges of source-load fluctuations and supply-demand mismatches,a multi-objective optimization model is established to optimize the system integration configurations,with objective functions of system energy ratio,cost savings ratio,and CO_(2)emission savings ratio,as well as decision variables of power unit capacity,solar collector area,and syngas storage capacity.The optimization design of the system configuration and the operation strategy improve the performance of the hybrid system.The results show that the system annual energy ratio,cost saving ratio,and CO_(2)emission saving ratio are 52.72%,11.61%,and 36.27%,respectively,whereas the monthly CO_(2)emission reduction rate is 27.3%–47.6%compared with those of reference systems.These promising results will provide useful guidance for the integrated design and operational regulation of hybrid solar-fuel thermochemical systems.