Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

A modified back analysis method for deep excavation with multi-objective optimization procedure

Real-time prediction of excavation-induced displacement of retaining pile during the deep excavation process is crucial for construction safety.This paper proposes a modified back analysis method with multi-objective optimization procedure,which enables a real-time prediction of horizontal displacement of retaining pile during construction.As opposed to the traditional stage-by-stage back analysis,time series monitoring data till the current excavation stage are utilized to form a multi-objective function.Then,the multi-objective particle swarm optimization (MOPSO) algorithm is applied for parameter identification.The optimized model parameters are immediately adopted to predict the excavation-induced pile deformation in the continuous construction stages.To achieve efficient parameter optimization and real-time prediction of system behavior,the back propagation neural network (BPNN) is established to substitute the finite element model,which is further implemented together with MOPSO for automatic operation.The proposed approach is applied in the Taihu tunnel excavation project,where the effectiveness of the method is demonstrated via the comparisons with the site monitoring data.The method is reliable with a prediction accuracy of more than 90%.Moreover,different optimization algorithms,including non-dominated sorting genetic algorithm (NSGA-II),Pareto Envelope-based Selection Algorithm II (PESA-II) and MOPSO,are compared,and their influences on the prediction accuracy at different excavation stages are studied.The results show that MOPSO has the best performance for high dimensional optimization task.

Multi-Objective Optimization of Aluminum Alloy Electric Bus Frame Connectors for Enhanced Durability

The widespread adoption of aluminumalloy electric buses,known for their energy efficiency and eco-friendliness,faces a challenge due to the aluminum frame’s susceptibility to deformation compared to steel.This issue is further exacerbated by the stringent requirements imposed by the flammability and explosiveness of batteries,necessitating robust frame protection.Our study aims to optimize the connectors of aluminum alloy bus frames,emphasizing durability,energy efficiency,and safety.This research delves into Multi-Objective Coordinated Optimization(MCO)techniques for lightweight design in aluminum alloy bus body connectors.Our goal is to enhance lightweighting,reinforce energy absorption,and improve deformation resistance in connector components.Three typical aluminum alloy connectors were selected and a design optimization platform was built for their MCO using a variety of software and methods.Firstly,through three-point bending experiments and finite element analysis on three types of connector components,we identified optimized design parameters based on deformation patterns.Then,employing Optimal Latin hypercube design(OLHD),parametric modeling,and neural network approximation,we developed high-precision approximate models for the design parameters of each connector component,targeting energy absorption,mass,and logarithmic strain.Lastly,utilizing the Archive-based Micro Genetic Algorithm(AMGA),Multi-Objective Particle Swarm Optimization(MOPSO),and Non-dominated SortingGenetic Algorithm(NSGA2),we explored optimized design solutions for these joint components.Subsequently,we simulated joint assembly buckling during bus rollover crash scenarios to verify and analyze the optimized solutions in three-point bending simulations.Each joint component showcased a remarkable 30%–40%mass reduction while boosting energy absorption.Our design optimization method exhibits high efficiency and costeffectiveness.Leveraging contemporary automation technology,the design optimization platform developed in this study is poised to facilitate intelligent optimization of lightweight metal components in future applications.

An integrated spatial planning of the mountainous landscapes for ski sports in a case area at the eastern Türkiye

Mountainous regions have disadvantages in economic development because of harsh physical and climatic conditions.However,winter tourism activities are one of the key components for supporting economic development in the highlands.Establishing a ski resort area supports direct and indirect employment in a region,and it stops immigration from mountainous regions to other places.This research aimed to assess the potential ski areas using a multi criteria evaluation technique in the Van region which is located in the eastern part of Türkiye.In this context,snow cover duration,sun effect,slope,slope length,elevation,population density,distance from main roads and lake visibility were used as input factors in the decision making process.Each factor was standardized using a fuzzy technique based on existing well-known ski centers in Türkiye.The weight of inputs was defined by applying a survey to the professional skiers.The most important factors were detected as transportation opportunities and snow covers whereas,the least important factors were elevation and population density.Additionally,lake visibility was very important to make a difference from other existing facilities in the region.Therefore,it was included as constraints and lake visible areas were extracted at the final stage of the research.Potential ski areas were mapped in three levels as professional,intermediate and beginner skiers.One of the suitable areas was selected as a sample projection and for the 3D simulation of the ski investment area.Potential costs and benefits were discussed.It was found that a ski tourism area investment can be amortized in 3 years in the region.

A new production component method for natural gas development planning

Based on an analysis of the limitations of conventional production component methods for natural gas development planning,this study proposes a new one that uses life cycle models for the trend fitting and prediction of production.In this new method,the annual production of old and new wells is predicted by year first and then is summed up to yield the production for the planning period.It shows that the changes in the production of old wells in old blocks can be fitted and predicted using the vapor pressure model(VPM),with precision of 80%e95%,which is 6.6%e13.2%higher than that of other life cycle models.Furthermore,a new production prediction process and method for new wells have been established based on this life cycle model to predict the production of medium-to-shallow gas reservoirs in western Sichuan Basin,with predication error of production rate in 2021 and 2022 being 6%and 3%respectively.The new method can be used to guide the medium-and long-term planning or annual scheme preparation for gas development.It is also applicable to planning for large single gas blocks that require continuous infill drilling and adjustment to improve gas recovery.

Inverted Modelling:An Effective Way to Support Motion Planning of Legged Mobile Robots

This paper presents an effective way to support motion planning of legged mobile robots—Inverted Modelling,based on the equivalent metamorphic mechanism concept.The difference from the previous research is that we herein invert the equivalent parallel mechanism.Assuming the leg mechanisms are hybrid links,the body of robot being considered as fixed platform,and ground as moving platform.The motion performance is transformed and measured in the body frame.Terrain and joint limits are used as input parameters to the model,resulting in the representation which is independent of terrains and particular poses in Inverted Modelling.Hence,it can universally be applied to any kind of legged robots as global motion performance framework.Several performance measurements using Inverted Modelling are presented and used in motion performance evaluation.According to the requirements of actual work like motion continuity and stability,motion planning of legged robot can be achieved using different measurements on different terrains.Two cases studies present the simulations of quadruped and hexapod robots walking on rugged roads.The results verify the correctness and effectiveness of the proposed method.

Review of multi-objective optimization in long-term energy system models

Modeling and optimizing long-term energy systems can provide solutions to various energy and environmental policies involving public-interest issues.The conventional optimization of long-term energy system models focuses on a single economic goal.However,the increasingly complex demands of energy systems necessitate the comprehensive consideration of multiple dimensional objectives,such as environmental,social,and energy security.Therefore,a multi-objective optimization of long-term energy system models has been developed.Herein,studies pertaining to the multi-objective optimization of long-term energy system models are summarized;the optimization objectives of long-term energy system models are classified into economic,environmental,social,and energy security aspects;and the multi-objective optimization methods are classified and explained based on the preferential expression of decision makers.Finally,the key development direction of the multi-objective optimization of energy system models is discussed.

Multi-objective evolutionary optimization for geostationary orbit satellite mission planning

In the past few decades, applications of geostationary orbit (GEO) satellites have attracted increasing attention, and with the development of optical technologies, GEO optical satellites have become popular worldwide. This paper proposes a general working pattern for a GEO optical satellite, as well as a target observation mission planning model. After analyzing the requirements of users and satellite control agencies, two objectives are simultaneously considered: maximization of total profit and minimization of satellite attitude maneuver angle. An NSGA-II based multi-objective optimization algorithm is proposed, which contains some heuristic principles in the initialization phase and mutation operator, and is embedded with a traveling salesman problem (TSP) optimization. The validity and performance of the proposed method are verified by extensive numerical simulations that include several types of point target distributions.

Multi-objective partition planning for multi-infeed HVDC system

The close proximity and the necessity of coordination between multiple high-voltage direct currents(HVDCs)raise the issue of grid partitioning in multi-infeed HVDC systems.A multi-objective partition strategy is proposed in this paper.Several types of relationships to be coordinated and complemented are analyzed and formulated using quantitative indices.According to the graph theory,the HVDC partition is transformed into a graph-cut problem and solved via the spectral clustering algorithm.Finally,the proposed method is validated for a practical multi-HVDC grid,confirming its feasibility and effectiveness.

Multi-objective Trajectory Planning Method based on the Improved Elitist Non-dominated Sorting Genetic Algorithm

Robot manipulators perform a point-point task under kinematic and dynamic constraints.Due to multi-degreeof-freedom coupling characteristics,it is difficult to find a better desired trajectory.In this paper,a multi-objective trajectory planning approach based on an improved elitist non-dominated sorting genetic algorithm(INSGA-II)is proposed.Trajectory function is planned with a new composite polynomial that by combining of quintic polynomials with cubic Bezier curves.Then,an INSGA-II,by introducing three genetic operators:ranking group selection(RGS),direction-based crossover(DBX)and adaptive precision-controllable mutation(APCM),is developed to optimize travelling time and torque fluctuation.Inverted generational distance,hypervolume and optimizer overhead are selected to evaluate the convergence,diversity and computational effort of algorithms.The optimal solution is determined via fuzzy comprehensive evaluation to obtain the optimal trajectory.Taking a serial-parallel hybrid manipulator as instance,the velocity and acceleration profiles obtained using this composite polynomial are compared with those obtained using a quintic B-spline method.The effectiveness and practicability of the proposed method are verified by simulation results.This research proposes a trajectory optimization method which can offer a better solution with efficiency and stability for a point-to-point task of robot manipulators.

Multi-objective route planning approach for timely searching tasks of a supervised robot

To performance efficient searching for an operator-supervised mobile robot, a multiple objectives route planning approach is proposed considering timeliness and path cost. An improved fitness function for route planning is proposed based on the multi-objective genetic algorithm （MOGA） for multiple objectives traveling salesman problem （MOTSP）. Then, the path between two route nodes is generated based on the heuristic path planning method A ＊. A simplified timeliness function for route nodes is proposed to represent the timeliness of each node. Based on the proposed timeliness function, experiments are conducted using the proposed two-stage planning method. The experimental results show that the proposed MOGA with improved fitness function can perform the searching function well when the timeliness of the searching task needs to be taken into consideration.

Multi-Objective Production Planning Using Lexicographic Procedure

This paper presents a multi-objective production planning model for a factory operating under a multi-product, and multi-period environment using the lexicographic (pre-emptive) procedure. The model objectives are to maximize the profit, minimize the total cost, and maximize the Overall Service Level (OSL) of the customers. The system consists of three potential suppliers that serve the factory to serve three customers/distributors. The performance of the developed model is illustrated using a verification example. Discussion of the results proved the efficacy of the model. Also, the effect of the deviation percentages on the different objectives is discussed.

Improved Fuzzification Method for Multi-Objective Decision-Making and Its Application in Evaluation of Highway Planning

A new fuzzification method for multi-objective decision-making and selective sorting is proposed on the basis of the fuzzy consistent relation, and the specific algorithm is presented. The method is applied to the evaluation of highway planning of Zhanjiang city. To decrease the subjectivity in the process of decision-making, the LOWA operator is introduced, and a discussion on how to select appropriate weights involved in multi-objective sorting is made. It is concluded that it is feasible to apply the fuzzy consistent relation to multi-objective decision-making analysis, and the improved fuzzication method is workable.

Distribution Network Expansion Planning Based on Multi-objective PSO Algorithm

This paper presents a novel approach for electrical distribution network expansion planning using multi-objective particle swarm optimization (PSO). The optimization objectives are: investment and operation cost, energy losses cost, and power congestion cost. A two-phase multi-objective PSO algorithm is employed to solve this optimization problem, which can accelerate the convergence and guarantee the diversity of Pareto-optimal front set as well. The feasibility and effectiveness of both the proposed multi-objective planning approach and the improved multi-objective PSO have been verified by the 18-node typical system.

MPC-based Motion Planning and Control Enables Smarter and Safer Autonomous Marine Vehicles:Perspectives and a Tutorial Survey

Autonomous marine vehicles(AMVs)have received considerable attention in the past few decades,mainly because they play essential roles in broad marine applications such as environmental monitoring and resource exploration.Recent advances in the field of communication technologies,perception capability,computational power and advanced optimization algorithms have stimulated new interest in the development of AMVs.In order to deploy the constrained AMVs in the complex dynamic maritime environment,it is crucial to enhance the guidance and control capabilities through effective and practical planning,and control algorithms.Model predictive control(MPC)has been exceptionally successful in different fields due to its ability to systematically handle constraints while optimizing control performance.This paper aims to provide a review of recent progress in the context of motion planning and control for AMVs from the perceptive of MPC.Finally,future research trends and directions in this substantial research area of AMVs are highlighted.

Energy-Efficient UAVs Coverage Path Planning Approach

Unmanned aerial vehicles(UAVs),commonly known as drones,have drawn significant consideration thanks to their agility,mobility,and flexibility features.They play a crucial role in modern reconnaissance,inspection,intelligence,and surveillance missions.Coverage path planning(CPP)which is one of the crucial aspects that determines an intelligent system’s quality seeks an optimal trajectory to fully cover the region of interest(ROI).However,the flight time of the UAV is limited due to a battery limitation and may not cover the whole region,especially in large region.Therefore,energy consumption is one of the most challenging issues that need to be optimized.In this paper,we propose an energy-efficient coverage path planning algorithm to solve the CPP problem.The objective is to generate a collision-free coverage path that minimizes the overall energy consumption and guarantees covering the whole region.To do so,the flight path is optimized and the number of turns is reduced to minimize the energy consumption.The proposed approach first decomposes the ROI into a set of cells depending on a UAV camera footprint.Then,the coverage path planning problem is formulated,where the exact solution is determined using the CPLEX solver.For small-scale problems,the CPLEX shows a better solution in a reasonable time.However,the CPLEX solver fails to generate the solution within a reasonable time for large-scale problems.Thus,to solve the model for large-scale problems,simulated annealing forCPP is developed.The results show that heuristic approaches yield a better solution for large-scale problems within amuch shorter execution time than the CPLEX solver.Finally,we compare the simulated annealing against the greedy algorithm.The results show that simulated annealing outperforms the greedy algorithm in generating better solution quality.

The Multi-Scale Numerical Modeling System for Research on the Relationship between Urban Planning and Meteorological Environment

Considering the urban characteristics, a customized multi-scale numerical modeling system is established to simulate the urban meteorological environment. The system mainly involves three spatial scales: the urban scale, urban sub-domain scale, and single to few buildings scale. In it, different underlying surface types are employed, the building drag factor is used to replace its roughness in the influence on the urban wind field, the effects of building distribution, azimuth and screening of shortwave radiation are added, and the influence of anthropogenic heating is also taken into account. All the numerical tests indicate that the simulated results are reasonably in agreement with the observational data, so the system can be used to simulate the urban meteorological environment. Making use of it, the characteristics of the meteorological environment from the urban to urban sub-domain scales, even the among-buildings scale, can be recognized. As long as the urban planning scheme is given, the corresponding simulated results can be obtained so as to meet the need of optimizing urban planning.

A Flexible Multi-Layer Map Model Designed for Lane-Level Route Planning in Autonomous Vehicles

An increasing number of drivers are relying on digital map navigation systems in vehicles or mobile phones to select optimal driving routes in order to save time and improve safety. In the near future, digital map navigation systems are expected to play more important roles in transportation systems. In order to extend current navigation systems to more applications, two fundamental problems must be resolved: the lane-level map model and lane-level route planning. This study proposes solutions to both problems. The current limitation of the lane-level map model is not its accuracy but its flexibility;this study proposes a novel seven-layer map structure, called as Tsinghua map model, which is able to support autonomous driving in a flexible and efficient way. For lane-level route planning, we propose a hierarchical route-searching algorithm to accelerate the planning process, even in the presence of complicated lane networks. In addition, we model the travel costs allocated for lane-level road networks by analyzing vehicle maneuvers in traversing lanes, changing lanes, and turning at intersections. Tests were performed on both a grid network and a real lane-level road network to demonstrate the validity and efficiency of the proposed algorithm.

Non-smooth environment modeling and global path planning for mobile robots

An Approximate Voronoi Boundary Network is constructed as the environmental model by way of enlar-ging the obstacle raster. The connectivity of the path network under complex environment is ensured through build-ing the second order Approximate Voronoi Boundary Network after adding virtual obstacles at joint-close grids. Thismethod embodies the network structure of the free area of environment with less nodes, so the complexity of pathplanning problem is reduced largely. An optimized path for mobile robot under complex environment is obtainedthrough the Genetic Algorithm based on the elitist rule and re-optimized by using the path-tightening method. Sincethe elitist one has the only authority of crossover, the management of one group becomes simple, which makes forobtaining the optimized path quickly. The Approximate Voronoi Boundary Network has a good tolerance to the im-precise a priori information and the noises of sensors under complex environment. Especially it is robust in dealingwith the local or partial changes, so a small quantity of dynamic obstacles is difficult to alter the overall character ofits connectivity, which means that it can also be adopted in dynamic environment by fusing the local path planning.

Modeling of UAV path planning based on IMM under POMDP framework

In order to enhance the capability of tracking targets autonomously of unmanned aerial vehicle (UAV), the partially observable Markov decision process (POMDP) model for UAV path planning is established based on the POMDP framework. The elements of the POMDP model are analyzed and described. The state transfer law in the model can be described by the method of interactive multiple model (IMM) due to the diversity of the target motion law, which is used to switch the motion model to accommodate target maneuvers, and hence improving the tracking accuracy. The simulation results show that the model can achieve efficient planning for the UAV route, and effective tracking for the target. Furthermore, the path planned by this model is more reasonable and efficient than that by using the single state transition law.