Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

Strategic Planning Practices of Hotels in Kenya

This study broadens perspectives of strategic planning procedures in hotels by analyzing hotel managers’perspectives on hotel strategy formulation and planning.The study was a descriptive quantitative study that targeted managers from various Kenyan hotels.180 questionnaires were returned from a sample of 280 hotel managers who had attended management development programs at a hospitality school.The primary goal of the study was to analyze two aspects of the strategic planning process:strategy formulation and strategic planning.The findings revealed that hotels in Kenya have developed methods and are keen on scanning their external environments.However,with the product offerings being so comparable,competitive analysis played an important role in the context.Creating a unique or specialty offering was not a popular option for most hotels.Cost-cutting was the most favored strategic inclination to achieve desired results.The balanced scorecard was underutilized in the sector.While managers were involved in the strategic planning process,other lower cadre employees were not,they were provided with the targets for the hotels’organizational goals to be achieved.The findings reveal that with similar products and services,the industry creates a hostile business climate with fierce rivalry and must invest in the most obvious alternative of cost reduction to survive.Alternative product innovation is not common in this industry for developing a differentiation approach that allows a property to control a market.

Efficient Route Planning for Real-Time Demand-Responsive Transit

Demand Responsive Transit (DRT) responds to the dynamic users’ requests without any fixed routes and timetablesand determines the stop and the start according to the demands. This study explores the optimization of dynamicvehicle scheduling and real-time route planning in urban public transportation systems, with a focus on busservices. It addresses the limitations of current shared mobility routing algorithms, which are primarily designedfor simpler, single origin/destination scenarios, and do not meet the complex demands of bus transit systems. Theresearch introduces an route planning algorithm designed to dynamically accommodate passenger travel needsand enable real-time route modifications. Unlike traditional methods, this algorithm leverages a queue-based,multi-objective heuristic A∗ approach, offering a solution to the inflexibility and limited coverage of suburbanbus routes. Also, this study conducts a comparative analysis of the proposed algorithm with solutions based onGenetic Algorithm (GA) and Ant Colony Optimization Algorithm (ACO), focusing on calculation time, routelength, passenger waiting time, boarding time, and detour rate. The findings demonstrate that the proposedalgorithmsignificantly enhances route planning speed, achieving an 80–100-fold increase in efficiency over existingmodels, thereby supporting the real-time demands of Demand-Responsive Transportation (DRT) systems. Thestudy concludes that this algorithm not only optimizes route planning in bus transit but also presents a scalablesolution for improving urban mobility.

Motion Planning for Autonomous Driving with Real Traffic Data Validation

Accurate trajectory prediction of surrounding road users is the fundamental input for motion planning,which enables safe autonomous driving on public roads.In this paper,a safe motion planning approach is proposed based on the deep learning-based trajectory prediction method.To begin with,a trajectory prediction model is established based on the graph neural network(GNN)that is trained utilizing the INTERACTION dataset.Then,the validated trajectory prediction model is used to predict the future trajectories of surrounding road users,including pedestrians and vehicles.In addition,a GNN prediction model-enabled motion planner is developed based on the model predictive control technique.Furthermore,two driving scenarios are extracted from the INTERACTION dataset to validate and evaluate the effectiveness of the proposed motion planning approach,i.e.,merging and roundabout scenarios.The results demonstrate that the proposed method can lower the risk and improve driving safety compared with the baseline method.

Postpartum Family Planning at the Timbuktu Hospital in Mali

Introduction: Postpartum family planning is the prevention of pregnancies during the 12 months following childbirth. Few studies have been devoted to postpartum family planning in Mali. Our work will contribute to reducing unmet need for family planning. Objective: To study the use of contraceptive methods in the postpartum period in the obstetrics and gynecology unit of Timbuktu hospital. Materials and Methods: This was a descriptive and analytical cross-sectional study with prospective collection of data from January 1, 2022 to December 31, 2023. All women who gave birth having chosen and benefited from a contraceptive method were included. The statistical test used was the Fisher test with a significance threshold fixed at 5%. Results: The frequency of contraception in the postpartum period was 17.03%. The average age of clients was 26.14% with extremes of 14 and 45 years. They were paupiparous at 56.4% with an inter-birth interval of less than 12 months at 12.3%. More than half of the counseling (58.5%) was done during postnatal visits. The methods chosen were implants at 48.1%, injectable progestins at 21.3%, intrauterine device at 14.7%, miro-progestin pills at 13.5%, tubal ligation at 1 .4% and condoms at 1%. The regular follow-up rate was 51.1% of cases and 25.6% had no follow-up. Conclusion: The overall rate of postpartum family planning of 17.08% remains low. Improving FP staff skills will reduce unmet needs and contribute to increasing contraceptive prevalence in Timbuktu.

A Planning Method for Operational Test of UAV Swarm Based on Mission Reliability

The unmanned aerial vehicle(UAV)swarm plays an increasingly important role in the modern battlefield,and the UAV swarm operational test is a vital means to validate the combat effectiveness of the UAV swarm.Due to the high cost and long duration of operational tests,it is essential to plan the test in advance.To solve the problem of planning UAV swarm operational test,this study considers the multi-stage feature of a UAV swarm mission,composed of launch,flight and combat stages,and proposes a method to find test plans that can maximize mission reliability.Therefore,a multi-stage mission reliability model for a UAV swarm is proposed to ensure successful implementation of the mission.A multi-objective integer optimization method that considers both mission reliability and cost is then formulated to obtain the optimal test plans.This study first constructs a mission reliability model for the UAV swarm in the combat stage.Then,the launch stage and flight stage are integrated to develop a complete PMS(Phased Mission Systems)reliability model.Finally,the Binary Decision Diagrams(BDD)and Multi Objective Quantum Particle Swarm Optimization(MOQPSO)methods are proposed to solve the model.The optimal plans considering both reliability and cost are obtained.The proposed model supports the planning of UAV swarm operational tests and represents a meaningful exploration of UAV swarm test planning.

Ground threat prediction-based path planning of unmanned autonomous helicopter using hybrid enhanced artificial bee colony algorithm

Unmanned autonomous helicopter(UAH)path planning problem is an important component of the UAH mission planning system.Aiming to reduce the influence of non-complete ground threat information on UAH path planning,a ground threat prediction-based path planning method is proposed based on artificial bee colony(ABC)algorithm by collaborative thinking strategy.Firstly,a dynamic threat distribution probability model is developed based on the characteristics of typical ground threats.The dynamic no-fly zone of the UAH is simulated and established by calculating the distribution probability of ground threats in real time.Then,a dynamic path planning method for UAH is designed in complex environment based on the real-time prediction of ground threats.By adding the collision warning mechanism to the path planning model,the flight path could be dynamically adjusted according to changing no-fly zones.Furthermore,a hybrid enhanced ABC algorithm is proposed based on collaborative thinking strategy.The proposed algorithm applies the leader-member thinking mechanism to guide the direction of population evolution,and reduces the negative impact of local optimal solutions caused by collaborative learning update strategy,which makes the optimization performance of ABC algorithm more controllable and efficient.Finally,simulation results verify the feasibility and effectiveness of the proposed ground threat prediction path planning method.

Trajectory planning for multi-robot coordinated towing system based on stability

Given the unconstrained characteristics of the multi-robot coordinated towing system,the rope can only provide a unidirectional constraint force to the suspended object,which leads to the weak ability of the system to resist external disturbances and makes it difficult to control the trajectory of the suspended object.Based on the kinematics and statics of the multi-robot coordinated towing system with fixed base,the dynamic model of the system is established by using the Newton-Euler equations and the Udwadia-Kalaba equations.To plan the trajectories with high stability and strong control,trajectory planning is performed by combining the dynamics and stability of the towing system.Based on the dynamic stability of the motion trajectory of the suspended object,the stability of the suspended object is effectively improved through online real-time planning and offline manual adjustment.The effectiveness of the proposed method is verified by comparing the motion stability of the suspended object before and after planning.The results provide a foundation for the motion planning and coordinated control of the towing system.

Safe Motion Planning and Control Framework for Automated Vehicles with Zonotopic TRMPC

Model mismatches can cause multi-dimensional uncertainties for the receding horizon control strategies of automated vehicles(AVs).The uncertainties may lead to potentially hazardous behaviors when the AV tracks ideal trajectories that are individually optimized by the AV's planning layer.To address this issue,this study proposes a safe motion planning and control(SMPAC)framework for AVs.For the control layer,a dynamic model including multi-dimensional uncertainties is established.A zonotopic tube-based robust model predictive control scheme is proposed to constrain the uncertain system in a bounded minimum robust positive invariant set.A flexible tube with varying cross-sections is constructed to reduce the controller conservatism.For the planning layer,a concept of safety sets,representing the geometric boundaries of the ego vehicle and obstacles under uncertainties,is proposed.The safety sets provide the basis for the subsequent evaluation and ranking of the generated trajectories.An efficient collision avoidance algorithm decides the desired trajectory through the intersection detection of the safety sets between the ego vehicle and obstacles.A numerical simulation and hardware-in-the-loop experiment validate the effectiveness and real-time performance of the SMPAC.The result of two driving scenarios indicates that the SMPAC can guarantee the safety of automated driving under multi-dimensional uncertainties.

General Optimal Trajectory Planning:Enabling Autonomous Vehicles with the Principle of Least Action

This study presents a general optimal trajectory planning(GOTP)framework for autonomous vehicles(AVs)that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently.Firstly,we employ the fifth-order Bezier curve to generate and smooth the reference path along the road centerline.Cartesian coordinates are then transformed to achieve the curvature continuity of the generated curve.Considering the road constraints and vehicle dynamics,limited polynomial candidate trajectories are generated and smoothed in a curvilinear coordinate system.Furthermore,in selecting the optimal trajectory,we develop a unified and auto-tune objective function based on the principle of least action by employing AVs to simulate drivers’behavior and summarizing their manipulation characteristics of“seeking benefits and avoiding losses.”Finally,by integrating the idea of receding-horizon optimization,the proposed framework is achieved by considering dynamic multi-performance objectives and selecting trajectories that satisfy feasibility,optimality,and adaptability.Extensive simulations and experiments are performed,and the results demonstrate the framework’s feasibility and effectiveness,which avoids both dynamic and static obstacles and applies to various scenarios with multi-source interactive traffic participants.Moreover,we prove that the proposed method can guarantee real-time planning and safety requirements compared to drivers’manipulation.

A digital twins enabled underwater intelligent internet vehicle path planning system via reinforcement learning and edge computing

The Autonomous Underwater Glider(AUG)is a kind of prevailing underwater intelligent internet vehicle and occupies a dominant position in industrial applications,in which path planning is an essential problem.Due to the complexity and variability of the ocean,accurate environment modeling and flexible path planning algorithms are pivotal challenges.The traditional models mainly utilize mathematical functions,which are not complete and reliable.Most existing path planning algorithms depend on the environment and lack flexibility.To overcome these challenges,we propose a path planning system for underwater intelligent internet vehicles.It applies digital twins and sensor data to map the real ocean environment to a virtual digital space,which provides a comprehensive and reliable environment for path simulation.We design a value-based reinforcement learning path planning algorithm and explore the optimal network structure parameters.The path simulation is controlled by a closed-loop model integrated into the terminal vehicle through edge computing.The integration of state input enriches the learning of neural networks and helps to improve generalization and flexibility.The task-related reward function promotes the rapid convergence of the training.The experimental results prove that our reinforcement learning based path planning algorithm has great flexibility and can effectively adapt to a variety of different ocean conditions.

Asia-Pacific Security Situation and Strategic Response Under Great Changes

Our world today is going through accelerated transformation unseen in a century.The new round of scientific and technological revolution and industrial transformation is gaining steam,the international balance of power is undergoing profound adjustment,and China’s development is facing new strategic opportunities.

Research on Evacuation Path Planning Based on Improved Sparrow Search Algorithm

Reducing casualties and property losses through effective evacuation route planning has been a key focus for researchers in recent years.As part of this effort,an enhanced sparrow search algorithm(MSSA)was proposed.Firstly,the Golden Sine algorithm and a nonlinear weight factor optimization strategy were added in the discoverer position update stage of the SSA algorithm.Secondly,the Cauchy-Gaussian perturbation was applied to the optimal position of the SSA algorithm to improve its ability to jump out of local optima.Finally,the local search mechanism based on the mountain climbing method was incorporated into the local search stage of the SSA algorithm,improving its local search ability.To evaluate the effectiveness of the proposed algorithm,the Whale Algorithm,Gray Wolf Algorithm,Improved Gray Wolf Algorithm,Sparrow Search Algorithm,and MSSA Algorithm were employed to solve various test functions.The accuracy and convergence speed of each algorithm were then compared and analyzed.The results indicate that the MSSA algorithm has superior solving ability and stability compared to other algorithms.To further validate the enhanced algorithm’s capabilities for path planning,evacuation experiments were conducted using different maps featuring various obstacle types.Additionally,a multi-exit evacuation scenario was constructed according to the actual building environment of a teaching building.Both the sparrow search algorithm and MSSA algorithm were employed in the simulation experiment for multiexit evacuation path planning.The findings demonstrate that the MSSA algorithm outperforms the comparison algorithm,showcasing its greater advantages and higher application potential.

An Improved Iterated Greedy Algorithm for Solving Rescue Robot Path Planning Problem with Limited Survival Time

Effective path planning is crucial for mobile robots to quickly reach rescue destination and complete rescue tasks in a post-disaster scenario.In this study,we investigated the post-disaster rescue path planning problem and modeled this problem as a variant of the travel salesman problem(TSP)with life-strength constraints.To address this problem,we proposed an improved iterated greedy(IIG)algorithm.First,a push-forward insertion heuristic(PFIH)strategy was employed to generate a high-quality initial solution.Second,a greedy-based insertion strategy was designed and used in the destruction-construction stage to increase the algorithm’s exploration ability.Furthermore,three problem-specific swap operators were developed to improve the algorithm’s exploitation ability.Additionally,an improved simulated annealing(SA)strategy was used as an acceptance criterion to effectively prevent the algorithm from falling into local optima.To verify the effectiveness of the proposed algorithm,the Solomon dataset was extended to generate 27 instances for simulation.Finally,the proposed IIG was compared with five state-of-the-art algorithms.The parameter analysiswas conducted using the design of experiments(DOE)Taguchi method,and the effectiveness analysis of each component has been verified one by one.Simulation results indicate that IIGoutperforms the compared algorithms in terms of the number of rescue survivors and convergence speed,proving the effectiveness of the proposed algorithm.

Efficient Penetration Testing Path Planning Based on Reinforcement Learning with Episodic Memory

Intelligent penetration testing is of great significance for the improvement of the security of information systems,and the critical issue is the planning of penetration test paths.In view of the difficulty for attackers to obtain complete network information in realistic network scenarios,Reinforcement Learning(RL)is a promising solution to discover the optimal penetration path under incomplete information about the target network.Existing RL-based methods are challenged by the sizeable discrete action space,which leads to difficulties in the convergence.Moreover,most methods still rely on experts’knowledge.To address these issues,this paper proposes a penetration path planning method based on reinforcement learning with episodic memory.First,the penetration testing problem is formally described in terms of reinforcement learning.To speed up the training process without specific prior knowledge,the proposed algorithm introduces episodic memory to store experienced advantageous strategies for the first time.Furthermore,the method offers an exploration strategy based on episodic memory to guide the agents in learning.The design makes full use of historical experience to achieve the purpose of reducing blind exploration and improving planning efficiency.Ultimately,comparison experiments are carried out with the existing RL-based methods.The results reveal that the proposed method has better convergence performance.The running time is reduced by more than 20%.

Function Evolution and Landscape Planning Strategy of Inland Rivers in Beilun Port City of Ningbo

In the history, the main roles of inland rivers in Beilun Port City of Ningbo were desalination,blocking tides, shipping, and flood control. Nowadays, with the continuous spread and deepening ofurbanization, the ecological environment of river courses has been destroyed. In the past, remediationmeasures based on engineering and technology played a certain role, but can not “cure the root cause”. Itshould respect the historical evolution process of river courses, and highlight the ecological service functionand leisure tourism value of river courses from the coordination perspective of urban and rural ecologicalenvironment, economic industries, society and culture in the planning ideas of ecology, production, andlife integration. Four aspects of the measures are as below: protecting and repairing the ecological matrixof river courses;building green space system and maintaining flood control functions through the waternetwork;protecting cultural heritage along the rivers;developing waterfront leisure tourism scenic area.

Rolling Decision Model of Thermal Power Retrofit and Generation Expansion Planning Considering Carbon Emissions and Power Balance Risk

With the increasing urgency of the carbon emission reduction task,the generation expansion planning process needs to add carbon emission risk constraints,in addition to considering the level of power adequacy.However,methods for quantifying and assessing carbon emissions and operational risks are lacking.It results in excessive carbon emissions and frequent load-shedding on some days,although meeting annual carbon emission reduction targets.First,in response to the above problems,carbon emission and power balance risk assessment indicators and assessment methods,were proposed to quantify electricity abundance and carbon emission risk level of power planning scenarios,considering power supply regulation and renewable energy fluctuation characteristics.Secondly,building on traditional two-tier models for low-carbon power planning,including investment decisions and operational simulations,considering carbon emissions and power balance risks in lower-tier operational simulations,a two-tier rolling model for thermal power retrofit and generation expansion planning was established.The model includes an investment tier and operation assessment tier and makes year-by-year decisions on the number of thermal power units to be retrofitted and the type and capacity of units to be commissioned.Finally,the rationality and validity of the model were verified through an example analysis,a small-scale power supply system in a certain region is taken as an example.The model can significantly reduce the number of days of carbon emissions risk and ensure that the power balance risk is within the safe limit.

Improving path planning efficiency for underwater gravity-aided navigation based on a new depth sorting fast search algorithm

This study focuses on the improvement of path planning efficiency for underwater gravity-aided navigation.Firstly,a Depth Sorting Fast Search(DSFS)algorithm was proposed to improve the planning speed of the Quick Rapidly-exploring Random Trees*(Q-RRT*)algorithm.A cost inequality relationship between an ancestor and its descendants was derived,and the ancestors were filtered accordingly.Secondly,the underwater gravity-aided navigation path planning system was designed based on the DSFS algorithm,taking into account the fitness,safety,and asymptotic optimality of the routes,according to the gravity suitability distribution of the navigation space.Finally,experimental comparisons of the computing performance of the ChooseParent procedure,the Rewire procedure,and the combination of the two procedures for Q-RRT*and DSFS were conducted under the same planning environment and parameter conditions,respectively.The results showed that the computational efficiency of the DSFS algorithm was improved by about 1.2 times compared with the Q-RRT*algorithm while ensuring correct computational results.

Landscape Architecture Planning and Design Based on Landscape Ecology Theory:A Case Study of Waterfront Landscape Planning and Design of Dapo Town

With the rapid development of urbanization,landscape architecture has become an indispensable component of daily life.In order to achieve better landscape effects and protect the ecological environment,landscape ecology theory can be integrated into landscape planning to carry out disciplinary crossing and integration research between landscape ecology and landscape architecture.In this study,based on the basic theories of landscape ecology,the waterfront landscape of Dapo Town was designed,with the aim to achieve ecological balance in planning,showcase biodiversity,and create a harmonious landscape ecological environment which can benefit both nature and people.This design combined artificial and natural elements while improving the natural environment,which promoted a harmonious relationship between humans and nature,thus enriching the spatial organization of the city,and playing a role in regulating the urban environment and climate.

Atmospheric Pollutants in a Commercial Region of Fortaleza, Ceará, Brazil: Integration of Health, Environment and Economy in Urban Planning to Improve Air Quality

The accelerated growth of the vehicular fleet, the modernization of large urban centers, and the few adjustments to the road network in Fortaleza have intensified the problems of traffic and emissions of atmospheric pollutants, highlighting the necessity for strategic urban planning initiatives to address the escalating issues of traffic and pollution. With the objective of analyzing the indices of concentrations of atmospheric pollutants and estimating how these levels can affect human health, this work consists of a study of the analysis of air quality in the intense trade region of Fortaleza. For this, the analysis zone was divided into three perimeters (Major - Medium - Minor), where each perimeter was analyzed at 7 am, 12 noon and 5 pm. Concentrations of the type of O3, particulate matter (PM2.5 and PM10), CO2 and HCHO were collected. Our results demonstrate that most of the analyses are within the limits of current legislation;however, at certain times and perimeters, the analyses of CO2 and HCHO exceeded the established limits. In view of the above, we conclude that public policies to control air quality are necessary to reduce the damage to human health and the environment caused by pollutants.