Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

Motion Planning for Autonomous Driving with Real Traffic Data Validation

Accurate trajectory prediction of surrounding road users is the fundamental input for motion planning,which enables safe autonomous driving on public roads.In this paper,a safe motion planning approach is proposed based on the deep learning-based trajectory prediction method.To begin with,a trajectory prediction model is established based on the graph neural network(GNN)that is trained utilizing the INTERACTION dataset.Then,the validated trajectory prediction model is used to predict the future trajectories of surrounding road users,including pedestrians and vehicles.In addition,a GNN prediction model-enabled motion planner is developed based on the model predictive control technique.Furthermore,two driving scenarios are extracted from the INTERACTION dataset to validate and evaluate the effectiveness of the proposed motion planning approach,i.e.,merging and roundabout scenarios.The results demonstrate that the proposed method can lower the risk and improve driving safety compared with the baseline method.

Selection of media tools for community planning:A study from the perspective of communicative planning

In community planning,due to the lack of evidence regarding the selection of media tools,this study examines how a common but differentiated ideal speech situation can be created as well as how more appropriate media tools can be defined and selected in the community planning process.First,this study describes the concept and theoretical basis of media used in community planning from the perspectives of the multiple effects of media evolution on communicative planning.Second,the classification criteria and typical characteristics of media tools used to support community planning are clarified from three dimensions:acceptability,cost effectiveness,and applicability.Third,strategies for applying media tools in the four phases of communicative planning-namely,state analysis,problem identification,contradictory solution and optimization-are described.Finally,trends in the development of media tools for community planning are explored in terms of multistakeholder engagement,supporting scientific decision-making and multiple-type media integration.The results provide a reference for developing more inclusive,effective,and appropriate media tools for enhancing decision-making capacity and modernizing governance in community planning and policy-making processes.

Optimal search path planning of UUV in battlefeld ambush scene

Aiming at the practical application of Unmanned Underwater Vehicle(UUV)in underwater combat,this paper proposes a battlefield ambush scene with UUV considering ocean current.Firstly,by establishing these mathematical models of ocean current environment,target movement,and sonar detection,the probability calculation methods of single UUV searching target and multiple UUV cooperatively searching target are given respectively.Then,based on the Hybrid Quantum-behaved Particle Swarm Optimization(HQPSO)algorithm,the path with the highest target search probability is found.Finally,through simulation calculations,the influence of different UUV parameters and target parameters on the target search probability is analyzed,and the minimum number of UUVs that need to be deployed to complete the ambush task is demonstrated,and the optimal search path scheme is obtained.The method proposed in this paper provides a theoretical basis for the practical application of UUV in the future combat.

Evaluation of frictional pressure drop correlations for air-water and air-oil two-phase flow in pipeline-riser system

Accurate prediction of the frictional pressure drop is important for the design and operation of subsea oil and gas transporting system considering the length of the pipeline. The applicability of the correlations to pipeline-riser flow needs evaluation since the flow condition in pipeline-riser is quite different from the original data where they were derived from. In the present study, a comprehensive evaluation of 24prevailing correlation in predicting frictional pressure drop is carried out based on experimentally measured data of air-water and air-oil two-phase flows in pipeline-riser. Experiments are performed in a system having different configuration of pipeline-riser with the inclination of the downcomer varied from-2°to-5°to investigated the effect of the elbow on the frictional pressure drop in the riser. The inlet gas velocity ranges from 0.03 to 6.2 m/s, and liquid velocity varies from 0.02 to 1.3 m/s. A total of885 experimental data points including 782 on air-water flows and 103 on air-oil flows are obtained and used to access the prediction ability of the correlations. Comparison of the predicted results with the measured data indicate that a majority of the investigated correlations under-predict the pressure drop on severe slugging. The result of this study highlights the requirement of new method considering the effect of pipe layout on the frictional pressure drop.

Efficient Route Planning for Real-Time Demand-Responsive Transit

Demand Responsive Transit (DRT) responds to the dynamic users’ requests without any fixed routes and timetablesand determines the stop and the start according to the demands. This study explores the optimization of dynamicvehicle scheduling and real-time route planning in urban public transportation systems, with a focus on busservices. It addresses the limitations of current shared mobility routing algorithms, which are primarily designedfor simpler, single origin/destination scenarios, and do not meet the complex demands of bus transit systems. Theresearch introduces an route planning algorithm designed to dynamically accommodate passenger travel needsand enable real-time route modifications. Unlike traditional methods, this algorithm leverages a queue-based,multi-objective heuristic A∗ approach, offering a solution to the inflexibility and limited coverage of suburbanbus routes. Also, this study conducts a comparative analysis of the proposed algorithm with solutions based onGenetic Algorithm (GA) and Ant Colony Optimization Algorithm (ACO), focusing on calculation time, routelength, passenger waiting time, boarding time, and detour rate. The findings demonstrate that the proposedalgorithmsignificantly enhances route planning speed, achieving an 80–100-fold increase in efficiency over existingmodels, thereby supporting the real-time demands of Demand-Responsive Transportation (DRT) systems. Thestudy concludes that this algorithm not only optimizes route planning in bus transit but also presents a scalablesolution for improving urban mobility.

Pressure transient characteristics of non-uniform conductivity fractured wells in viscoelasticity polymer flooding based on oil-water two-phase flow

Polymer flooding in fractured wells has been extensively applied in oilfields to enhance oil recovery.In contrast to water,polymer solution exhibits non-Newtonian and nonlinear behavior such as effects of shear thinning and shear thickening,polymer convection,diffusion,adsorption retention,inaccessible pore volume and reduced effective permeability.Meanwhile,the flux density and fracture conductivity along the hydraulic fracture are generally non-uniform due to the effects of pressure distribution,formation damage,and proppant breakage.In this paper,we present an oil-water two-phase flow model that captures these complex non-Newtonian and nonlinear behavior,and non-uniform fracture characteristics in fractured polymer flooding.The hydraulic fracture is firstly divided into two parts:high-conductivity fracture near the wellbore and low-conductivity fracture in the far-wellbore section.A hybrid grid system,including perpendicular bisection(PEBI)and Cartesian grid,is applied to discrete the partial differential flow equations,and the local grid refinement method is applied in the near-wellbore region to accurately calculate the pressure distribution and shear rate of polymer solution.The combination of polymer behavior characterizations and numerical flow simulations are applied,resulting in the calculation for the distribution of water saturation,polymer concentration and reservoir pressure.Compared with the polymer flooding well with uniform fracture conductivity,this non-uniform fracture conductivity model exhibits the larger pressure difference,and the shorter bilinear flow period due to the decrease of fracture flow ability in the far-wellbore section.The field case of the fall-off test demonstrates that the proposed method characterizes fracture characteristics more accurately,and yields fracture half-lengths that better match engineering reality,enabling a quantitative segmented characterization of the near-wellbore section with high fracture conductivity and the far-wellbore section with low fracture conductivity.The novelty of this paper is the analysis of pressure performances caused by the fracture dynamics and polymer rheology,as well as an analysis method that derives formation and fracture parameters based on the pressure and its derivative curves.

Integrated numerical simulation of hydraulic fracturing and production in shale gas well considering gas-water two-phase flow

Based on the displacement discontinuity method and the discrete fracture unified pipe network model,a sequential iterative numerical method was used to build a fracturing-production integrated numerical model of shale gas well considering the two-phase flow of gas and water.The model accounts for the influence of natural fractures and matrix properties on the fracturing process and directly applies post-fracturing formation pressure and water saturation distribution to subsequent well shut-in and production simulation,allowing for a more accurate fracturing-production integrated simulation.The results show that the reservoir physical properties have great impacts on fracture propagation,and the reasonable prediction of formation pressure and reservoir fluid distribution after the fracturing is critical to accurately predict the gas and fluid production of the shale gas wells.Compared with the conventional method,the proposed model can more accurately simulate the water and gas production by considering the impact of fracturing on both matrix pressure and water saturation.The established model is applied to the integrated fracturing-production simulation of practical horizontal shale gas wells.The simulation results are in good agreement with the practical production data,thus verifying the accuracy of the model.

Exploration of Detailed Planning Practice of Chemical Industrial Parks under the Background of Territorial Space Planning

With the gradual completion of the overall planning of city and county land space,the detailed planning will be prepared according to the requirements of transmitting and refining the upper planning.Industrial parks are one of the“main forces”of local economic development,and the preparation of their detailed planning will escort their development.The key points of theControlIndicatorsofConstruction LandinIndustrialProjectsissued in 2008 and 2023 were compared,and the new requirements for detailed planning under the background of territorial space and the contradictions between the detailed planning of industrial parks and the overall planning of the upper territorial space were sorted out based on the summary of the existing problems in the development of chemical parks.It provides some ideas for the practice of detailed planning of chemical industrial parks under the background of territorial space.

Postpartum Family Planning at the Timbuktu Hospital in Mali

Introduction: Postpartum family planning is the prevention of pregnancies during the 12 months following childbirth. Few studies have been devoted to postpartum family planning in Mali. Our work will contribute to reducing unmet need for family planning. Objective: To study the use of contraceptive methods in the postpartum period in the obstetrics and gynecology unit of Timbuktu hospital. Materials and Methods: This was a descriptive and analytical cross-sectional study with prospective collection of data from January 1, 2022 to December 31, 2023. All women who gave birth having chosen and benefited from a contraceptive method were included. The statistical test used was the Fisher test with a significance threshold fixed at 5%. Results: The frequency of contraception in the postpartum period was 17.03%. The average age of clients was 26.14% with extremes of 14 and 45 years. They were paupiparous at 56.4% with an inter-birth interval of less than 12 months at 12.3%. More than half of the counseling (58.5%) was done during postnatal visits. The methods chosen were implants at 48.1%, injectable progestins at 21.3%, intrauterine device at 14.7%, miro-progestin pills at 13.5%, tubal ligation at 1 .4% and condoms at 1%. The regular follow-up rate was 51.1% of cases and 25.6% had no follow-up. Conclusion: The overall rate of postpartum family planning of 17.08% remains low. Improving FP staff skills will reduce unmet needs and contribute to increasing contraceptive prevalence in Timbuktu.

Stochastic programming based coordinated expansion planning of generation,transmission,demand side resources,and energy storage considering the DC transmission system

With the increasing penetration of wind and solar energies,the accompanying uncertainty that propagates in the system places higher requirements on the expansion planning of power systems.A source-grid-load-storage coordinated expansion planning model based on stochastic programming was proposed to suppress the impact of wind and solar energy fluctuations.Multiple types of system components,including demand response service entities,converter stations,DC transmission systems,cascade hydropower stations,and other traditional components,have been extensively modeled.Moreover,energy storage systems are considered to improve the accommodation level of renewable energy and alleviate the influence of intermittence.Demand-response service entities from the load side are used to reduce and move the demand during peak load periods.The uncertainties in wind,solar energy,and loads were simulated using stochastic programming.Finally,the effectiveness of the proposed model is verified through numerical simulations.

Correlates of Mistimed Pregnancy and Unmet Need for Family Planning among Women of Reproductive Age in Sandema, Ghana

Background: Globally, an estimated 80 million unintended pregnancies comprising both mistimed and unwanted pregnancies are recorded yearly. Yet only half of the women at risk of mistimed pregnancy use contraceptives. In developing countries, over 100 million females have unmet need, and national surveys in Ghana indicate 23% unmet need rate. Methods: Using a cross-sectional community-based approach, a sample size of 300 women of reproductive age were selected using multi-step cluster sampling techniques. The study was quantitative, using structured interviewer-administered questionnaires. Results: Two-third (66%) of the women in reproductive age still had unmet need, 71% were currently pregnant, and more than a third (36%) confirmed ever having a mistimed pregnancy. Fifty-three percent (53%) of the women confirmed never communicating with their partners on family planning issues, a little below half (45%) took their own health care decisions. Seventy nine percent (79%) ever received family planning services from a health professional. Factors related to unmet needs included mistimed pregnancy, level of education, preferred birth/pregnancy interval, communication between partners and the autonomy to spend self-earnings. Conclusion: Considering that high rates of unmet need results in mistimed pregnancy, improved policies around the influence of unmet need on mistimed pregnancies are needed.

A Reverse Path Planning Approach for Enhanced Performance of Multi-Degree-of-Freedom Industrial Manipulators

In the domain of autonomous industrial manipulators,precise positioning and appropriate posture selection in path planning are pivotal for tasks involving obstacle avoidance,such as handling,heat sealing,and stacking.While Multi-Degree-of-Freedom(MDOF)manipulators offer kinematic redundancy,aiding in the derivation of optimal inverse kinematic solutions to meet position and posture requisites,their path planning entails intricate multiobjective optimization,encompassing path,posture,and joint motion optimization.Achieving satisfactory results in practical scenarios remains challenging.In response,this study introduces a novel Reverse Path Planning(RPP)methodology tailored for industrial manipulators.The approach commences by conceptualizing the manipulator’s end-effector as an agent within a reinforcement learning(RL)framework,wherein the state space,action set,and reward function are precisely defined to expedite the search for an initial collision-free path.To enhance convergence speed,the Q-learning algorithm in RL is augmented with Dyna-Q.Additionally,we formulate the cylindrical bounding box of the manipulator based on its Denavit-Hartenberg(DH)parameters and propose a swift collision detection technique.Furthermore,the motion performance of the end-effector is refined through a bidirectional search,and joint weighting coefficients are introduced to mitigate motion in high-power joints.The efficacy of the proposed RPP methodology is rigorously examined through extensive simulations conducted on a six-degree-of-freedom(6-DOF)manipulator encountering two distinct obstacle configurations and target positions.Experimental results substantiate that the RPP method adeptly orchestrates the computation of the shortest collision-free path while adhering to specific posture constraints at the target point.Moreover,itminimizes both posture angle deviations and joint motion,showcasing its prowess in enhancing the operational performance of MDOF industrial manipulators.

A Planning Method for Operational Test of UAV Swarm Based on Mission Reliability

The unmanned aerial vehicle(UAV)swarm plays an increasingly important role in the modern battlefield,and the UAV swarm operational test is a vital means to validate the combat effectiveness of the UAV swarm.Due to the high cost and long duration of operational tests,it is essential to plan the test in advance.To solve the problem of planning UAV swarm operational test,this study considers the multi-stage feature of a UAV swarm mission,composed of launch,flight and combat stages,and proposes a method to find test plans that can maximize mission reliability.Therefore,a multi-stage mission reliability model for a UAV swarm is proposed to ensure successful implementation of the mission.A multi-objective integer optimization method that considers both mission reliability and cost is then formulated to obtain the optimal test plans.This study first constructs a mission reliability model for the UAV swarm in the combat stage.Then,the launch stage and flight stage are integrated to develop a complete PMS(Phased Mission Systems)reliability model.Finally,the Binary Decision Diagrams(BDD)and Multi Objective Quantum Particle Swarm Optimization(MOQPSO)methods are proposed to solve the model.The optimal plans considering both reliability and cost are obtained.The proposed model supports the planning of UAV swarm operational tests and represents a meaningful exploration of UAV swarm test planning.

Heuristic Expanding Disconnected Graph:A Rapid Path Planning Method for Mobile Robots

Existing mobile robots mostly use graph search algorithms for path planning,which suffer from relatively low planning efficiency owing to high redundancy and large computational complexity.Due to the limitations of the neighborhood search strategy,the robots could hardly obtain the most optimal global path.A global path planning algorithm,denoted as EDG*,is proposed by expanding nodes using a well-designed expanding disconnected graph operator(EDG)in this paper.Firstly,all obstacles are marked and their corners are located through the map pre-processing.Then,the EDG operator is designed to find points in non-obstruction areas to complete the rapid expansion of disconnected nodes.Finally,the EDG*heuristic iterative algorithm is proposed.It selects the candidate node through a specific valuation function and realizes the node expansion while avoiding collision with a minimum offset.Path planning experiments were conducted in a typical indoor environment and on the public dataset CSM.The result shows that the proposed EDG*reduced the planning time by more than 90%and total length of paths reduced by more than 4.6%.Compared to A*,Dijkstra and JPS,EDG*does not show an exponential explosion effect in map size.The EDG*showed better performance in terms of path smoothness,and collision avoidance.This shows that the EDG*algorithm proposed in this paper can improve the efficiency of path planning and enhance path quality.

Trajectory planning for multi-robot coordinated towing system based on stability

Given the unconstrained characteristics of the multi-robot coordinated towing system,the rope can only provide a unidirectional constraint force to the suspended object,which leads to the weak ability of the system to resist external disturbances and makes it difficult to control the trajectory of the suspended object.Based on the kinematics and statics of the multi-robot coordinated towing system with fixed base,the dynamic model of the system is established by using the Newton-Euler equations and the Udwadia-Kalaba equations.To plan the trajectories with high stability and strong control,trajectory planning is performed by combining the dynamics and stability of the towing system.Based on the dynamic stability of the motion trajectory of the suspended object,the stability of the suspended object is effectively improved through online real-time planning and offline manual adjustment.The effectiveness of the proposed method is verified by comparing the motion stability of the suspended object before and after planning.The results provide a foundation for the motion planning and coordinated control of the towing system.

Ground threat prediction-based path planning of unmanned autonomous helicopter using hybrid enhanced artificial bee colony algorithm

Unmanned autonomous helicopter(UAH)path planning problem is an important component of the UAH mission planning system.Aiming to reduce the influence of non-complete ground threat information on UAH path planning,a ground threat prediction-based path planning method is proposed based on artificial bee colony(ABC)algorithm by collaborative thinking strategy.Firstly,a dynamic threat distribution probability model is developed based on the characteristics of typical ground threats.The dynamic no-fly zone of the UAH is simulated and established by calculating the distribution probability of ground threats in real time.Then,a dynamic path planning method for UAH is designed in complex environment based on the real-time prediction of ground threats.By adding the collision warning mechanism to the path planning model,the flight path could be dynamically adjusted according to changing no-fly zones.Furthermore,a hybrid enhanced ABC algorithm is proposed based on collaborative thinking strategy.The proposed algorithm applies the leader-member thinking mechanism to guide the direction of population evolution,and reduces the negative impact of local optimal solutions caused by collaborative learning update strategy,which makes the optimization performance of ABC algorithm more controllable and efficient.Finally,simulation results verify the feasibility and effectiveness of the proposed ground threat prediction path planning method.

Simulation of Two-Phase Flowback Phenomena in Shale Gas Wells

The gas-water two-phaseflow occurring as a result of fracturingfluidflowback phenomena is known to impact significantly the productivity of shale gas well.In this work,this two-phaseflow has been simulated in the framework of a hybrid approach partially relying on the embedded discrete fracture model(EDFM).This model assumes the region outside the stimulated reservoir volume(SRV)as a single-medium while the SRV region itself is described using a double-medium strategy which can account for thefluid exchange between the matrix and the micro-fractures.The shale gas adsorption,desorption,diffusion,gas slippage effect,fracture stress sensitivity,and capillary imbibition have been considered.The shale gas production,pore pressure distribution and water saturation distribution in the reservoir have been simulated.The influences of hydraulic fracture geometry and nonorthogonal hydraulic fractures on gas production have been determined and discussed accordingly.The simulation results show that the daily gas production has an upward and downward trend due to the presence of a large amount of fracturingfluid in the reservoir around the hydraulic fracture.The smaller the angle between the hydraulic fracture and the wellbore,the faster the daily production of shale gas wells decreases,and the lower the cumulative production.Nonplanar fractures can increase the control volume of hydraulic fractures and improve the production of shale gas wells.

Safe Motion Planning and Control Framework for Automated Vehicles with Zonotopic TRMPC

Model mismatches can cause multi-dimensional uncertainties for the receding horizon control strategies of automated vehicles(AVs).The uncertainties may lead to potentially hazardous behaviors when the AV tracks ideal trajectories that are individually optimized by the AV's planning layer.To address this issue,this study proposes a safe motion planning and control(SMPAC)framework for AVs.For the control layer,a dynamic model including multi-dimensional uncertainties is established.A zonotopic tube-based robust model predictive control scheme is proposed to constrain the uncertain system in a bounded minimum robust positive invariant set.A flexible tube with varying cross-sections is constructed to reduce the controller conservatism.For the planning layer,a concept of safety sets,representing the geometric boundaries of the ego vehicle and obstacles under uncertainties,is proposed.The safety sets provide the basis for the subsequent evaluation and ranking of the generated trajectories.An efficient collision avoidance algorithm decides the desired trajectory through the intersection detection of the safety sets between the ego vehicle and obstacles.A numerical simulation and hardware-in-the-loop experiment validate the effectiveness and real-time performance of the SMPAC.The result of two driving scenarios indicates that the SMPAC can guarantee the safety of automated driving under multi-dimensional uncertainties.

General Optimal Trajectory Planning:Enabling Autonomous Vehicles with the Principle of Least Action

This study presents a general optimal trajectory planning(GOTP)framework for autonomous vehicles(AVs)that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently.Firstly,we employ the fifth-order Bezier curve to generate and smooth the reference path along the road centerline.Cartesian coordinates are then transformed to achieve the curvature continuity of the generated curve.Considering the road constraints and vehicle dynamics,limited polynomial candidate trajectories are generated and smoothed in a curvilinear coordinate system.Furthermore,in selecting the optimal trajectory,we develop a unified and auto-tune objective function based on the principle of least action by employing AVs to simulate drivers’behavior and summarizing their manipulation characteristics of“seeking benefits and avoiding losses.”Finally,by integrating the idea of receding-horizon optimization,the proposed framework is achieved by considering dynamic multi-performance objectives and selecting trajectories that satisfy feasibility,optimality,and adaptability.Extensive simulations and experiments are performed,and the results demonstrate the framework’s feasibility and effectiveness,which avoids both dynamic and static obstacles and applies to various scenarios with multi-source interactive traffic participants.Moreover,we prove that the proposed method can guarantee real-time planning and safety requirements compared to drivers’manipulation.