Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

Oxygen‑Coordinated Single Mn Sites for Efficient Electrocatalytic Nitrate Reduction to Ammonia

Electrocatalytic nitrate reduction reaction has attracted increasing attention due to its goal of low carbon emission and environmental protection.Here,we report an efficient NitRR catalyst composed of single Mn sites with atomically dispersed oxygen(O)coordination on bacterial cellulose-converted graphitic carbon(Mn-O-C).Evidence of the atomically dispersed Mn-(O-C_(2))_(4)moieties embedding in the exposed basal plane of carbon surface is confirmed by X-ray absorption spectroscopy.As a result,the as-synthesized Mn-O-C catalyst exhibits superior NitRR activity with an NH_(3)yield rate(RNH_(3))of 1476.9±62.6μg h^(−1)cm^(−2)at−0.7 V(vs.reversible hydrogen electrode,RHE)and a faradaic efficiency(FE)of 89.0±3.8%at−0.5 V(vs.RHE)under ambient conditions.Further,when evaluated with a practical flow cell,Mn-O-C shows a high RNH_(3)of 3706.7±552.0μg h^(−1)cm^(−2)at a current density of 100 mA cm−2,2.5 times of that in the H cell.The in situ FT-IR and Raman spectroscopic studies combined with theoretical calculations indicate that the Mn-(O-C_(2))_(4)sites not only effectively inhibit the competitive hydrogen evolution reaction,but also greatly promote the adsorption and activation of nitrate(NO_(3)^(−)),thus boosting both the FE and selectivity of NH_(3)over Mn-(O-C_(2))_(4)sites.

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

Orientation and Decision-Making for Soccer Based on Sports Analytics and AI:A Systematic Review

Due to ever-growing soccer data collection approaches and progressing artificial intelligence(AI) methods, soccer analysis, evaluation, and decision-making have received increasing interest from not only the professional sports analytics realm but also the academic AI research community. AI brings gamechanging approaches for soccer analytics where soccer has been a typical benchmark for AI research. The combination has been an emerging topic. In this paper, soccer match analytics are taken as a complete observation-orientation-decision-action(OODA) loop.In addition, as in AI frameworks such as that for reinforcement learning, interacting with a virtual environment enables an evolving model. Therefore, both soccer analytics in the real world and virtual domains are discussed. With the intersection of the OODA loop and the real-virtual domains, available soccer data, including event and tracking data, and diverse orientation and decisionmaking models for both real-world and virtual soccer matches are comprehensively reviewed. Finally, some promising directions in this interdisciplinary area are pointed out. It is claimed that paradigms for both professional sports analytics and AI research could be combined. Moreover, it is quite promising to bridge the gap between the real and virtual domains for soccer match analysis and decision-making.

Ethical Decision-Making Framework Based on Incremental ILP Considering Conflicts

Humans are experiencing the inclusion of artificial agents in their lives,such as unmanned vehicles,service robots,voice assistants,and intelligent medical care.If the artificial agents cannot align with social values or make ethical decisions,they may not meet the expectations of humans.Traditionally,an ethical decision-making framework is constructed by rule-based or statistical approaches.In this paper,we propose an ethical decision-making framework based on incremental ILP(Inductive Logic Programming),which can overcome the brittleness of rule-based approaches and little interpretability of statistical approaches.As the current incremental ILP makes it difficult to solve conflicts,we propose a novel ethical decision-making framework considering conflicts in this paper,which adopts our proposed incremental ILP system.The framework consists of two processes:the learning process and the deduction process.The first process records bottom clauses with their score functions and learns rules guided by the entailment and the score function.The second process obtains an ethical decision based on the rules.In an ethical scenario about chatbots for teenagers’mental health,we verify that our framework can learn ethical rules and make ethical decisions.Besides,we extract incremental ILP from the framework and compare it with the state-of-the-art ILP systems based on ASP(Answer Set Programming)focusing on conflict resolution.The results of comparisons show that our proposed system can generate better-quality rules than most other systems.

Stroke Risk Assessment Decision-Making Using a Machine Learning Model:Logistic-AdaBoost

Stroke is a chronic cerebrovascular disease that carries a high risk.Stroke risk assessment is of great significance in preventing,reversing and reducing the spread and the health hazards caused by stroke.Aiming to objectively predict and identify strokes,this paper proposes a new stroke risk assessment decision-making model named Logistic-AdaBoost(Logistic-AB)based on machine learning.First,the categorical boosting(CatBoost)method is used to perform feature selection for all features of stroke,and 8 main features are selected to form a new index evaluation system to predict the risk of stroke.Second,the borderline synthetic minority oversampling technique(SMOTE)algorithm is applied to transform the unbalanced stroke dataset into a balanced dataset.Finally,the stroke risk assessment decision-makingmodel Logistic-AB is constructed,and the overall prediction performance of this new model is evaluated by comparing it with ten other similar models.The comparison results show that the new model proposed in this paper performs better than the two single algorithms(logistic regression and AdaBoost)on the four indicators of recall,precision,F1 score,and accuracy,and the overall performance of the proposed model is better than that of common machine learning algorithms.The Logistic-AB model presented in this paper can more accurately predict patients’stroke risk.

Research on Maneuver Decision-Making of Multi-Agent Adversarial Game in a Random Interference Environment

The strategy evolution process of game players is highly uncertain due to random emergent situations and other external disturbances.This paper investigates the issue of strategy interaction and behavioral decision-making among game players in simulated confrontation scenarios within a random interference environment.It considers the possible risks that random disturbances may pose to the autonomous decision-making of game players,as well as the impact of participants’manipulative behaviors on the state changes of the players.A nonlinear mathematical model is established to describe the strategy decision-making process of the participants in this scenario.Subsequently,the strategy selection interaction relationship,strategy evolution stability,and dynamic decision-making process of the game players are investigated and verified by simulation experiments.The results show that maneuver-related parameters and random environmental interference factors have different effects on the selection and evolutionary speed of the agent’s strategies.Especially in a highly uncertain environment,even small information asymmetry or miscalculation may have a significant impact on decision-making.This also confirms the feasibility and effectiveness of the method proposed in the paper,which can better explain the behavioral decision-making process of the agent in the interaction process.This study provides feasibility analysis ideas and theoretical references for improving multi-agent interactive decision-making and the interpretability of the game system model.

The Spherical q-Linear Diophantine Fuzzy Multiple-Criteria Group Decision-Making Based on Differential Measure

Spherical q-linearDiophantine fuzzy sets(Sq-LDFSs)provedmore effective for handling uncertainty and vagueness in multi-criteria decision-making(MADM).It does not only cover the data in two variable parameters but is also beneficial for three parametric data.By Pythagorean fuzzy sets,the difference is calculated only between two parameters(membership and non-membership).According to human thoughts,fuzzy data can be found in three parameters(membership uncertainty,and non-membership).So,to make a compromise decision,comparing Sq-LDFSs is essential.Existing measures of different fuzzy sets do,however,can have several flaws that can lead to counterintuitive results.For instance,they treat any increase or decrease in the membership degree as the same as the non-membership degree because the uncertainty does not change,even though each parameter has a different implication.In the Sq-LDFSs comparison,this research develops the differentialmeasure(DFM).Themain goal of the DFM is to cover the unfair arguments that come from treating different types of FSs opposing criteria equally.Due to their relative positions in the attribute space and the similarity of their membership and non-membership degrees,two Sq-LDFSs formthis preference connectionwhen the uncertainty remains same in both sets.According to the degree of superiority or inferiority,two Sq-LDFSs are shown as identical,equivalent,superior,or inferior over one another.The suggested DFM’s fundamental characteristics are provided.Based on the newly developed DFM,a unique approach tomultiple criterion group decision-making is offered.Our suggestedmethod verifies the novel way of calculating the expert weights for Sq-LDFSS as in PFSs.Our proposed technique in three parameters is applied to evaluate solid-state drives and choose the optimum photovoltaic cell in two applications by taking uncertainty parameter zero.The method’s applicability and validity shown by the findings are contrasted with those obtained using various other existing approaches.To assess its stability and usefulness,a sensitivity analysis is done.

Stochastic programming based coordinated expansion planning of generation,transmission,demand side resources,and energy storage considering the DC transmission system

With the increasing penetration of wind and solar energies,the accompanying uncertainty that propagates in the system places higher requirements on the expansion planning of power systems.A source-grid-load-storage coordinated expansion planning model based on stochastic programming was proposed to suppress the impact of wind and solar energy fluctuations.Multiple types of system components,including demand response service entities,converter stations,DC transmission systems,cascade hydropower stations,and other traditional components,have been extensively modeled.Moreover,energy storage systems are considered to improve the accommodation level of renewable energy and alleviate the influence of intermittence.Demand-response service entities from the load side are used to reduce and move the demand during peak load periods.The uncertainties in wind,solar energy,and loads were simulated using stochastic programming.Finally,the effectiveness of the proposed model is verified through numerical simulations.

A NovelMethod for Determining Tourism Carrying Capacity in a Decision-Making Context Using q−Rung Orthopair Fuzzy Hypersoft Environment

Tourism is a popular activity that allows individuals to escape their daily routines and explore new destinations for various reasons,including leisure,pleasure,or business.A recent study has proposed a unique mathematical concept called a q−Rung orthopair fuzzy hypersoft set(q−ROFHS)to enhance the formal representation of human thought processes and evaluate tourism carrying capacity.This approach can capture the imprecision and ambiguity often present in human perception.With the advanced mathematical tools in this field,the study has also incorporated the Einstein aggregation operator and score function into the q−ROFHS values to supportmultiattribute decision-making algorithms.By implementing this technique,effective plans can be developed for social and economic development while avoiding detrimental effects such as overcrowding or environmental damage caused by tourism.A case study of selected tourism carrying capacity will demonstrate the proposed methodology.

UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

A coordinated operation method of wind-PV-hydrogenstorage multi-agent energy system

Wind-photovoltaic(PV)-hydrogen-storage multi-agent energy systems are expected to play an important role in promoting renewable power utilization and decarbonization.In this study,a coordinated operation method was proposed for a wind-PVhydrogen-storage multi-agent energy system.First,a coordinated operation model was formulated for each agent considering peer-to-peer power trading.Second,a coordinated operation interactive framework for a multi-agent energy system was proposed based on the theory of the alternating direction method of multipliers.Third,a distributed interactive algorithm was proposed to protect the privacy of each agent and solve coordinated operation strategies.Finally,the effectiveness of the proposed coordinated operation method was tested on multi-agent energy systems with different structures,and the operational revenues of the wind power,PV,hydrogen,and energy storage agents of the proposed coordinated operation model were improved by approximately 59.19%,233.28%,16.75%,and 145.56%,respectively,compared with the independent operation model.

Coupling coordinated development among digital economy,regional innovation,and talent employment:A case study in the Hangzhou Metropolitan Circle,China

Coordinative development across various systems,particularly the economic,social,cultural,and human resources subsystems,is a key aspect of urban sustainability and has a direct impact on the quality of urbanization.The Hangzhou Metropolitan Circle,comprising Hangzhou City,Huzhou City,Jiaxing City,and Shaoxing City,was the first metropolitan circle approved by the National Development and Reform Commission(NDRC)as a demonstration of economic transformation in China.To evaluate the coupling coordination degree of the four cities and analyze the coordinative development in three systems(including digital economy,regional innovation,and talent employment),we collected panel data during 2015–2022 from these four cities.The development level of the three systems was evaluated by the standard deviation method and comprehensive development index.The results are as follows:(1)the level of coupling coordinated development of the three systems in the Hangzhou Metropolitan Circle was relatively low;(2)the coupling coordination degree of the four cities in the Hangzhou Metropolitan Circle showed significant regional differences,among which Hangzhou City was in the leading position,and Huzhou,Jiaxing,and Shaoxing cities made steady but slow progress in the coupling development of the three systems;and(3)the development of digital economy and talent employment needs to be strengthened.This study contributes to the coordinative development of Hangzhou Metropolitan Circle by innovatively focusing on the coupling coordination relationship among digital economy,regional innovation,and talent employment,which also meets the industrial layout of Hangzhou Metropolitan Circle.In this way,the optimal allocation and sustainable development of digital economy,regional innovation,and talent employment in the Hangzhou Metropolitan Circle can be achieved.

Coordinated Mining Procedures of Open Pit Mines Based on River Management

This paper primarily concerns the effective coordination of the procedures and methods employed in open pit mining operations under the background of river management.The central objective of this study is to identify a viable approach for ensuring rational and efficient development of open pit mineral resources while simultaneously protecting and restoring the ecological environment of the river.This approach should facilitate the realization of a harmonious symbiosis between mining and river management.The intricate mutual influence relationship between river management and open pit mining is first analyzed in depth,which provides a solid foundation for the subsequent coordination strategy development.In light of the aforementioned considerations,a set of coordination procedures for open pit mining based on river management conditions is proposed.These procedures emphasize the integration of river protection into the overall layout of mining at the planning stage.The implementation of scientific mining schemes,accompanied by rigorous control of the scope and depth of mining operations,has proven to be an effective means of reducing the impact of mining activities on river environments.This approach has also facilitated the achievement of a balance and coordination between mining and river management.

Influence of social media on maternal decision-making and breastfeeding practices

Breastfeeding practices are influenced by multifactorial determinants including individual characteristics,external support systems,and media influences.This commentary emphasizes such complex factors influencing breastfeeding practices.Potential methodological limitations and the need for diverse sampling in studying breastfeeding practices are highlighted.Further research must explore the interplay between social influences,cultural norms,government policies,and individual factors in shaping maternal breastfeeding decisions.

Decision-Making and Management of Self-Care in Persons with Traumatic Spinal Cord Injuries: A Preliminary Study

Patients and physicians understand the importance of self-care following spinal cord injury (SCI), yet many individuals with SCI do not adhere to recommended self-care activities despite logistical supports. Neurobehavioral determinants of SCI self-care behavior, such as impulsivity, are not widely studied, yet understanding them could inform efforts to improve SCI self-care. We explored associations between impulsivity and self-care in an observational study of 35 US adults age 18 - 50 who had traumatic SCI with paraplegia at least six months before assessment. The primary outcome measure was self-reported self-care. In LASSO regression models that included all neurobehavioral measures and demographics as predictors of self-care, dispositional measures of greater impulsivity (negative urgency, lack of premeditation, lack of perseverance), and reduced mindfulness were associated with reduced self-care. Outcome (magnitude) sensitivity, a latent decision-making parameter derived from computationally modeling successive choices in a gambling task, was also associated with self-care behavior. These results are preliminary;more research is needed to demonstrate the utility of these findings in clinical settings. Information about associations between impulsivity and poor self-care in people with SCI could guide the development of interventions to improve SCI self-care and help patients with elevated risks related to self-care and secondary health conditions.

Assessment of rural sustainable development and analysis and prediction of obstacles and coupled coordinated development:A case study of Zaozhuang City

In China,the Innovation Demonstration Zone for the National Sustainable Development Agenda is a key initiative for executing the United Nations(UN)2030 Agenda for Sustainable Development.The Zone also plays critical roles in addressing the developmental bottlenecks that China faces and sharing Chinese insights into global sustainable development efforts.On July 15,2022,the State Council endorsed the Zone’s establishment in Zaozhuang City,Shandong Province,where it focuses on innovation-led sustainable development in rural areas.Research into the levels,impediments,interdependencies,and evolutionary trends of rural sustainable development is crucial.Therefore,this research aimed to assist in comprehensively assessing developmental challenges and facilitating the harmonious advancement of social,economic,and environmental aspects in rural areas.In pursuit of the three fundamental dimensions of the UN’s Sustainable Development Goals(SDGs),namely development’s drivers,quality,and equity,this study was grounded in China’s national Rural Revitalization Strategy and the demands of sustainable development strategies.It also aligns with the UN 2030 Agenda for Sustainable Development and the associated SDG indicators.Focusing on four key areas,namely production elements,natural elements,social elements,and rural governance,this study developed an evaluation index system for assessing the level of rural sustainable development.It employed a range of analytical models,including the game theory-based combination empowerment method,barrier degree model,coupling degree model,coupling coordination degree model,and gray prediction GM(1,1)model,to analyze the status and evolving trends of rural sustainable development in Zaozhuang City from 2015 to 2022.The key findings were as follows:①Relative to the baseline year 2015,the sustainable development level in Zaozhuang’s rural areas has shifted toward an improved state overall.②The primary barrier to achieving rural sustainable development in Zaozhuang is the city’s rural governance system.③While the components of rural sustainable development in Zaozhuang are in the early stages of both basic and moderate coordination,an overall enhancement has occurred in their integrative coordination.④Between 2023 and 2025,the level of integrative coordination in Zaozhuang is expected to rise steadily.However,reaching a state of advanced coordination will require additional time for development.

Cortical activity in patients with high-functioning ischemic stroke during the Purdue Pegboard Test:insights into bimanual coordinated fine motor skills with functional near-infrared spectroscopy

After stroke,even high-functioning individuals may experience compromised bimanual coordination and fine motor dexterity,leading to reduced functional independence.Bilateral arm training has been proposed as a promising intervention to address these deficits.However,the neural basis of the impairment of functional fine motor skills and their relationship to bimanual coordination performance in stroke patients remains unclear,limiting the development of more targeted interventions.To address this gap,our study employed functional near-infrared spectroscopy to investigate cortical responses in patients after stroke as they perform functional tasks that engage fine motor control and coordination.Twenty-four high-functioning patients with ischemic stroke(7 women,17 men;mean age 64.75±10.84 years)participated in this cross-sectional observational study and completed four subtasks from the Purdue Pegboard Test,which measures unimanual and bimanual finger and hand dexterity.We found significant bilateral activation of the sensorimotor cortices during all Purdue Pegboard Test subtasks,with bimanual tasks inducing higher cortical activation than the assembly subtask.Importantly,patients with better bimanual coordination exhibited lower cortical activation during the other three Purdue Pegboard Test subtasks.Notably,the observed neural response patterns varied depending on the specific subtask.In the unaffected hand task,the differences were primarily observed in the ipsilesional hemisphere.In contrast,the bilateral sensorimotor cortices and the contralesional hemisphere played a more prominent role in the bimanual task and assembly task,respectively.While significant correlations were found between cortical activation and unimanual tasks,no significant correlations were observed with bimanual tasks.This study provides insights into the neural basis of bimanual coordination and fine motor skills in high-functioning patients after stroke,highlighting task-dependent neural responses.The findings also suggest that patients who exhibit better bimanual performance demonstrate more efficient cortical activation.Therefore,incorporating bilateral arm training in post-stroke rehabilitation is important for better outcomes.The combination of functional near-infrared spectroscopy with functional motor paradigms is valuable for assessing skills and developing targeted interventions in stroke rehabilitation.

Interaction and coordinated development between desertification control and social economy in Xizang,China

Based on the general requirements of the coordinated development of"ecological livable"and"affluent life"in the rural revitalization strategy,the evaluation index system of desertification control was constructed,the interaction between desertification control and regional social economy and the internal space-time coordination mechanism were explored,and the quality of desertification control and its coordination degree with regional economic development were quantitatively analyzed.The decoupling mechanism of desertification governance society economy system were analyzed,and the high level for the government to promote desertification governance,constructing ecological economy coordinated development pattern to provide decision basis to Xizang desertification governance-social economic system interaction and coupling coordination development as the research object,introducing the coupling decoupling model to measure the coupling coordination model and system coordination and decoupling decoupling.Desertification control in Xizang shows a trend of gradual improvement,but the overall level is still not high and there is a lot of room for optimization.The coupling coordination degree of desertification control-social and economic system is in a steady fluctuation trend,rising from D value less than 0.55 in 2004 to 0.87 in 2018,in a state of coordinated development(good),and grey prediction analysis shows that D value is in a continuous rise.The coupling coordination degree of the six prefecture-level cities in Xizang and Ngari region is different in time and space,but the overall development trend is coordinated.The development index of desertification control and the socio-economic development index show the interaction of strong decoupling,strong negative decoupling and weak decoupling,and there are interaction effects of desertification control,economic development and social development at different scales.

Spatio-temporal evolution of the coordinated development of high-tech industry agglomeration and resource-environmental carrying capacity in the Yellow River Basin

Under the background of new infrastructure,the Yellow River Basin’s superior growth cannot be separated originating with the synergistic effect of scientific and technological inventiveness and ecological civilization construction.In light of the coupling coordination analysis of the coordination effect of provincial high-tech industry agglomeration and resource carrying capacity in the Yellow River Basin from 2009 to 2021,The evolution of the geographical and temporal pattern of development was investigated using the Moran index and kernel density estimation.The results show that the agglomeration of high-tech industries in the Yellow River Basin presents a development trend of seek improvement in stability,and there is a good coupling and coordination throughout the progression of scientific and technological innovation and the loading capacity of the resource,from the viewpoint of a time series.From the perspective of spatial pattern distribution,the whole basin aims at the lower reaches,accelerates the optimization of digital industry and promotes Yellow River Basin development of superior quality through innovation support and increase of input,and based on policy guidance.