Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

Thanks to our academic editors and peer reviewers

The Editorial Office of Water Science and Engineering would like to express their sincere appreciation to the academic editors including Prof.Carlo Gualtieri from University of Napoli Federico II,Italy,Prof.Guo-qing Wang and Prof.Zhong-zhi Fu from Nanjing Hydraulic Research Institute,China,and Prof.Yan-hui Ao,Prof.Ching-sheng Huang,Prof.Guang-qiu Jin,Prof.Bin Xu,Prof.Sai-yu Yuan,Prof.Zeng Zhou,Prof.Bo Chen,and Prof Da-wei Guan from Hohai Uiversity,China,for their great effort and contribution to WSE in the year 2023.

Insights from an academic endeavor into central nervous system drug discovery

Historically,"big pharma"did most central nervous system drug discovery R&D in-house.Yet,in modern times their"management reductionism"resulted in disappointing pipelines and pharma resided to(late)development,regulatory approval,and marketing(Thong,2015).This had significant consequences for financing and executing research,resulting in a larger role for funding by governments and patient-organizations and a shift of research to academia(Mazzucato,2013).

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

Orientation and Decision-Making for Soccer Based on Sports Analytics and AI:A Systematic Review

Due to ever-growing soccer data collection approaches and progressing artificial intelligence(AI) methods, soccer analysis, evaluation, and decision-making have received increasing interest from not only the professional sports analytics realm but also the academic AI research community. AI brings gamechanging approaches for soccer analytics where soccer has been a typical benchmark for AI research. The combination has been an emerging topic. In this paper, soccer match analytics are taken as a complete observation-orientation-decision-action(OODA) loop.In addition, as in AI frameworks such as that for reinforcement learning, interacting with a virtual environment enables an evolving model. Therefore, both soccer analytics in the real world and virtual domains are discussed. With the intersection of the OODA loop and the real-virtual domains, available soccer data, including event and tracking data, and diverse orientation and decisionmaking models for both real-world and virtual soccer matches are comprehensively reviewed. Finally, some promising directions in this interdisciplinary area are pointed out. It is claimed that paradigms for both professional sports analytics and AI research could be combined. Moreover, it is quite promising to bridge the gap between the real and virtual domains for soccer match analysis and decision-making.

Effects of a school-based karate intervention on academic achievement,psychosocial functioning,and physical fitness:A multi-country cluster randomized controlled trial

Purpose:To examine the effects of a school-based karate intervention on academic achievement,psychosocial functioning,and physical fitness in children aged 7-8 years.Methods:Twenty schools in 5 different European countries(2 second-grade classrooms per school)participated in a cluster randomized controlled trial(Sport at School trial).Participants were assigned to either a control group,which continued with their habitual physical education lessons,or to an intervention group,which replaced these lessons with a 1-year karate intervention(Karate Mind and Movement program).A total of 721 children(344 girls and 377 boys,7.4±0.5 years old,mean±SD)completed the study,of which 333 and 388 were assigned to the control group and intervention group,respectively.Outcomes included academic performance(average grade),psychosocial functioning(Strengths and Difficulties Questionnaire for parents),and different markers of physical fitness(cardiorespiratory fitness,balance,and flexibility).Results:The intervention provided small but significant benefits compared to the control group for academic achievement(d=0.16;p=0.003),conduct problems(d=-0.28;p=0.003),cardiorespiratory fitness(d=0.36;p<0.001),and balance(d=0.24;p=0.015).There was a trend towards significant benefits for flexibility(d=0.24;p=0.056).No significant benefits were observed for other variables,including psychosocial difficulties,emotional symptoms,hyperactivity/inattention,peer problems,or prosocial behaviour(all p>0.05).Conclusion:A 1-year school-based karate intervention was effective in improving academic achievement,conduct problems,and physical fitness in primary school children.The results support the inclusion of karate during physical education lessons.

Ethical Decision-Making Framework Based on Incremental ILP Considering Conflicts

Humans are experiencing the inclusion of artificial agents in their lives,such as unmanned vehicles,service robots,voice assistants,and intelligent medical care.If the artificial agents cannot align with social values or make ethical decisions,they may not meet the expectations of humans.Traditionally,an ethical decision-making framework is constructed by rule-based or statistical approaches.In this paper,we propose an ethical decision-making framework based on incremental ILP(Inductive Logic Programming),which can overcome the brittleness of rule-based approaches and little interpretability of statistical approaches.As the current incremental ILP makes it difficult to solve conflicts,we propose a novel ethical decision-making framework considering conflicts in this paper,which adopts our proposed incremental ILP system.The framework consists of two processes:the learning process and the deduction process.The first process records bottom clauses with their score functions and learns rules guided by the entailment and the score function.The second process obtains an ethical decision based on the rules.In an ethical scenario about chatbots for teenagers’mental health,we verify that our framework can learn ethical rules and make ethical decisions.Besides,we extract incremental ILP from the framework and compare it with the state-of-the-art ILP systems based on ASP(Answer Set Programming)focusing on conflict resolution.The results of comparisons show that our proposed system can generate better-quality rules than most other systems.

Stroke Risk Assessment Decision-Making Using a Machine Learning Model:Logistic-AdaBoost

Stroke is a chronic cerebrovascular disease that carries a high risk.Stroke risk assessment is of great significance in preventing,reversing and reducing the spread and the health hazards caused by stroke.Aiming to objectively predict and identify strokes,this paper proposes a new stroke risk assessment decision-making model named Logistic-AdaBoost(Logistic-AB)based on machine learning.First,the categorical boosting(CatBoost)method is used to perform feature selection for all features of stroke,and 8 main features are selected to form a new index evaluation system to predict the risk of stroke.Second,the borderline synthetic minority oversampling technique(SMOTE)algorithm is applied to transform the unbalanced stroke dataset into a balanced dataset.Finally,the stroke risk assessment decision-makingmodel Logistic-AB is constructed,and the overall prediction performance of this new model is evaluated by comparing it with ten other similar models.The comparison results show that the new model proposed in this paper performs better than the two single algorithms(logistic regression and AdaBoost)on the four indicators of recall,precision,F1 score,and accuracy,and the overall performance of the proposed model is better than that of common machine learning algorithms.The Logistic-AB model presented in this paper can more accurately predict patients’stroke risk.

Ranking academic institutions based on the productivity,impact,and quality of institutional scholars

Purpose:The quantitative rankings of over 55,000 institutions and their institutional programs are based on the individual rankings of approximately 30 million scholars determined by their productivity,impact,and quality.Design/methodology/approach:The institutional ranking process developed here considers all institutions in all countries and regions,thereby including those that are established,as well as those that are emerging in scholarly prowess.Rankings of individual scholars worldwide are first generated using the recently introduced,fully indexed ScholarGPS database.The rankings of individual scholars are extended here to determine the lifetime and last-five-year Top 20 rankings of academic institutions over all Fields of scholarly endeavor,in 14 individual Fields,in 177 Disciplines,and in approximately 350,000 unique Specialties.Rankings associated with five specific Fields(Medicine,Engineering&Computer Science,Life Sciences,Physical Sciences&Mathematics,and Social Sciences),and in two Disciplines(Chemistry,and Electrical&Computer Engineering)are presented as examples,and changes in the rankings over time are discussed.Findings:For the Fields considered here,the Top 20 institutional rankings in Medicine have undergone the least change(lifetime versus last five years),while the rankings in Engineering&Computer Science have exhibited significant change.The evolution of institutional rankings over time is largely attributed to the recent emergence of Chinese academic institutions,although this emergence is shown to be highly Field-and Discipline-dependent.Practical implementations:Existing rankings of academic institutions have:(i)often been restricted to pre-selected institutions,clouding the potential discovery of scholarly activity in emerging institutions and countries;(ii)considered only broad areas of research,limiting the ability of university leadership to act on the assessments in a concrete manner,or in contrast;(iii)have considered only a narrow area of research for comparison,diminishing the broader applicability and impact of the assessment.In general,existing institutional rankings depend on which institutions are included in the ranking process,which areas of research are considered,the breadth(or granularity)of the research areas of interest,and the methodologies used to define and quantify research performance.In contrast,the methods presented here can provide important data over a broad range of granularity to allow responsible individuals to gauge the performance of any institution from the Overall(all Fields)level,to the level of the Specialty.The methods may also assist identification of the root causes of shifts in institution rankings,and how these shifts vary across hundreds of thousands of Fields,Disciplines,and Specialties of scholarly endeavor.Originality/value:This study provides the first ranking of all academic institutions worldwide over Fields,Disciplines,and Specialties based on a unique methodology that quantifies the productivity,impact,and quality of individual scholars.

The Spherical q-Linear Diophantine Fuzzy Multiple-Criteria Group Decision-Making Based on Differential Measure

Spherical q-linearDiophantine fuzzy sets(Sq-LDFSs)provedmore effective for handling uncertainty and vagueness in multi-criteria decision-making(MADM).It does not only cover the data in two variable parameters but is also beneficial for three parametric data.By Pythagorean fuzzy sets,the difference is calculated only between two parameters(membership and non-membership).According to human thoughts,fuzzy data can be found in three parameters(membership uncertainty,and non-membership).So,to make a compromise decision,comparing Sq-LDFSs is essential.Existing measures of different fuzzy sets do,however,can have several flaws that can lead to counterintuitive results.For instance,they treat any increase or decrease in the membership degree as the same as the non-membership degree because the uncertainty does not change,even though each parameter has a different implication.In the Sq-LDFSs comparison,this research develops the differentialmeasure(DFM).Themain goal of the DFM is to cover the unfair arguments that come from treating different types of FSs opposing criteria equally.Due to their relative positions in the attribute space and the similarity of their membership and non-membership degrees,two Sq-LDFSs formthis preference connectionwhen the uncertainty remains same in both sets.According to the degree of superiority or inferiority,two Sq-LDFSs are shown as identical,equivalent,superior,or inferior over one another.The suggested DFM’s fundamental characteristics are provided.Based on the newly developed DFM,a unique approach tomultiple criterion group decision-making is offered.Our suggestedmethod verifies the novel way of calculating the expert weights for Sq-LDFSS as in PFSs.Our proposed technique in three parameters is applied to evaluate solid-state drives and choose the optimum photovoltaic cell in two applications by taking uncertainty parameter zero.The method’s applicability and validity shown by the findings are contrasted with those obtained using various other existing approaches.To assess its stability and usefulness,a sensitivity analysis is done.

A NovelMethod for Determining Tourism Carrying Capacity in a Decision-Making Context Using q−Rung Orthopair Fuzzy Hypersoft Environment

Tourism is a popular activity that allows individuals to escape their daily routines and explore new destinations for various reasons,including leisure,pleasure,or business.A recent study has proposed a unique mathematical concept called a q−Rung orthopair fuzzy hypersoft set(q−ROFHS)to enhance the formal representation of human thought processes and evaluate tourism carrying capacity.This approach can capture the imprecision and ambiguity often present in human perception.With the advanced mathematical tools in this field,the study has also incorporated the Einstein aggregation operator and score function into the q−ROFHS values to supportmultiattribute decision-making algorithms.By implementing this technique,effective plans can be developed for social and economic development while avoiding detrimental effects such as overcrowding or environmental damage caused by tourism.A case study of selected tourism carrying capacity will demonstrate the proposed methodology.

UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

International academic symposium of ISO/TC 312 held in Beijing

The international academic symposium of ISO/TC 312, Excellence in ser vice, was held in Beijing on February 27, which was a part of the 11th plenary meeting of the committee. Directed by SAC, organized by China National Institute of Standardization(CNIS), and supported by China Association for Standardization(CAS) and China Civil Airports Association(CCAA), the symposium was attended by over 20,000 representatives in hybrid forms.

Parental Educational Expectations,Academic Pressure,and Adolescent Mental Health:An Empirical Study Based on CEPS Survey Data

Background:This study aimed to investigate the relationship between parental educational expectations and adolescent mental health problems,with academic pressure as a moderating variable.Methods:This study was based on the baseline data of the China Education Panel Survey,which was collected within one school year during 2013–2014.It included 19,958 samples from seventh and ninth graders,who ranged from 11 to 18 years old.After removing missing values and conducting relevant data processing,the effective sample size for analysis was 16344.The OLS(Ordinary Least Squares)multiple linear regression analysis was used to examine the relationship between parental educational expectations,academic pressure,and adolescents’mental health problems.In addition,we established an interaction term between parents’educational expectations and academic pressure to investigate the moderating effect of academic stress.Results:The study found that adolescents whose parents had high educational expectations reported less mental health problems.(β=−0.195;p<0.001).Additionally,adolescents who had high academic pressure reported more mental health problems.(β=0.649;p<0.001).Furthermore,the study found that academic pressure had a significant moderating effect on the relationship between parental educational expectations and adolescents’mental health problems(β=0.082;p<0.001).Conclusion:Parental educational expectations had a close relationship with adolescents’mental health problems,and academic pressure moderated this relationship.For those adolescents with high levels of academic pressure,the association between high parental educational expectations and mental health problems became stronger.On the contrary,for those adolescents with low levels of academic pressure,the association between high parental educational expectations and mental health problems became weaker.These findings shed new light on how parental educational expectations affected adolescent mental health problems and had significant implications for their healthy development.

Forecasting the Academic Performance by Leveraging Educational Data Mining

The study aims to recognize how efficiently Educational DataMining(EDM)integrates into Artificial Intelligence(AI)to develop skills for predicting students’performance.The study used a survey questionnaire and collected data from 300 undergraduate students of Al Neelain University.The first step’s initial population placements were created using Particle Swarm Optimization(PSO).Then,using adaptive feature space search,Educational Grey Wolf Optimization(EGWO)was employed to choose the optimal attribute combination.The second stage uses the SVMclassifier to forecast classification accuracy.Different classifiers were utilized to evaluate the performance of students.According to the results,it was revealed that AI could forecast the final grades of students with an accuracy rate of 97%on the test dataset.Furthermore,the present study showed that successful students could be selected by the Decision Tree model with an efficiency rate of 87.50%and could be categorized as having equal information ratio gain after the semester.While the random forest provided an accuracy of 28%.These findings indicate the higher accuracy rate in the results when these models were implemented on the data set which provides significantly accurate results as compared to a linear regression model with accuracy(12%).The study concluded that the methodology used in this study can prove to be helpful for students and teachers in upgrading academic performance,reducing chances of failure,and taking appropriate steps at the right time to raise the standards of education.The study also motivates academics to assess and discover EDM at several other universities.

Decision-Making and Management of Self-Care in Persons with Traumatic Spinal Cord Injuries: A Preliminary Study

Patients and physicians understand the importance of self-care following spinal cord injury (SCI), yet many individuals with SCI do not adhere to recommended self-care activities despite logistical supports. Neurobehavioral determinants of SCI self-care behavior, such as impulsivity, are not widely studied, yet understanding them could inform efforts to improve SCI self-care. We explored associations between impulsivity and self-care in an observational study of 35 US adults age 18 - 50 who had traumatic SCI with paraplegia at least six months before assessment. The primary outcome measure was self-reported self-care. In LASSO regression models that included all neurobehavioral measures and demographics as predictors of self-care, dispositional measures of greater impulsivity (negative urgency, lack of premeditation, lack of perseverance), and reduced mindfulness were associated with reduced self-care. Outcome (magnitude) sensitivity, a latent decision-making parameter derived from computationally modeling successive choices in a gambling task, was also associated with self-care behavior. These results are preliminary;more research is needed to demonstrate the utility of these findings in clinical settings. Information about associations between impulsivity and poor self-care in people with SCI could guide the development of interventions to improve SCI self-care and help patients with elevated risks related to self-care and secondary health conditions.

Academic Stress Assessment Using Virtual Reality as an Educational Tool in Spine Surgery

Introduction: The evaluation of academic stress in medical students and residents is a topic of significant interest, given the considerable challenges they face during their learning process with traditional teaching methods. The use of technologies like virtual reality presents an opportunity to enhance their skills through simulations and training. The main objective of this study is to qualitatively assess the stress levels experienced by medical students and residents by integrating virtual reality into their current learning methods, aiming to improve their ability to manage stressors in their practice. Material and Methods: A questionnaire was conducted with 12 medical students and 12 Traumatology and orthopedics residents. The purpose of the questionnaire was to evaluate the levels of academic stress using the SISCO inventory. The stress levels were calculated by transforming average values into percentages, and the following criteria were assigned: 0 to 33% for Mild Stress, 34 to 66% for Moderate Stress, and 67 to 100% for Deep Stress. Then, a virtual reality class focused on spine surgery was provided. Both medical students and residents were trained using the Non Nocere SharpSurgeon software platform and Oculus Quest 2 virtual reality glasses. At the end of the session, a second questionnaire related to the practice with virtual reality was conducted with the same evaluation criteria and a comparative analysis was carried out. Results: 12 undergraduate students from Hospital Angeles Mexico, CDMX and 12 traumatology and orthopedics residents at Hospital Santa Fe, Bogota were evaluated. The students in CDMX reported an average qualitative stress of 28.50% during habitual practices, which decreased to an average of 14.67% after virtual reality practice. Residents in Bogotá experienced an average qualitative stress of 30.50% with their current learning methods but this reduced to an average of 13.92% after using virtual reality. These findings indicate that the use of virtual reality has a positive impact on reducing stress levels qualitatively. Conclusions: The use of virtual reality as a learning method for medical students and residents qualitatively improves stress levels. Further studies are required to define the potential uses of Virtual Reality to improve learning methods and emotional state in medical students and residents and for a quantitative assessment to validate the training as certified learning methods.

通用学术词表Academic Vocabulary List(AVL)修订述略

学术英语词汇是学术英语教学的重点和难点,不同时代和学科曾编写过各类学术词表。加德纳和戴维斯(2014)基于学术语料容量达1.2亿的COCA语料库推出学术词表Academic Vocabulary List(AVL),该词表在学术英语教学和研究中得到广泛应用。然而实践表明,AVL词表收录的3015个词元存在词汇重复、以词元为单位排列的词表和以词族为单位排列的词表不相吻合等问题。本研究尝试以科学性原则、适切性原则、时效性原则为指导,基于AVL词表原有的比率、分布、离散度、学科指数四条选词标准,增加最低频次和经验判断两条新标准对AVL词表予以完善和修订。完善修订后的AVL词表由先前的1991个词族、3015个词元缩减至709个词族1715个词元,较修订前更具简洁性和高效性。希望依据3项原则和6项标准所做的修订为学术英语教与学以及学术英语教材编写和选用带来新的参考。

Research on Public Engineering Emergency Decision-Making Based on Multi-Granularity Language Information

To effectively deal with fuzzy and uncertain information in public engineering emergencies,an emergency decision-making method based on multi-granularity language information is proposed.Firstly,decision makers select the appropriate language phrase set according to their own situation,give the preference information of the weight of each key indicator,and then transform the multi-granularity language information through consistency.On this basis,the sequential optimization technology of the approximately ideal scheme is introduced to obtain the weight coefficient of each key indicator.Subsequently,the weighted average operator is used to aggregate the preference information of each alternative scheme with the relative importance of decision-makers and the weight of key indicators in sequence,and the comprehensive evaluation value of each scheme is obtained to determine the optimal scheme.Lastly,the effectiveness and practicability of the method are verified by taking the earthwork collapse accident in the construction of a reservoir as an example.

A Blind Spot in the Reframing of a Universe of Possibles: Towards a Suitable Model for Decision-Making Theory and A.I.

Bayesian inference model is an optimal processing of incomplete information that, more than other models, better captures the way in which any decision-maker learns and updates his degree of rational beliefs about possible states of nature, in order to make a better judgment while taking new evidence into account. Such a scientific model proposed for the general theory of decision-making, like all others in general, whether in statistics, economics, operations research, A.I., data science or applied mathematics, regardless of whether they are time-dependent, have in common a theoretical basis that is axiomatized by relying on related concepts of a universe of possibles, especially the so-called universe (or the world), the state of nature (or the state of the world), when formulated explicitly. The issue of where to stand as an observer or a decision-maker to reframe such a universe of possibles together with a partition structure of knowledge (i.e. semantic formalisms), including a copy of itself as it was initially while generalizing it, is not addressed. Memory being the substratum, whether human or artificial, wherein everything stands, to date, even the theoretical possibility of such an operation of self-inclusion is prohibited by pure mathematics. We make this blind spot come to light through a counter-example (namely Archimedes’ Eureka experiment) and explore novel theoretical foundations, fitting better with a quantum form than with fuzzy modeling, to deal with more than a reference universe of possibles. This could open up a new path of investigation for the general theory of decision-making, as well as for Artificial Intelligence, often considered as the science of the imitation of human abilities, while being also the science of knowledge representation and the science of concept formation and reasoning.