Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

Orientation and Decision-Making for Soccer Based on Sports Analytics and AI:A Systematic Review

Due to ever-growing soccer data collection approaches and progressing artificial intelligence(AI) methods, soccer analysis, evaluation, and decision-making have received increasing interest from not only the professional sports analytics realm but also the academic AI research community. AI brings gamechanging approaches for soccer analytics where soccer has been a typical benchmark for AI research. The combination has been an emerging topic. In this paper, soccer match analytics are taken as a complete observation-orientation-decision-action(OODA) loop.In addition, as in AI frameworks such as that for reinforcement learning, interacting with a virtual environment enables an evolving model. Therefore, both soccer analytics in the real world and virtual domains are discussed. With the intersection of the OODA loop and the real-virtual domains, available soccer data, including event and tracking data, and diverse orientation and decisionmaking models for both real-world and virtual soccer matches are comprehensively reviewed. Finally, some promising directions in this interdisciplinary area are pointed out. It is claimed that paradigms for both professional sports analytics and AI research could be combined. Moreover, it is quite promising to bridge the gap between the real and virtual domains for soccer match analysis and decision-making.

Ethical Decision-Making Framework Based on Incremental ILP Considering Conflicts

Humans are experiencing the inclusion of artificial agents in their lives,such as unmanned vehicles,service robots,voice assistants,and intelligent medical care.If the artificial agents cannot align with social values or make ethical decisions,they may not meet the expectations of humans.Traditionally,an ethical decision-making framework is constructed by rule-based or statistical approaches.In this paper,we propose an ethical decision-making framework based on incremental ILP(Inductive Logic Programming),which can overcome the brittleness of rule-based approaches and little interpretability of statistical approaches.As the current incremental ILP makes it difficult to solve conflicts,we propose a novel ethical decision-making framework considering conflicts in this paper,which adopts our proposed incremental ILP system.The framework consists of two processes:the learning process and the deduction process.The first process records bottom clauses with their score functions and learns rules guided by the entailment and the score function.The second process obtains an ethical decision based on the rules.In an ethical scenario about chatbots for teenagers’mental health,we verify that our framework can learn ethical rules and make ethical decisions.Besides,we extract incremental ILP from the framework and compare it with the state-of-the-art ILP systems based on ASP(Answer Set Programming)focusing on conflict resolution.The results of comparisons show that our proposed system can generate better-quality rules than most other systems.

Addressing inclusion,innovation,and sustainability challenges through the lens of economic geography:Introducing the hierarchical regional innovation system

The world is facing dramatic challenges related to environmental sustainability at an accelerating pace.In this context,the field of economic geography(EG)has been playing an important role in understanding both the socioeconomic and technological dimensions of these challenges,as it deals with a variety of complementary notions and perspectives.Departing from this lens,our aim is to explore a conceptual framework that can help us to understand environmental changes relating to multi-dimensional territorial development,notably in eco-nomic contexts where inequality is high,and stratification based on hierarchies regulate social and economic life.Based on the territory concept,we propose the original notion of a hierarchical regional innovation system(HRIS)that emphasises the pervasive role of hierarchies(powers)in regional innovation systems and illustrate its value with evidence and case studies from extant literature on sustainability transitions.The HRIS can help us understand and promote development paths considering the contribution of inclusive eco-innovations(another original conceptual amalgam).Through some empirical cases from other studies in low-carbon transitions,we show the application of the HRIS(and inclusive eco-innovation)framework.In conclusion,we provide incen-tives to explore new regional innovation systems,alongside the HRIS,adapted to different regions worldwide and centred on the inclusiveness of people and places.

Stroke Risk Assessment Decision-Making Using a Machine Learning Model:Logistic-AdaBoost

Stroke is a chronic cerebrovascular disease that carries a high risk.Stroke risk assessment is of great significance in preventing,reversing and reducing the spread and the health hazards caused by stroke.Aiming to objectively predict and identify strokes,this paper proposes a new stroke risk assessment decision-making model named Logistic-AdaBoost(Logistic-AB)based on machine learning.First,the categorical boosting(CatBoost)method is used to perform feature selection for all features of stroke,and 8 main features are selected to form a new index evaluation system to predict the risk of stroke.Second,the borderline synthetic minority oversampling technique(SMOTE)algorithm is applied to transform the unbalanced stroke dataset into a balanced dataset.Finally,the stroke risk assessment decision-makingmodel Logistic-AB is constructed,and the overall prediction performance of this new model is evaluated by comparing it with ten other similar models.The comparison results show that the new model proposed in this paper performs better than the two single algorithms(logistic regression and AdaBoost)on the four indicators of recall,precision,F1 score,and accuracy,and the overall performance of the proposed model is better than that of common machine learning algorithms.The Logistic-AB model presented in this paper can more accurately predict patients’stroke risk.

Research on Innovation-Driven Expansion of Regional OFDI: New Evidence From a Business Environment Perspective

This paper investigates the impact of provincial innovation-driven efficiency on the expansion of regional Outward Foreign Direct Investment(OFDI)flows within the context of China’s economy during the period 2011 to 2020 by measuring the innovation-driven efficiency and business environment index using the DEA-Malmquist index and the combined CRITIC weighting method from the new perspective of business environment improvement.The findings reveal that:(a)There is an inverted U-shaped relationship between provincial innovation-driven efficiency and regional OFDI flows.This increase in innovation-driven efficiency can promote OFDI expansion of the region by improving its business environment.(b)The improvement of the business environments plays a significant intermediary and synergistic role in OFDI expansion driven by improved innovation efficiency.(c)The study of regional heterogeneity suggests that the central region enjoys the longest window period in terms of innovation-driven OFDI expansion,followed by the eastern region while the western region has the shortest window period.The improvement of the business environment in the western region is more effective in driving regional OFDI expansion.This conclusion remained true after the robustness test.In conclusion,this paper offers a few policy recommendations that can help Chinese capital of various kinds go global more effectively.

Improving innovation and entrepreneurship education in higher institutions: the impact of "Mass Entrepreneurship and Innovation" education on undergraduates' entrepreneurial intentions

The exploration of the way"mass entrepreneurship and innovation"(MEI)education influences students'aspirations to become entrepreneurs has grown into an important area of analysis in studies related to higher education.This research intends to examine the consequences of MEI education on students'tendency towards entrepreneurship,and to put forward methods for augmenting the teaching of innovation and entrepreneurship in private higher educational establishments.To achieve this objective,questionnaires and semi-structured interviews were employed in the study,which involved a total of 197 students and five education experts.The statistical analysis of the questionnaire data revealed that MEI education was positively related to students'entrepreneurial intentions,and that both entrepreneurial experience and family entrepreneurial background played moderating roles in this relationship.The interview findings indicated that private universities could enhance educational reforms by designing talent training programs,developing diversified curricula,and developing more professional entrepreneurial platforms to encourage students'entrepreneurial intentions.This study offers fresh insights for improving and perfecting the mechanism of innovation and entrepreneurship education in private universities.

The Spherical q-Linear Diophantine Fuzzy Multiple-Criteria Group Decision-Making Based on Differential Measure

Spherical q-linearDiophantine fuzzy sets(Sq-LDFSs)provedmore effective for handling uncertainty and vagueness in multi-criteria decision-making(MADM).It does not only cover the data in two variable parameters but is also beneficial for three parametric data.By Pythagorean fuzzy sets,the difference is calculated only between two parameters(membership and non-membership).According to human thoughts,fuzzy data can be found in three parameters(membership uncertainty,and non-membership).So,to make a compromise decision,comparing Sq-LDFSs is essential.Existing measures of different fuzzy sets do,however,can have several flaws that can lead to counterintuitive results.For instance,they treat any increase or decrease in the membership degree as the same as the non-membership degree because the uncertainty does not change,even though each parameter has a different implication.In the Sq-LDFSs comparison,this research develops the differentialmeasure(DFM).Themain goal of the DFM is to cover the unfair arguments that come from treating different types of FSs opposing criteria equally.Due to their relative positions in the attribute space and the similarity of their membership and non-membership degrees,two Sq-LDFSs formthis preference connectionwhen the uncertainty remains same in both sets.According to the degree of superiority or inferiority,two Sq-LDFSs are shown as identical,equivalent,superior,or inferior over one another.The suggested DFM’s fundamental characteristics are provided.Based on the newly developed DFM,a unique approach tomultiple criterion group decision-making is offered.Our suggestedmethod verifies the novel way of calculating the expert weights for Sq-LDFSS as in PFSs.Our proposed technique in three parameters is applied to evaluate solid-state drives and choose the optimum photovoltaic cell in two applications by taking uncertainty parameter zero.The method’s applicability and validity shown by the findings are contrasted with those obtained using various other existing approaches.To assess its stability and usefulness,a sensitivity analysis is done.

A Blind Spot in the Reframing of a Universe of Possibles: Towards a Suitable Model for Decision-Making Theory and A.I.

Bayesian inference model is an optimal processing of incomplete information that, more than other models, better captures the way in which any decision-maker learns and updates his degree of rational beliefs about possible states of nature, in order to make a better judgment while taking new evidence into account. Such a scientific model proposed for the general theory of decision-making, like all others in general, whether in statistics, economics, operations research, A.I., data science or applied mathematics, regardless of whether they are time-dependent, have in common a theoretical basis that is axiomatized by relying on related concepts of a universe of possibles, especially the so-called universe (or the world), the state of nature (or the state of the world), when formulated explicitly. The issue of where to stand as an observer or a decision-maker to reframe such a universe of possibles together with a partition structure of knowledge (i.e. semantic formalisms), including a copy of itself as it was initially while generalizing it, is not addressed. Memory being the substratum, whether human or artificial, wherein everything stands, to date, even the theoretical possibility of such an operation of self-inclusion is prohibited by pure mathematics. We make this blind spot come to light through a counter-example (namely Archimedes’ Eureka experiment) and explore novel theoretical foundations, fitting better with a quantum form than with fuzzy modeling, to deal with more than a reference universe of possibles. This could open up a new path of investigation for the general theory of decision-making, as well as for Artificial Intelligence, often considered as the science of the imitation of human abilities, while being also the science of knowledge representation and the science of concept formation and reasoning.

Innovation and Firm Co-ownership Network in China’s Electric Vehicle Industry

Firms are embedded in complex networks,where diverse ideas combine and generate new ideas.Shareholders of firms are of-ten seen as critical external resources that have significant influence on firm innovation.The current literature tends to focus on the rela-tionship between firms and their shareholders,while paying less attention to the connections between firms with the same shareholders.This article identifies two types of network spillover effects,intra-city network effect and inter-city network effect,by visualizing the co-ownership networks in China’s electric vehicle(EV)industry.We find that firms with the same shareholders,which are defined as co-owned EV firms,are more innovative than non-co-owned ones.Furthermore,there are two dominant types of firm co-ownership ties formed by corporate and financial institution shareholders.While corporate shareholders help exploiting local tacit knowledge,financial institutions are more active in bridging inter-city connections.The conclusion is confirmed at both firm and city levels.This paper theor-izes the firm co-ownership network as a new form of institutional proximity and tested the result empirically.For policy consideration,we have emphasized the importance of building formal or informal inter-firm network,and the government should further enhance the knowledge flow channel by institutional construction.

A NovelMethod for Determining Tourism Carrying Capacity in a Decision-Making Context Using q−Rung Orthopair Fuzzy Hypersoft Environment

Tourism is a popular activity that allows individuals to escape their daily routines and explore new destinations for various reasons,including leisure,pleasure,or business.A recent study has proposed a unique mathematical concept called a q−Rung orthopair fuzzy hypersoft set(q−ROFHS)to enhance the formal representation of human thought processes and evaluate tourism carrying capacity.This approach can capture the imprecision and ambiguity often present in human perception.With the advanced mathematical tools in this field,the study has also incorporated the Einstein aggregation operator and score function into the q−ROFHS values to supportmultiattribute decision-making algorithms.By implementing this technique,effective plans can be developed for social and economic development while avoiding detrimental effects such as overcrowding or environmental damage caused by tourism.A case study of selected tourism carrying capacity will demonstrate the proposed methodology.

UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

Fast-to-Clinic, Fast-to-Market in Biotech Innovation: Optimizing Chemistry Manufacturing & Controls (CMC) Excellence for Clinical and Commercial Success

In the emerging world of biotech innovation, the fast-to-clinic/market strategy has emerged as a critical “mantra” for biotech, investors, and CDMOs. This approach addresses the escalating costs and complexities of research and development by streamlining the path from concept to clinical trials and, ultimately, to market. The article delves into the intricacies of implementing a fast-to-clinic/market strategy, underlining the empowering role of strategic decision-making in preclinical and commercial stages. The plan advocates for a phase-appropriate approach, where the development decision is tailored to each phase of the product’s lifecycle. This ensures that resources are allocated efficiently, risks are managed effectively, and the product can move through the development pipeline accelerated without compromising quality or regulatory compliance. The article also discusses the role of CDMOs in facilitating rapid product development and the essential factors biotech companies must consider when selecting a partner for outsourcing. These factors include the CDMO’s expertise in navigating regulatory landscapes, technological capabilities, and ability to scale processes efficiently. Moreover, the article stresses the importance of agility and flexibility in the fast-to-clinic/market approach. Biotech companies are encouraged to adopt adaptable strategies that respond to the fast-evolving regulatory and market landscapes.

Cultivation Path of Nursing Undergraduates’Scientific Research and Innovation Ability

Objective: The cultivation of the innovation ability and scientific research is one of the nursing learning objectives for undergraduate students. To explore the method and effect of training system of scientific research innovation ability of nursing undergraduates based on “3332”. Methods: Three course learning modules are constructed: stage-based course learning module, systematic project practice training module and comprehensive practice training module. A practical training platform for scientific research innovation projects is built, and undergraduate scientific research innovation ability training is carried out from both in-class and out-of-class lines. Results: Since 2017, the students have obtained 7 national innovation and entrepreneurship training programs, 52 university-level undergraduate scientific research projects, published more than 10 academic papers, and obtained 2 patent authorization. Conclusions: The training system of scientific research innovation ability of nursing undergraduates based on “3332” is conducive to the development of scientific research innovation ability of nursing students, and to cultivate nursing talents who can adapt to the development of the new era and have better post competence.

Coordination Mechanism and Empirical Research on Marine Science Technology Innovation and Marine Eco-civilization:A Case Study of Coastal Areas of China

Marine science technology innovation provides power and guarantees for marine eco-civilization construction,which provides direction and material support for marine science technology innovation.Therefore,the coordinated development of the two is of great significance to the marine economy sustainable development in China’s coastal areas.On the basis of clarifying the connotations of marine science technology innovation and marine eco-civilization in China’s coastal areas from 2006 to 2019,the mechanism for their coordinated development was analysed.A comprehensive indicator system based on the connotation of the two was constructed,and the coordinated development relationship was empirically tested using the coupled coordination model and the panel vector autoregressive(PVAR)model.The results show that:1)the level of China’s coastal marine science technology innovation continues to improve,gradually forming the core of the development of marine science technology innovation in the north,east and south of Shandong,Shanghai and Guangdong;the level of marine eco-civilization development fluctuating upward trend,showing obvious spatial differentiation characteristics.2)The degree of coordination of marine science technology innovation and marine eco-civilization is growing over time.There is no causal relationship between marine science technology innovation and marine eco-civilization in the northern marine economic circle,but there is a two-way causal relationship between the two in the eastern and southern marine economic circles.3)Marine eco-civilization shows a significant positive and continuous impact on marine science technology innovation,and marine science technology innovation shows a long-term,continuous,fluctuating,and lagging impact on marine eco-civilization.The overall role of marine eco-civilization on marine science technology innovation is dominant,and there are significant differences in the impact effects of the two major marine economic circles.

The Influence Mechanism of an Inclusive Organizational Climate on Innovation Input of Sci-Tech Talents

With the implementation of China’s innovation-driven development strategy,the competition among sci-tech talents has become increasingly fierce.Stimulating the innovative vigor of sci-tech talents has become a hot topic in theoretical research and policy practice.Based on the data from 246 questionnaires collected from sci-tech talents in Hebei province,this study explored the influence mechanism of an inclusive organizational climate on innovation input from technological talents and verified the mediating effects of innovation self-efficacy and intrinsic motivation.The results indicate that an inclusive organizational climate has a significant positive impact on innovation input,innovation self-efficacy,and intrinsic motivation of sci-tech talents.Both innovation self-efficacy and intrinsic motivation play a partial mediating role between an inclusive climate and innovation input.This study verified the important role of an inclusive climate in an organization’s human resource management practices and encouraged managers to emphasize enhancing the innovation self-efficacy and intrinsic motivation of sci-tech talents,thereby continuously improving the level of innovation.

Establishment of Regional Green Innovation Value Chains:A Case Study on Tackling the Impeded Diffusion of Green Products

The green innovation value chain is a key step in transforming green,innovative scientific,and technological achievements into productive forces.The establishment of green innovation value chains based on value distribution rather than technical conditions can effectively overcome the common bottleneck faced by different nations during their green innovation endeavors,namely,the substitution of conventional products with green alternatives.This study investigates the impeded diffusion of green products and their underlying causes,analyzes the internal structure and mechanism of the green innovation value chain,and explores the establishment of regional green innovation value chains and the models available for value chain upgrading.

Coupling coordinated development among digital economy,regional innovation,and talent employment:A case study in the Hangzhou Metropolitan Circle,China

Coordinative development across various systems,particularly the economic,social,cultural,and human resources subsystems,is a key aspect of urban sustainability and has a direct impact on the quality of urbanization.The Hangzhou Metropolitan Circle,comprising Hangzhou City,Huzhou City,Jiaxing City,and Shaoxing City,was the first metropolitan circle approved by the National Development and Reform Commission(NDRC)as a demonstration of economic transformation in China.To evaluate the coupling coordination degree of the four cities and analyze the coordinative development in three systems(including digital economy,regional innovation,and talent employment),we collected panel data during 2015–2022 from these four cities.The development level of the three systems was evaluated by the standard deviation method and comprehensive development index.The results are as follows:(1)the level of coupling coordinated development of the three systems in the Hangzhou Metropolitan Circle was relatively low;(2)the coupling coordination degree of the four cities in the Hangzhou Metropolitan Circle showed significant regional differences,among which Hangzhou City was in the leading position,and Huzhou,Jiaxing,and Shaoxing cities made steady but slow progress in the coupling development of the three systems;and(3)the development of digital economy and talent employment needs to be strengthened.This study contributes to the coordinative development of Hangzhou Metropolitan Circle by innovatively focusing on the coupling coordination relationship among digital economy,regional innovation,and talent employment,which also meets the industrial layout of Hangzhou Metropolitan Circle.In this way,the optimal allocation and sustainable development of digital economy,regional innovation,and talent employment in the Hangzhou Metropolitan Circle can be achieved.

Drivers for Inter-city Innovation Networks Across Chinese Cities:Modelling Physical Versus Intangible Effects

Cross-region innovation is widely recognized as an important source of the long-term regional innovation capacity.In the recent past,a growing number of studies has investigated the network structure and mechanisms of cross-region innovation collaboration in various contexts.However,existing research mainly focuses on physical effects,such as geographical distance and high-speed railway connections.These studies ignore the intangible drivers in a changing environment,the more digitalized economy and the increasingly solidified innovation network structure.Thus,the focus of this study is on estimating determinants of innovation networks,especially on intangible drivers,which have been largely neglected so far.Using city-level data of Chinese patents(excluding Hong Kong,Macao,and Taiwan Province of China),we trace innovation networks across Chinese cities over a long period of time.By integrating a measure on Information and Communications Technology(ICT)development gap and network structural effects into the general proximity framework,this paper explores the changing mechanisms of Chinese innovation networks from a new perspective.The results show that the structure of cross-region innovation networks has changed in China.As mechanisms behind this development,the results confirm the increasingly important role of intangible drivers in Chinese inter-city innovation collaboration when controlling for effects of physical proximity,such as geographical distance.Since digitalization and coordinated development are the mainstream trends in China and other developing countries,these countries'inter-city innovation collaboration patterns will witness dramatic changes under the influence of intangible drivers.