Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

Natural Disaster Risk Monitoring for Immovable Cultural Relics Based on Digital Twin

Natural disaster risk monitoring is an important task for disaster prevention and reduction.In the case of immovable cultural relics,however,the feedback mechanism,risk factors,monitoring logic,and monitoring indicators of natural disaster risk monitoring are complex.How to achieve intelligent perception and monitoring of natural disaster risk for immovable cultural relics has always been a focus and a challenge for researchers.Based on the analysis of the concepts and issues related to the natural disaster risk of immovable cultural relics,this paper proposes a framework for natural disaster risk monitoring for immovable cultural relics based on the digital twin.This framework focuses on risk monitoring,including the physical entities of natural disaster risk for immovable cultural relics,monitoring indicators,and virtual entity construction.A platform for monitoring the natural disaster risk of immovable cultural relics is proposed.Using the Puzhou Ancient City Site as a test bed,the proposed concept can be used for monitoring the natural disaster risk of immovable cultural relics at different scales.

Automatic Extraction Method of 3D Feature Guidelines for Complex Cultural Relic Surfaces Based on Point Cloud

Cultural relics line graphic serves as a crucial form of traditional artifact information documentation,which is a simple and intuitive product with low cost of displaying compared with 3D models.Dimensionality reduction is undoubtedly necessary for line drawings.However,most existing methods for artifact drawing rely on the principles of orthographic projection that always cannot avoid angle occlusion and data overlapping while the surface of cultural relics is complex.Therefore,conformal mapping was introduced as a dimensionality reduction way to compensate for the limitation of orthographic projection.Based on the given criteria for assessing surface complexity,this paper proposed a three-dimensional feature guideline extraction method for complex cultural relic surfaces.A 2D and 3D combined factor that measured the importance of points on describing surface features,vertex weight,was designed.Then the selection threshold for feature guideline extraction was determined based on the differences between vertex weight and shape index distributions.The feasibility and stability were verified through experiments conducted on real cultural relic surface data.Results demonstrated the ability of the method to address the challenges associated with the automatic generation of line drawings for complex surfaces.The extraction method and the obtained results will be useful for line graphic drawing,displaying and propaganda of cultural relics.

Between the City and Images:An Analysis of Mainstream Media’s Paths of Constructing the Cultural Memory of a City:Taking Chengdu Radio and Television’s“Hi Chengdu”as an Example

Mainstream media play a crucial role in constructing the cultural memory of a city.This study used 319 short videos released by“Hi Chengdu,”a new media product of Chengdu Radio and Television,as samples.Based on the grounded theory,a research framework encompassing“content,technology,and discourse”was established to explore the paths through which mainstream media construct the cultural memory.Regarding content,this paper emphasized temporal and spatial contexts and urban spaces,delving deep into the themes of the cultural memory and vehicles for it.In terms of technology,this paper discussed the practice of leveraging audio/visual-mode discourse to stitch together the impressions of a city and evoke emotional resonance to create a“flow”of memory.As for discourse,this paper looked at the performance of a communication ritual to frame concepts and shape urban identity.It is essential to break free from conventional thinking and leverage local culture as the primary driving force to further boost a city’s productivity,in order to excel in cultural communication.

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

Orientation and Decision-Making for Soccer Based on Sports Analytics and AI:A Systematic Review

Due to ever-growing soccer data collection approaches and progressing artificial intelligence(AI) methods, soccer analysis, evaluation, and decision-making have received increasing interest from not only the professional sports analytics realm but also the academic AI research community. AI brings gamechanging approaches for soccer analytics where soccer has been a typical benchmark for AI research. The combination has been an emerging topic. In this paper, soccer match analytics are taken as a complete observation-orientation-decision-action(OODA) loop.In addition, as in AI frameworks such as that for reinforcement learning, interacting with a virtual environment enables an evolving model. Therefore, both soccer analytics in the real world and virtual domains are discussed. With the intersection of the OODA loop and the real-virtual domains, available soccer data, including event and tracking data, and diverse orientation and decisionmaking models for both real-world and virtual soccer matches are comprehensively reviewed. Finally, some promising directions in this interdisciplinary area are pointed out. It is claimed that paradigms for both professional sports analytics and AI research could be combined. Moreover, it is quite promising to bridge the gap between the real and virtual domains for soccer match analysis and decision-making.

Ethical Decision-Making Framework Based on Incremental ILP Considering Conflicts

Humans are experiencing the inclusion of artificial agents in their lives,such as unmanned vehicles,service robots,voice assistants,and intelligent medical care.If the artificial agents cannot align with social values or make ethical decisions,they may not meet the expectations of humans.Traditionally,an ethical decision-making framework is constructed by rule-based or statistical approaches.In this paper,we propose an ethical decision-making framework based on incremental ILP(Inductive Logic Programming),which can overcome the brittleness of rule-based approaches and little interpretability of statistical approaches.As the current incremental ILP makes it difficult to solve conflicts,we propose a novel ethical decision-making framework considering conflicts in this paper,which adopts our proposed incremental ILP system.The framework consists of two processes:the learning process and the deduction process.The first process records bottom clauses with their score functions and learns rules guided by the entailment and the score function.The second process obtains an ethical decision based on the rules.In an ethical scenario about chatbots for teenagers’mental health,we verify that our framework can learn ethical rules and make ethical decisions.Besides,we extract incremental ILP from the framework and compare it with the state-of-the-art ILP systems based on ASP(Answer Set Programming)focusing on conflict resolution.The results of comparisons show that our proposed system can generate better-quality rules than most other systems.

Offline Reinforcement Learning with Constrained Hybrid Action Implicit Representation Towards Wargaming Decision-Making

Reinforcement Learning(RL)has emerged as a promising data-driven solution for wargaming decision-making.However,two domain challenges still exist:(1)dealing with discrete-continuous hybrid wargaming control and(2)accelerating RL deployment with rich offline data.Existing RL methods fail to handle these two issues simultaneously,thereby we propose a novel offline RL method targeting hybrid action space.A new constrained action representation technique is developed to build a bidirectional mapping between the original hybrid action space and a latent space in a semantically consistent way.This allows learning a continuous latent policy with offline RL with better exploration feasibility and scalability and reconstructing it back to a needed hybrid policy.Critically,a novel offline RL optimization objective with adaptively adjusted constraints is designed to balance the alleviation and generalization of out-of-distribution actions.Our method demonstrates superior performance and generality across different tasks,particularly in typical realistic wargaming scenarios.

Stroke Risk Assessment Decision-Making Using a Machine Learning Model:Logistic-AdaBoost

Stroke is a chronic cerebrovascular disease that carries a high risk.Stroke risk assessment is of great significance in preventing,reversing and reducing the spread and the health hazards caused by stroke.Aiming to objectively predict and identify strokes,this paper proposes a new stroke risk assessment decision-making model named Logistic-AdaBoost(Logistic-AB)based on machine learning.First,the categorical boosting(CatBoost)method is used to perform feature selection for all features of stroke,and 8 main features are selected to form a new index evaluation system to predict the risk of stroke.Second,the borderline synthetic minority oversampling technique(SMOTE)algorithm is applied to transform the unbalanced stroke dataset into a balanced dataset.Finally,the stroke risk assessment decision-makingmodel Logistic-AB is constructed,and the overall prediction performance of this new model is evaluated by comparing it with ten other similar models.The comparison results show that the new model proposed in this paper performs better than the two single algorithms(logistic regression and AdaBoost)on the four indicators of recall,precision,F1 score,and accuracy,and the overall performance of the proposed model is better than that of common machine learning algorithms.The Logistic-AB model presented in this paper can more accurately predict patients’stroke risk.

Research on Maneuver Decision-Making of Multi-Agent Adversarial Game in a Random Interference Environment

The strategy evolution process of game players is highly uncertain due to random emergent situations and other external disturbances.This paper investigates the issue of strategy interaction and behavioral decision-making among game players in simulated confrontation scenarios within a random interference environment.It considers the possible risks that random disturbances may pose to the autonomous decision-making of game players,as well as the impact of participants’manipulative behaviors on the state changes of the players.A nonlinear mathematical model is established to describe the strategy decision-making process of the participants in this scenario.Subsequently,the strategy selection interaction relationship,strategy evolution stability,and dynamic decision-making process of the game players are investigated and verified by simulation experiments.The results show that maneuver-related parameters and random environmental interference factors have different effects on the selection and evolutionary speed of the agent’s strategies.Especially in a highly uncertain environment,even small information asymmetry or miscalculation may have a significant impact on decision-making.This also confirms the feasibility and effectiveness of the method proposed in the paper,which can better explain the behavioral decision-making process of the agent in the interaction process.This study provides feasibility analysis ideas and theoretical references for improving multi-agent interactive decision-making and the interpretability of the game system model.

Determination of the best materials for development and designing product using a multi-criteria decision-making

Purpose–Material selection,driven by wide and often conflicting objectives,is an important,sometimes difficult problem in material engineering.In this context,multi-criteria decision-making(MCDM)methodologies are effective.An approach of MCDM is needed to cater to criteria of material assortment simultaneously.More firms are now concerned about increasing their productivity using mathematical tools.To occupy a gap in the previous literature this research recommends an integrated MCDM and mathematical Bi-objective model for the selection of material.In addition,by using the Technique for Order Preference by Similarity to Ideal Solution(TOPSIS),the inherent ambiguities of decision-makers in paired evaluations are considered in this research.It goes on to construct a mathematical bi-objective model for determining the best item to purchase.Design/methodology/approach–The entropy perspective is implemented in this paper to evaluate the weight parameters,while the TOPSIS technique is used to determine the best and worst intermediate pipe materials for automotive exhaust system.The intermediate pipes are used to join the components of the exhaust systems.The materials usually used to manufacture intermediate pipe are SUS 436LM,SUS 430,SUS 304,SUS 436L,SUH 409 L,SUS 441 L and SUS 439L.These seven materials are evaluated based on tensile strength(TS),hardness(H),elongation(E),yield strength(YS)and cost(C).A hybrid methodology combining entropy-based criteria weighting,with the TOPSIS for alternative ranking,is pursued to identify the optimal design material for an engineered application in this paper.This study aims to help while filling the information gap in selecting the most suitable material for use in the exhaust intermediate pipes.After that,the authors searched for and considered eight materials and evaluated them on the following five criteria:(1)TS,(2)YS,(3)H,(4)E and(5)C.The first two criteria have been chosen because they can have a lot of influence on the behavior of the exhaust intermediate pipes,on their performance and on the cost.In this structure,the weights of the criteria are calculated objectively through the entropy method in order to have an unbiased assessment.This essentially measures the quantity of information each criterion contribution,indicating the relative importance of these criteria better.Subsequently,the materials were ranked using the TOPSIS method in terms of their relative performance by measuring each material from an ideal solution to determine the best alternative.The results show that SUS 309,SUS 432L and SUS 436 LM are the first three materials that the exhaust intermediate pipe optimal design should consider.Findings–The material matrix of the decision presented in Table 3 was normalized through Equation 5,as shown in Table 5,and the matrix was multiplied with weighting criteriaß_j.The obtained weighted normalized matrix V_ij is presented in Table 6.However,the ideal,worst and best value was ascertained by employing Equation 7.This study is based on the selection of material for the development of intermediate pipe using MCDM,and it involves four basic stages,i.e.method of translation criteria,screening process,method of ranking and search for methods.The selection was done through the TOPSIS method,and the criteria weight was obtained by the entropy method.The result showed that the top three materials are SUS 309,SUS 432L and SUS 436 LM,respectively.For the future work,it is suggested to select more alternatives and criteria.The comparison can also be done by using different MCDM techniques like and Choice Expressing Reality(ELECTRE),Decision-Making Trial and Evaluation Laboratory(DEMATEL)and Preference Ranking Organization Method for Enrichment Evaluation(PROMETHEE).Originality/value–The results provide important conclusions for material selection in this targeted application,verifying the employment of mutual entropy-TOPSIS methodology for a series of difficult engineering decisions in material engineering concepts that combine superior capacity with better performance as well as cost-efficiency in various engineering design.

The Spherical q-Linear Diophantine Fuzzy Multiple-Criteria Group Decision-Making Based on Differential Measure

Spherical q-linearDiophantine fuzzy sets(Sq-LDFSs)provedmore effective for handling uncertainty and vagueness in multi-criteria decision-making(MADM).It does not only cover the data in two variable parameters but is also beneficial for three parametric data.By Pythagorean fuzzy sets,the difference is calculated only between two parameters(membership and non-membership).According to human thoughts,fuzzy data can be found in three parameters(membership uncertainty,and non-membership).So,to make a compromise decision,comparing Sq-LDFSs is essential.Existing measures of different fuzzy sets do,however,can have several flaws that can lead to counterintuitive results.For instance,they treat any increase or decrease in the membership degree as the same as the non-membership degree because the uncertainty does not change,even though each parameter has a different implication.In the Sq-LDFSs comparison,this research develops the differentialmeasure(DFM).Themain goal of the DFM is to cover the unfair arguments that come from treating different types of FSs opposing criteria equally.Due to their relative positions in the attribute space and the similarity of their membership and non-membership degrees,two Sq-LDFSs formthis preference connectionwhen the uncertainty remains same in both sets.According to the degree of superiority or inferiority,two Sq-LDFSs are shown as identical,equivalent,superior,or inferior over one another.The suggested DFM’s fundamental characteristics are provided.Based on the newly developed DFM,a unique approach tomultiple criterion group decision-making is offered.Our suggestedmethod verifies the novel way of calculating the expert weights for Sq-LDFSS as in PFSs.Our proposed technique in three parameters is applied to evaluate solid-state drives and choose the optimum photovoltaic cell in two applications by taking uncertainty parameter zero.The method’s applicability and validity shown by the findings are contrasted with those obtained using various other existing approaches.To assess its stability and usefulness,a sensitivity analysis is done.

A NovelMethod for Determining Tourism Carrying Capacity in a Decision-Making Context Using q−Rung Orthopair Fuzzy Hypersoft Environment

Tourism is a popular activity that allows individuals to escape their daily routines and explore new destinations for various reasons,including leisure,pleasure,or business.A recent study has proposed a unique mathematical concept called a q−Rung orthopair fuzzy hypersoft set(q−ROFHS)to enhance the formal representation of human thought processes and evaluate tourism carrying capacity.This approach can capture the imprecision and ambiguity often present in human perception.With the advanced mathematical tools in this field,the study has also incorporated the Einstein aggregation operator and score function into the q−ROFHS values to supportmultiattribute decision-making algorithms.By implementing this technique,effective plans can be developed for social and economic development while avoiding detrimental effects such as overcrowding or environmental damage caused by tourism.A case study of selected tourism carrying capacity will demonstrate the proposed methodology.

Investigating the Creation of Cultural Atmospheres in Physical Bookstores Within the Context of Scene-Based Consumption:A Perspective Based on the Ways of Seeing

In an era of scene-based consumption,the essence of operating a bookstore lies in accepting and enabling the bookstore to play its role as a cultural medium for browsing and appreciating books,which in turn fosters the development of a distinctive bookstore culture.This new type of consumption context has led to an evolution in the book-reading culture in physical bookstores that is characterized by a shift from a paradigm of passive reading to one where the emphasis is on interactive viewing.This transition has laid the foundation for the creation of cultural atmospheres in bookstores,and it highlights the visual interactions that now exist between readers and books as well as with other related cultural industries.The dominant and fundamental logic behind this process is symbiosis,experience,aesthetics,immersion,and creativity.However,when a form of culture that focuses on consumption-oriented browsing begins to overshadow knowledge acquisition during the process of book reading,the cultural essence of bookstores is likely to be diminished.Therefore,the cultural essence within the scene-based consumption context should be enhanced by creating innovative viewing activities that showcase the cultural and emotional implications inherent in the scene itself,and thus help to align the identity of the bookstore with its in-situ cultural space.

UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

Facial aesthetics is shaped not only by genetic predispositions but also by the cultural norms and values

The positioning of teeth is of significant importance,both in terms of function and aesthetics.Aesthetics is a subjective matter,and there is often a discrepancy between the perceptions of patients and those of medical professionals.The act of wearing a mask has been demonstrated to impair the ability to evaluate facial attractiveness,thereby reaffirming the visual importance of the oral cavity in the context of facial aesthetics.The notion that a face perceived as beautiful is inherently exceptional is a fallacy.An average face is defined as one that exhibits characteristics that are common to the group.However,cultural mutations occur at a faster rate than genetic mutations.With regard to changes in facial aesthetics,cultural differences have a more immediate effect than genetic mutations.The advent of the internet meme may herald the advent of an era in which the average face that defines a beautiful face is determined by the internet.

Analysis of the Reform of Ideological and Political Education in College English Curriculum from the Perspective of“Cultural Confidence”

With the rapid development of the education industry,higher requirements have been put forward for college English education and teaching,accelerating the pace of college English reform.Issues such as how to integrate knowledge transmission,language expression skill improvement,cultural element extraction,and ideological and political education,and present the role of curriculum education function have attracted attention.In the era of informatization,college students’thinking has undergone certain changes and gradually developed towards diversification.Therefore,universities should start from the perspective of cultural confidence,extract valuable ideological and political elements,and explore effective tourism ideological and political teaching methods.While helping college students enhance their cultural confidence,it is also beneficial for them to better inherit traditional Chinese culture.This article conducts an in-depth exploration of ideological and political education in college English courses from the perspective of“cultural confidence”and uses scientific and effective measures to solve the problems encountered,aiming to provide valuable guidelines for relevant researchers.

Implementation of an international medical student pen-pal club:survey outcomes of perceptions in cultural competency and global health

Background:Pen-pal clubs(PPC)are used worldwide for students to learn about different cultures and other skillsets without the need for travel.Many medical students are interested in global health opportunities abroad but costs,scheduling,and other barriers allow few to participate in such experiences.It is important that medical students have nuanced global medical perspectives and can contribute to the global medical community.Objective:The purpose of this study is to demonstrate that an international medical student PPC improves medical students'perspectives of cultural competency and global health engagement.Methods:In 2021,a novel medical student PPC was established that began between an American and Japanese medical school.Following a shareholders meeting,it was decided that the number of medical schools involved globally be expanded through previous institutional affiliations and online presences.In total,the club connected 50 American medical students and 52 medical students from 17 high-and middle-income countries.The primary form of communication was online;pen-pals were encouraged to communicate monthly using provided topics,although frequency and way of communication was their discretion.In February 2022,American PPC members were emailed a qualitative survey to assess the PPC's impact.Results:The survey was completed by 42%of American PPC members,95%of which were 22-26 years.Participants were preclinical medical students,60%whom were female and the majority either white(47%)or Asian(43%).Overall,the PPC positively influenced American medical students'perception of global medicine,medical education,and their cultural competency after joining the PPC compared to prior(P=0.004).Conclusion:PPCs encourage medical students to think from a global perspective and foster open-mindedness within varying social and cultural contexts.Having a global communication platform for students during medical school education may be an additional way to train aspiring global leaders.

Discussion about Tourism Development of Agricultural Cultural Heritage in Xiajin County of Shandong Province

[Objectives]To discuss the protection and utilization of agricultural cultural heritage in Xiajin County in the context of deep integration of culture and tourism.With the advancement of the process of revitalizing villages through culture and tourism,agricultural cultural heritage has gradually attracted wide attention from all walks of life.This paper is intended to provide new ideas and strategies for the development of local cultural tourism through in-depth analysis of agricultural cultural heritage resources in Xiajin County.[Methods]Using the method of literature research,this paper systematically sorted out the historical background,current situation and value of agricultural cultural heritage in Xiajin County.Besides,the agricultural cultural heritage resources in Xiajin County were comprehensively evaluated using the 3-3-6 evaluation method.On this basis,combined with the theory of industrial convergence and sustainable development,it came up with some specific suggestions on the tourism development of agricultural cultural heritage in Xiajin County.[Results]Through the in-depth evaluation of agricultural cultural heritage resources in Xiajin County,it is found that it has rich historical and cultural heritage and unique tourism value.However,there are still some problems in protection and utilization.In view of the problems,it recommended to attach importance to the inheritance of Xiajin agricultural cultural heritage,develop characteristic heritage tourism and improve relevant supporting facilities.[Conclusions]Deeply excavating the essence of agricultural cultural heritage in Xiajin County and organically combining it with modern tourism is an important way to realize the sustainable development of local cultural tourism.The recommendations are expected to provide reference for the development of agricultural heritage tourism in Xiajin County and other regions,and help to promote the deep integration of culture and tourism,and promote rural revitalization and cultural inheritance.

The Innovative Expression of Traditional Chinese Cultural Archetypes in Animated Films: Establishing a Reliable, Admirable, and Respectable Image of China

China’s domestic animation industry is deeply rooted in its rich traditional cultural heritage.While continuously exploring and showcasing the unique charm of such cultural heritage through storytelling,imagery establishment,and spirit creation,Chinese animation also seamlessly integrates modern aesthetic characteristics and cultural values into its development within the context of the new era.By adopting a contemporary perspective,it innovatively expresses the essence of traditional culture while striving to shape and present a reliable,admirable and respectable image of China.Chinese animation aims to create credible contemporary animation images by drawing inspiration from traditional Chinese cultural archetypes.It also seeks to revitalize admirable traditional cultural imagery using vibrant and prevailing ACGN visuals,while shaping credible characters with richer cultural connotations and crafting stories with more enchanting plots to convey the spiritual essence of the Chinese nation.By establishing reliable,admirable and respectable animation images,the Chinese animation industry strives to enhance its capability to“tell China’s stories well and make the voice of China heard,”to better promote the image of China in the new era from a global perspective.