Multi-UAV cooperative maneuver decision-making for pursuitevasion using improved MADRL

Aiming at the problem of multi-UAV pursuit-evasion confrontation, a UAV cooperative maneuver method based on an improved multi-agent deep reinforcement learning(MADRL) is proposed. In this method, an improved Comm Net network based on a communication mechanism is introduced into a deep reinforcement learning algorithm to solve the multi-agent problem. A layer of gated recurrent unit(GRU) is added to the actor-network structure to remember historical environmental states. Subsequently,another GRU is designed as a communication channel in the Comm Net core network layer to refine communication information between UAVs. Finally, the simulation results of the algorithm in two sets of scenarios are given, and the results show that the method has good effectiveness and applicability.

Evolutionary Decision-Making and Planning for Autonomous Driving Based on Safe and Rational Exploration and Exploitation

Decision-making and motion planning are extremely important in autonomous driving to ensure safe driving in a real-world environment.This study proposes an online evolutionary decision-making and motion planning framework for autonomous driving based on a hybrid data-and model-driven method.First,a data-driven decision-making module based on deep reinforcement learning(DRL)is developed to pursue a rational driving performance as much as possible.Then,model predictive control(MPC)is employed to execute both longitudinal and lateral motion planning tasks.Multiple constraints are defined according to the vehicle’s physical limit to meet the driving task requirements.Finally,two principles of safety and rationality for the self-evolution of autonomous driving are proposed.A motion envelope is established and embedded into a rational exploration and exploitation scheme,which filters out unreasonable experiences by masking unsafe actions so as to collect high-quality training data for the DRL agent.Experiments with a high-fidelity vehicle model and MATLAB/Simulink co-simulation environment are conducted,and the results show that the proposed online-evolution framework is able to generate safer,more rational,and more efficient driving action in a real-world environment.

Toward Trustworthy Decision-Making for Autonomous Vehicles:A Robust Reinforcement Learning Approach with Safety Guarantees

While autonomous vehicles are vital components of intelligent transportation systems,ensuring the trustworthiness of decision-making remains a substantial challenge in realizing autonomous driving.Therefore,we present a novel robust reinforcement learning approach with safety guarantees to attain trustworthy decision-making for autonomous vehicles.The proposed technique ensures decision trustworthiness in terms of policy robustness and collision safety.Specifically,an adversary model is learned online to simulate the worst-case uncertainty by approximating the optimal adversarial perturbations on the observed states and environmental dynamics.In addition,an adversarial robust actor-critic algorithm is developed to enable the agent to learn robust policies against perturbations in observations and dynamics.Moreover,we devise a safety mask to guarantee the collision safety of the autonomous driving agent during both the training and testing processes using an interpretable knowledge model known as the Responsibility-Sensitive Safety Model.Finally,the proposed approach is evaluated through both simulations and experiments.These results indicate that the autonomous driving agent can make trustworthy decisions and drastically reduce the number of collisions through robust safety policies.

Orientation and Decision-Making for Soccer Based on Sports Analytics and AI:A Systematic Review

Due to ever-growing soccer data collection approaches and progressing artificial intelligence(AI) methods, soccer analysis, evaluation, and decision-making have received increasing interest from not only the professional sports analytics realm but also the academic AI research community. AI brings gamechanging approaches for soccer analytics where soccer has been a typical benchmark for AI research. The combination has been an emerging topic. In this paper, soccer match analytics are taken as a complete observation-orientation-decision-action(OODA) loop.In addition, as in AI frameworks such as that for reinforcement learning, interacting with a virtual environment enables an evolving model. Therefore, both soccer analytics in the real world and virtual domains are discussed. With the intersection of the OODA loop and the real-virtual domains, available soccer data, including event and tracking data, and diverse orientation and decisionmaking models for both real-world and virtual soccer matches are comprehensively reviewed. Finally, some promising directions in this interdisciplinary area are pointed out. It is claimed that paradigms for both professional sports analytics and AI research could be combined. Moreover, it is quite promising to bridge the gap between the real and virtual domains for soccer match analysis and decision-making.

Ethical Decision-Making Framework Based on Incremental ILP Considering Conflicts

Humans are experiencing the inclusion of artificial agents in their lives,such as unmanned vehicles,service robots,voice assistants,and intelligent medical care.If the artificial agents cannot align with social values or make ethical decisions,they may not meet the expectations of humans.Traditionally,an ethical decision-making framework is constructed by rule-based or statistical approaches.In this paper,we propose an ethical decision-making framework based on incremental ILP(Inductive Logic Programming),which can overcome the brittleness of rule-based approaches and little interpretability of statistical approaches.As the current incremental ILP makes it difficult to solve conflicts,we propose a novel ethical decision-making framework considering conflicts in this paper,which adopts our proposed incremental ILP system.The framework consists of two processes:the learning process and the deduction process.The first process records bottom clauses with their score functions and learns rules guided by the entailment and the score function.The second process obtains an ethical decision based on the rules.In an ethical scenario about chatbots for teenagers’mental health,we verify that our framework can learn ethical rules and make ethical decisions.Besides,we extract incremental ILP from the framework and compare it with the state-of-the-art ILP systems based on ASP(Answer Set Programming)focusing on conflict resolution.The results of comparisons show that our proposed system can generate better-quality rules than most other systems.

Roles of N-cadherin in cerebral cortical development:cooperation with membrane trafficking and actin cytoskeletal regulation

Cell adhesion plays pivotal roles in the morphogenesis of multicellular organisms.Epithelial cells form several types of cell-to-cell adhesion,including zonula occludens(tight junctions),zonula adhaerens(adherens junctions),and macula adhaerens(desmosomes).Although these adhesion complexes are basically observed only in epithelial cells,cadherins,which are the major cell adhesion molecules of adherens junctions,are expressed in both epithelial and non-epithelial tissues,including neural tissues(Kawauchi,2012).The cadherin superfamily consists of more than 100 members,but classic cadherins.

Stroke Risk Assessment Decision-Making Using a Machine Learning Model:Logistic-AdaBoost

Stroke is a chronic cerebrovascular disease that carries a high risk.Stroke risk assessment is of great significance in preventing,reversing and reducing the spread and the health hazards caused by stroke.Aiming to objectively predict and identify strokes,this paper proposes a new stroke risk assessment decision-making model named Logistic-AdaBoost(Logistic-AB)based on machine learning.First,the categorical boosting(CatBoost)method is used to perform feature selection for all features of stroke,and 8 main features are selected to form a new index evaluation system to predict the risk of stroke.Second,the borderline synthetic minority oversampling technique(SMOTE)algorithm is applied to transform the unbalanced stroke dataset into a balanced dataset.Finally,the stroke risk assessment decision-makingmodel Logistic-AB is constructed,and the overall prediction performance of this new model is evaluated by comparing it with ten other similar models.The comparison results show that the new model proposed in this paper performs better than the two single algorithms(logistic regression and AdaBoost)on the four indicators of recall,precision,F1 score,and accuracy,and the overall performance of the proposed model is better than that of common machine learning algorithms.The Logistic-AB model presented in this paper can more accurately predict patients’stroke risk.

Effect of distribution of fines on evolution of cooperation in spatial public goods game

In the realm of public goods game,punishment,as a potent tool,stands out for fostering cooperation.While it effectively addresses the first-order free-rider problem,the associated costs can be substantial.Punishers incur expenses in imposing sanctions,while defectors face fines.Unfortunately,these monetary elements seemingly vanish into thin air,representing a loss to the system itself.However,by virtue of the redistribution of fines to cooperators and punishers,not only can we mitigate this loss,but the rewards for these cooperative individuals can be enhanced.Based upon this premise,this paper introduces a fine distribution mechanism to the traditional pool punishment model.Under identical parameter settings,by conducting a comparative experiment with the conventional punishment model,the paper aims to investigate the impact of fine distribution on the evolution of cooperation in spatial public goods game.The experimental results clearly demonstrate that,in instances where the punishment cost is prohibitively high,the cooperative strategies of the traditional pool punishment model may completely collapse.However,the model enriched with fine distribution manages to sustain a considerable number of cooperative strategies,thus highlighting its effectiveness in promoting and preserving cooperation,even in the face of substantial punishment cost.

Determination of the best materials for development and designing product using a multi-criteria decision-making

Purpose–Material selection,driven by wide and often conflicting objectives,is an important,sometimes difficult problem in material engineering.In this context,multi-criteria decision-making(MCDM)methodologies are effective.An approach of MCDM is needed to cater to criteria of material assortment simultaneously.More firms are now concerned about increasing their productivity using mathematical tools.To occupy a gap in the previous literature this research recommends an integrated MCDM and mathematical Bi-objective model for the selection of material.In addition,by using the Technique for Order Preference by Similarity to Ideal Solution(TOPSIS),the inherent ambiguities of decision-makers in paired evaluations are considered in this research.It goes on to construct a mathematical bi-objective model for determining the best item to purchase.Design/methodology/approach–The entropy perspective is implemented in this paper to evaluate the weight parameters,while the TOPSIS technique is used to determine the best and worst intermediate pipe materials for automotive exhaust system.The intermediate pipes are used to join the components of the exhaust systems.The materials usually used to manufacture intermediate pipe are SUS 436LM,SUS 430,SUS 304,SUS 436L,SUH 409 L,SUS 441 L and SUS 439L.These seven materials are evaluated based on tensile strength(TS),hardness(H),elongation(E),yield strength(YS)and cost(C).A hybrid methodology combining entropy-based criteria weighting,with the TOPSIS for alternative ranking,is pursued to identify the optimal design material for an engineered application in this paper.This study aims to help while filling the information gap in selecting the most suitable material for use in the exhaust intermediate pipes.After that,the authors searched for and considered eight materials and evaluated them on the following five criteria:(1)TS,(2)YS,(3)H,(4)E and(5)C.The first two criteria have been chosen because they can have a lot of influence on the behavior of the exhaust intermediate pipes,on their performance and on the cost.In this structure,the weights of the criteria are calculated objectively through the entropy method in order to have an unbiased assessment.This essentially measures the quantity of information each criterion contribution,indicating the relative importance of these criteria better.Subsequently,the materials were ranked using the TOPSIS method in terms of their relative performance by measuring each material from an ideal solution to determine the best alternative.The results show that SUS 309,SUS 432L and SUS 436 LM are the first three materials that the exhaust intermediate pipe optimal design should consider.Findings–The material matrix of the decision presented in Table 3 was normalized through Equation 5,as shown in Table 5,and the matrix was multiplied with weighting criteriaß_j.The obtained weighted normalized matrix V_ij is presented in Table 6.However,the ideal,worst and best value was ascertained by employing Equation 7.This study is based on the selection of material for the development of intermediate pipe using MCDM,and it involves four basic stages,i.e.method of translation criteria,screening process,method of ranking and search for methods.The selection was done through the TOPSIS method,and the criteria weight was obtained by the entropy method.The result showed that the top three materials are SUS 309,SUS 432L and SUS 436 LM,respectively.For the future work,it is suggested to select more alternatives and criteria.The comparison can also be done by using different MCDM techniques like and Choice Expressing Reality(ELECTRE),Decision-Making Trial and Evaluation Laboratory(DEMATEL)and Preference Ranking Organization Method for Enrichment Evaluation(PROMETHEE).Originality/value–The results provide important conclusions for material selection in this targeted application,verifying the employment of mutual entropy-TOPSIS methodology for a series of difficult engineering decisions in material engineering concepts that combine superior capacity with better performance as well as cost-efficiency in various engineering design.

Discreet investors exert greater influence on cooperation in the public goods game

This paper studies the evolutionary process of cooperative behavior in a public goods game model with heterogeneous investment strategies in square lattices.In the proposed model,players are divided into defectors,cooperators and discreet investors.Among these,defectors do not participate in investing,discreet investors make heterogeneous investments based on the investment behavior and cooperation value of their neighbors,and cooperators invest equally in each neighbor.In real life,heterogeneous investment is often accompanied by time or economic costs.The discreet investors in this paper pay a certain price to obtain their neighbors'investment behavior and cooperation value,which quantifies the time and economic costs of the heterogeneous investment process.The results of Monte Carlo simulation experiments in this study show that discreet investors can effectively resist the invasion of the defectors,form a stable cooperative group and expand the cooperative advantage in evolution.However,when discreet investors pay too high a price,they lose their strategic advantage.The results in this paper help us understand the role of heterogeneous investment in promoting and maintaining human social cooperation.

The Spherical q-Linear Diophantine Fuzzy Multiple-Criteria Group Decision-Making Based on Differential Measure

Spherical q-linearDiophantine fuzzy sets(Sq-LDFSs)provedmore effective for handling uncertainty and vagueness in multi-criteria decision-making(MADM).It does not only cover the data in two variable parameters but is also beneficial for three parametric data.By Pythagorean fuzzy sets,the difference is calculated only between two parameters(membership and non-membership).According to human thoughts,fuzzy data can be found in three parameters(membership uncertainty,and non-membership).So,to make a compromise decision,comparing Sq-LDFSs is essential.Existing measures of different fuzzy sets do,however,can have several flaws that can lead to counterintuitive results.For instance,they treat any increase or decrease in the membership degree as the same as the non-membership degree because the uncertainty does not change,even though each parameter has a different implication.In the Sq-LDFSs comparison,this research develops the differentialmeasure(DFM).Themain goal of the DFM is to cover the unfair arguments that come from treating different types of FSs opposing criteria equally.Due to their relative positions in the attribute space and the similarity of their membership and non-membership degrees,two Sq-LDFSs formthis preference connectionwhen the uncertainty remains same in both sets.According to the degree of superiority or inferiority,two Sq-LDFSs are shown as identical,equivalent,superior,or inferior over one another.The suggested DFM’s fundamental characteristics are provided.Based on the newly developed DFM,a unique approach tomultiple criterion group decision-making is offered.Our suggestedmethod verifies the novel way of calculating the expert weights for Sq-LDFSS as in PFSs.Our proposed technique in three parameters is applied to evaluate solid-state drives and choose the optimum photovoltaic cell in two applications by taking uncertainty parameter zero.The method’s applicability and validity shown by the findings are contrasted with those obtained using various other existing approaches.To assess its stability and usefulness,a sensitivity analysis is done.

Role Dynamic Allocation of Human-Robot Cooperation Based on Reinforcement Learning in an Installation of Curtain Wall

A real-time adaptive roles allocation method based on reinforcement learning is proposed to improve humanrobot cooperation performance for a curtain wall installation task.This method breaks the traditional idea that the robot is regarded as the follower or only adjusts the leader and the follower in cooperation.In this paper,a self-learning method is proposed which can dynamically adapt and continuously adjust the initiative weight of the robot according to the change of the task.Firstly,the physical human-robot cooperation model,including the role factor is built.Then,a reinforcement learningmodel that can adjust the role factor in real time is established,and a reward and actionmodel is designed.The role factor can be adjusted continuously according to the comprehensive performance of the human-robot interaction force and the robot’s Jerk during the repeated installation.Finally,the roles adjustment rule established above continuously improves the comprehensive performance.Experiments of the dynamic roles allocation and the effect of the performance weighting coefficient on the result have been verified.The results show that the proposed method can realize the role adaptation and achieve the dual optimization goal of reducing the sum of the cooperator force and the robot’s Jerk.

A NovelMethod for Determining Tourism Carrying Capacity in a Decision-Making Context Using q−Rung Orthopair Fuzzy Hypersoft Environment

Tourism is a popular activity that allows individuals to escape their daily routines and explore new destinations for various reasons,including leisure,pleasure,or business.A recent study has proposed a unique mathematical concept called a q−Rung orthopair fuzzy hypersoft set(q−ROFHS)to enhance the formal representation of human thought processes and evaluate tourism carrying capacity.This approach can capture the imprecision and ambiguity often present in human perception.With the advanced mathematical tools in this field,the study has also incorporated the Einstein aggregation operator and score function into the q−ROFHS values to supportmultiattribute decision-making algorithms.By implementing this technique,effective plans can be developed for social and economic development while avoiding detrimental effects such as overcrowding or environmental damage caused by tourism.A case study of selected tourism carrying capacity will demonstrate the proposed methodology.

UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

Enhancing Mutual Trust and Tapping into New Areas and Potentials for Bilateral Cooperation——Exclusive Interview with Namibian Ambassador to China,Elia George Kaiyamo

The 2024 Forum on ChinaAfrica Cooperation Summit was held in Beijing from September 4 to 6.Economic and trade cooperation serves as the"ballast stone"and"propeller"of China-Africa relations.During an exclusive interview with China's Foreign Trade conducted in Beijing recently,Namibian Ambassador to China,Elia George Kaiyamo,discussed Namibian-China bilateral trade and twoway investment,stating that since the establishment of diplomatic relations in1990,China and Namibia have made remarkable achievements in both economic and trade cooperation,which have become the most dynamic and potential components of bilateral relations.

BRICS seeks trade development and standards cooperation

The BRICS Economic and Trade Forum was held on October 28 in Beijing, co-organized by the China Council for the Promotion of International Trade(CCPIT), China General Technology(Group) Holding Co., Ltd., and the Chinese chapter of the BRICS Business Council.The forum focused on trade development and standards cooperation among BRICS countries, and aimed to implement the outcomes of the BRICS Leaders' Meeting. It was attended by more than 500 representatives from ISO, standardization administrative departments of BRICS countries, business councils, enterprises, and foreign embassies in China in person or online.

Resource Allocation for IRS Assistedmm Wave Wireless Powered Sensor Networks with User Cooperation

In this paper,we investigate IRS-aided user cooperation(UC)scheme in millimeter wave(mmWave)wirelesspowered sensor networks(WPSN),where two single-antenna users are wireless powered in the wireless energy transfer(WET)phase first and then cooperatively transmit information to a hybrid access point(AP)in the wireless information transmission(WIT)phase,following which the IRS is deployed to enhance the system performance of theWET andWIT.We maximized the weighted sum-rate problem by jointly optimizing the transmit time slots,power allocations,and the phase shifts of the IRS.Due to the non-convexity of the original problem,a semidefinite programming relaxation-based approach is proposed to convert the formulated problem to a convex optimization framework,which can obtain the optimal global solution.Simulation results demonstrate that the weighted sum throughput of the proposed UC scheme outperforms the non-UC scheme whether equipped with IRS or not.

Effect of comprehensive management combined with cognitive intervention on patient cooperation and complications during digestive endoscopy

BACKGROUND As lifestyles continue to change worldwide,the incidence of digestive tract carcinoma has gradually increased.Digestive endoscopy is an important tool that can assist in the diagnosis,treatment,and surgical intervention for this disease.However,the examination process is affected by many factors,and patient cooperation is often poor,which can increase the risk of complications.AIM To explore the effects of integrated management and cognitive intervention on cooperation and complications in patients undergoing endoscopy for early gastrointestinal neoplasms.METHODS A total of 354 patients with early stage gastrointestinal cancer who underwent digestive endoscopy procedures between January and December 2023 at our hospital were divided into observation and control groups(177 patients in each group)in a randomized controlled blind trial.The control group received routine interventions,while the observation group received comprehensive integrated management combined with cognitive interventions.We compared the changes in adverse mood,discomfort,examination time,cooperation with the examination,and complications before and after the intervention between the two groups.RESULTS The self-rated anxiety and depression scale scores were lower in the observation group than in the control group(P<0.05).The visual analog scale scores for discomfort during intubation and examination were also lower in the observation group than in the control group(P<0.05).Furthermore,the examination time was shorter in the observation group than in the control group(P<0.05),and the degree of cooperation(94.35%)was higher in the observation group than in the control group(84.75%;P<0.05).Lastly,the incidence rates of gastrointestinal adverse reactions(10.17%vs 20.34%),choking agitation(14.69%vs 24.86%),abdominal pain(8.47%vs 18.08%),and muscle tension(5.08%vs 14.12%)were all lower in the observation group than in the control group(P<0.05).CONCLUSION Integrated management and cognitive intervention in early gastrointestinal neoplasm endoscopy alleviate mood,reduce discomfort,shorten examinations,improve cooperation,and reduce complications.

On the Cooperation Between China and the Non-Aligned Movement in the Field of the Right to Development and its Prospects

China and the Non-Aligned Movement share the same goals,a common code of conduct,and similar ideas in protecting the right to development,and the two have a solid foundation for cooper-ation.Both emphasize that the right to development is a basic human right,strive to elevate the right to development to a mainstream hu-man right,and jointly advocate placing the right to development at the center of the agenda.They work together to enhance the strategic sta-tus of the right to development.Both of them have participated in the formulation of the Declaration on the Right to Development,and col-laborated to improve the Declaration.They have also jointly proposed the resolution on the right to development,and supported the drafting of the Convention on the Right to Development to advance the codifi-cation of the right to development.Both of them uphold South-South cooperation and promote North-South dialogue and cooperation.They have established a support mechanism to promote international cooperation on the right to development in a coordinated manner.The cooperation between China and the Non-Aligned Movement in pro-tecting the right to development has broken the past Western-centered paradigm of human rights development,broadened the international perspective of the human rights cause,and played a crucial role in the formation of international human rights norms.In the future,oppor-tunities and challenges coexist for cooperation between the two sides,with promising prospects.China’s cooperation with the Non-Aligned Movement in the protection of the right to development has accumulat-ed valuable and inspirational experiences for the human rights cause of developing countries and the building of the international human rights system.。

Influence of social media on maternal decision-making and breastfeeding practices

Breastfeeding practices are influenced by multifactorial determinants including individual characteristics,external support systems,and media influences.This commentary emphasizes such complex factors influencing breastfeeding practices.Potential methodological limitations and the need for diverse sampling in studying breastfeeding practices are highlighted.Further research must explore the interplay between social influences,cultural norms,government policies,and individual factors in shaping maternal breastfeeding decisions.