基于Multi-Agent的无人机集群体系自主作战系统设计

针对无人集群自主作战体系设计中的关键问题,提出基于Multi-Agent的无人集群自主作战系统设计方法。建立无人集群各节点的Agent模型及其推演规则;对于仿真系统模块化和通用化的需求,设计系统互操作式接口和无人集群自主作战的交互关系;开展无人集群系统仿真推演验证。仿真结果表明,所提设计方案不仅能够有效开展并完成自主作战网络生成-集群演化-效能评估的全过程动态演示验证,而且能够通过重复随机试验进一步评估无人集群的协同作战效能,最后总结了集群协同作战的策略和经验。

基于Multi-Agent的水电站变压器故障诊断系统

为了精准、快速完成水电站变压器的故障诊断,设计基于Multi-Agent的水电站变压器故障诊断系统。变压器状态监控agent将检测到的变压器故障信息发送给系统管理agent,系统管理agent通过通信agent将变压器故障信息发送给变压器故障诊断agent,变压器故障诊断agent利用小波变换方法提取变压器故障特征,并将其作为IFOA-SVM模型输入,完成变压器故障分类后,获取变压器故障诊断结果,该结果通过通信agent显示给用户。实验表明,该系统可有效诊断变压器故障诊断,诊断成功率受系统故障信息丢失率的影响较小,诊断耗时、耗能小,并具有较高故障诊断成功率。

UAV-Assisted Dynamic Avatar Task Migration for Vehicular Metaverse Services: A Multi-Agent Deep Reinforcement Learning Approach

Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metaverses. However, avatar tasks include a multitude of human-to-avatar and avatar-to-avatar interactive applications, e.g., augmented reality navigation,which consumes intensive computing resources. It is inefficient and impractical for vehicles to process avatar tasks locally. Fortunately, migrating avatar tasks to the nearest roadside units(RSU)or unmanned aerial vehicles(UAV) for execution is a promising solution to decrease computation overhead and reduce task processing latency, while the high mobility of vehicles brings challenges for vehicles to independently perform avatar migration decisions depending on current and future vehicle status. To address these challenges, in this paper, we propose a novel avatar task migration system based on multi-agent deep reinforcement learning(MADRL) to execute immersive vehicular avatar tasks dynamically. Specifically, we first formulate the problem of avatar task migration from vehicles to RSUs/UAVs as a partially observable Markov decision process that can be solved by MADRL algorithms. We then design the multi-agent proximal policy optimization(MAPPO) approach as the MADRL algorithm for the avatar task migration problem. To overcome slow convergence resulting from the curse of dimensionality and non-stationary issues caused by shared parameters in MAPPO, we further propose a transformer-based MAPPO approach via sequential decision-making models for the efficient representation of relationships among agents. Finally, to motivate terrestrial or non-terrestrial edge servers(e.g., RSUs or UAVs) to share computation resources and ensure traceability of the sharing records, we apply smart contracts and blockchain technologies to achieve secure sharing management. Numerical results demonstrate that the proposed approach outperforms the MAPPO approach by around 2% and effectively reduces approximately 20% of the latency of avatar task execution in UAV-assisted vehicular Metaverses.

Finite-time Prescribed Performance Time-Varying Formation Control for Second-Order Multi-Agent Systems With Non-Strict Feedback Based on a Neural Network Observer

This paper studies the problem of time-varying formation control with finite-time prescribed performance for nonstrict feedback second-order multi-agent systems with unmeasured states and unknown nonlinearities.To eliminate nonlinearities,neural networks are applied to approximate the inherent dynamics of the system.In addition,due to the limitations of the actual working conditions,each follower agent can only obtain the locally measurable partial state information of the leader agent.To address this problem,a neural network state observer based on the leader state information is designed.Then,a finite-time prescribed performance adaptive output feedback control strategy is proposed by restricting the sliding mode surface to a prescribed region,which ensures that the closed-loop system has practical finite-time stability and that formation errors of the multi-agent systems converge to the prescribed performance bound in finite time.Finally,a numerical simulation is provided to demonstrate the practicality and effectiveness of the developed algorithm.

Current perspectives of viral hepatitis

Viral hepatitis represents a major danger to public health,and is a globally leading cause of death.The five liver-specific viruses:Hepatitis A virus,hepatitis B virus,hepatitis C virus,hepatitis D virus,and hepatitis E virus,each have their own unique epidemiology,structural biology,transmission,endemic patterns,risk of liver complications,and response to antiviral therapies.There remain few options for treatment,in spite of the increasing prevalence of viral-hepatitiscaused liver disease.Furthermore,chronic viral hepatitis is a leading worldwide cause of both liver-related morbidity and mortality,even though effective treatments are available that could reduce or prevent most patients’complications.In 2016,the World Health Organization released its plan to eliminate viral hepatitis as a public health threat by the year 2030,along with a discussion of current gaps and prospects for both regional and global eradication of viral hepatitis.Today,treatment is sufficiently able to prevent the disease from reaching advanced phases.However,future therapies must be extremely safe,and should ideally limit the period of treatment necessary.A better understanding of pathogenesis will prove beneficial in the development of potential treatment strategies targeting infections by viral hepatitis.This review aims to summarize the current state of knowledge on each type of viral hepatitis,together with major innovations.

Discovering Latent Variables for the Tasks With Confounders in Multi-Agent Reinforcement Learning

Efficient exploration in complex coordination tasks has been considered a challenging problem in multi-agent reinforcement learning(MARL). It is significantly more difficult for those tasks with latent variables that agents cannot directly observe. However, most of the existing latent variable discovery methods lack a clear representation of latent variables and an effective evaluation of the influence of latent variables on the agent. In this paper, we propose a new MARL algorithm based on the soft actor-critic method for complex continuous control tasks with confounders. It is called the multi-agent soft actor-critic with latent variable(MASAC-LV) algorithm, which uses variational inference theory to infer the compact latent variables representation space from a large amount of offline experience.Besides, we derive the counterfactual policy whose input has no latent variables and quantify the difference between the actual policy and the counterfactual policy via a distance function. This quantified difference is considered an intrinsic motivation that gives additional rewards based on how much the latent variable affects each agent. The proposed algorithm is evaluated on two collaboration tasks with confounders, and the experimental results demonstrate the effectiveness of MASAC-LV compared to other baseline algorithms.

A survey on multi-agent reinforcement learning and its application

Multi-agent reinforcement learning(MARL)has been a rapidly evolving field.This paper presents a comprehensive survey of MARL and its applications.We trace the historical evolution of MARL,highlight its progress,and discuss related survey works.Then,we review the existing works addressing inherent challenges and those focusing on diverse applications.Some representative stochastic games,MARL means,spatial forms of MARL,and task classification are revisited.We then conduct an in-depth exploration of a variety of challenges encountered in MARL applications.We also address critical operational aspects,such as hyperparameter tuning and computational complexity,which are pivotal in practical implementations of MARL.Afterward,we make a thorough overview of the applications of MARL to intelligent machines and devices,chemical engineering,biotechnology,healthcare,and societal issues,which highlights the extensive potential and relevance of MARL within both current and future technological contexts.Our survey also encompasses a detailed examination of benchmark environments used in MARL research,which are instrumental in evaluating MARL algorithms and demonstrate the adaptability of MARL to diverse application scenarios.In the end,we give our prospect for MARL and discuss their related techniques and potential future applications.

CoopAI-Route: DRL Empowered Multi-Agent Cooperative System for Efficient QoS-Aware Routing for Network Slicing in Multi-Domain SDN

The emergence of beyond 5G networks has the potential for seamless and intelligent connectivity on a global scale.Network slicing is crucial in delivering services for different,demanding vertical applications in this context.Next-generation applications have time-sensitive requirements and depend on the most efficient routing path to ensure packets reach their intended destinations.However,the existing IP(Internet Protocol)over a multi-domain network faces challenges in enforcing network slicing due to minimal collaboration and information sharing among network operators.Conventional inter-domain routing methods,like Border Gateway Protocol(BGP),cannot make routing decisions based on performance,which frequently results in traffic flowing across congested paths that are never optimal.To address these issues,we propose CoopAI-Route,a multi-agent cooperative deep reinforcement learning(DRL)system utilizing hierarchical software-defined networks(SDN).This framework enforces network slicing in multi-domain networks and cooperative communication with various administrators to find performance-based routes in intra-and inter-domain.CoopAI-Route employs the Distributed Global Topology(DGT)algorithm to define inter-domain Quality of Service(QoS)paths.CoopAI-Route uses a DRL agent with a message-passing multi-agent Twin-Delayed Deep Deterministic Policy Gradient method to ensure optimal end-to-end routes adapted to the specific requirements of network slicing applications.Our evaluation demonstrates CoopAI-Route’s commendable performance in scalability,link failure handling,and adaptability to evolving topologies compared to state-of-the-art methods.

Assessment of public perspectives and barriers towards dengue preventive practices using the Health Belief Model in Puducherry,India:A cross-sectional study

Objective:To assess the perspectives and barriers towards dengue preventive practices among the residents of Puducherry,India.Methods:A cross-sectional survey was conducted in 300 households in Puducherry,using a population-proportionate(7:3)distribution from urban and rural areas by grid sampling.One adult interview per household was conducted and the participants were selected using a KISH grid.A semi-structured questionnaire based on the Health Belief Model(HBM)with additional questions on knowledge assessment was used.Knowledge was assessed based on the correctness of answers and the HBM scores were calculated on a 5-point Likert scale.Participants were categorized based on the median score under each domain.Logistic regression was used for adjusted analysis and models were built to predict the performances in each domain.Results:Four percent of the participants lacked basic knowledge regarding dengue transmission.While 208(69.3%)participants did not consider themselves at risk of contracting dengue within the next year,majority perceived dengue as a disease with low severity.Around 49.3%(148)were skeptical about the benefit of time and money spent on dengue prevention.Inadequate government efforts were stated as the major barrier(47.0%)and frequent reminders(142,47.3%)as the major cue to action.Age above 50 years(aOR 1.78,95%CI 1.04-3.06,P=0.037)and rural locality(aOR 2.68,95%CI 1.52-4.71,P=0.001)were found to be significantly associated with poor knowledge scores.Urban participants had a significantly higher chance to perceive low susceptibility as compared to the rural counterparts(aOR 1.74,95%CI 1.05-2.9,P=0.03).Participants with less than a high school education had low perceived benefits(aOR 2.46,95%CI 1.52-3.96,P<0.001)and low self-efficacy scores(aOR 2.66,95%CI 1.61-4.39,P<0.001).Conclusions:This study identifies key gaps in dengue prevention,including low perceived susceptibility,mild disease perception,limited knowledge of breeding sites,and overreliance on government efforts.Tailoring interventions to community needs,stratified to factors influencing the community perspectives can significantly improve dengue prevention efforts.

Recent advances and perspectives of zinc metal-free anodes for zinc ion batteries

Zinc-ion batteries(ZIBs) are recognized as potential energy storage devices due to their advantages of low cost, high energy density, and environmental friendliness. However, zinc anodes are subject to unavoidable zinc dendrites, passivation, corrosion, and hydrogen evolution reactions during the charging and discharging of batteries, becoming obstacles to the practical application of ZIBs. Appropriate zinc metal-free anodes provide a higher working potential than metallic zinc anodes, effectively solving the problems of zinc dendrites, hydrogen evolution, and side reactions during the operation of metallic zinc anodes. The improvement in the safety and cycle life of batteries creates conditions for further commercialization of ZIBs. Therefore, this work systematically introduces the research progress of zinc metal-free anodes in “rocking chair” ZIBs. Zinc metal-free anodes are mainly discussed in four categories: transition metal oxides,transition metal sulfides, MXene(two dimensional transition metal carbide) composites, and organic compounds, with discussions on their properties and zinc storage mechanisms. Finally, the outlook for the development of zinc metal-free anodes is proposed. This paper is expected to provide a reference for the further promotion of commercial rechargeable ZIBs.

Bipartite consensus problems of Lurie multi-agent systems over signed graphs: A contraction approach

This paper examines the bipartite consensus problems for the nonlinear multi-agent systems in Lurie dynamics form with cooperative and competitive communication between different agents. Based on the contraction theory, some new conditions for the nonlinear Lurie multi-agent systems reaching bipartite leaderless consensus and bipartite tracking consensus are presented. Compared with the traditional methods, this approach degrades the dimensions of the conditions, eliminates some restrictions of the system matrix, and extends the range of the nonlinear function. Finally, two numerical examples are provided to illustrate the efficiency of our results.

Hyperbolic Tangent Function-Based Protocols for Global/Semi-Global Finite-Time Consensus of Multi-Agent Systems

This paper investigates the problem of global/semi-global finite-time consensus for integrator-type multi-agent sys-tems.New hyperbolic tangent function-based protocols are pro-posed to achieve global and semi-global finite-time consensus for both single-integrator and double-integrator multi-agent systems with leaderless undirected and leader-following directed commu-nication topologies.These new protocols not only provide an explicit upper-bound estimate for the settling time,but also have a user-prescribed bounded control level.In addition,compared to some existing results based on the saturation function,the pro-posed approach considerably simplifies the protocol design and the stability analysis.Illustrative examples and an application demonstrate the effectiveness of the proposed protocols.

Designing Proportional-Integral Consensus Protocols for Second-Order Multi-Agent Systems Using Delayed and Memorized State Information

This paper is concerned with consensus of a secondorder linear time-invariant multi-agent system in the situation that there exists a communication delay among the agents in the network.A proportional-integral consensus protocol is designed by using delayed and memorized state information.Under the proportional-integral consensus protocol,the consensus problem of the multi-agent system is transformed into the problem of asymptotic stability of the corresponding linear time-invariant time-delay system.Note that the location of the eigenvalues of the corresponding characteristic function of the linear time-invariant time-delay system not only determines the stability of the system,but also plays a critical role in the dynamic performance of the system.In this paper,based on recent results on the distribution of roots of quasi-polynomials,several necessary conditions for Hurwitz stability for a class of quasi-polynomials are first derived.Then allowable regions of consensus protocol parameters are estimated.Some necessary and sufficient conditions for determining effective protocol parameters are provided.The designed protocol can achieve consensus and improve the dynamic performance of the second-order multi-agent system.Moreover,the effects of delays on consensus of systems of harmonic oscillators/double integrators under proportional-integral consensus protocols are investigated.Furthermore,some results on proportional-integral consensus are derived for a class of high-order linear time-invariant multi-agent systems.

Unleashing the Power of Multi-Agent Reinforcement Learning for Algorithmic Trading in the Digital Financial Frontier and Enterprise Information Systems

In the rapidly evolving landscape of today’s digital economy,Financial Technology(Fintech)emerges as a trans-formative force,propelled by the dynamic synergy between Artificial Intelligence(AI)and Algorithmic Trading.Our in-depth investigation delves into the intricacies of merging Multi-Agent Reinforcement Learning(MARL)and Explainable AI(XAI)within Fintech,aiming to refine Algorithmic Trading strategies.Through meticulous examination,we uncover the nuanced interactions of AI-driven agents as they collaborate and compete within the financial realm,employing sophisticated deep learning techniques to enhance the clarity and adaptability of trading decisions.These AI-infused Fintech platforms harness collective intelligence to unearth trends,mitigate risks,and provide tailored financial guidance,fostering benefits for individuals and enterprises navigating the digital landscape.Our research holds the potential to revolutionize finance,opening doors to fresh avenues for investment and asset management in the digital age.Additionally,our statistical evaluation yields encouraging results,with metrics such as Accuracy=0.85,Precision=0.88,and F1 Score=0.86,reaffirming the efficacy of our approach within Fintech and emphasizing its reliability and innovative prowess.

Surgeon Perspectives on Anastomotic Leaks and FluidAI’s StreamTM Platform: Integrating Qualitative Insights for Technological Innovation

Purpose: This article investigates the critical importance of integrating surgeons’ direct input into the development of innovative technologies that address gaps in surgical care, including those aimed at reducing anastomotic leaks (AL), a major complication in gastrointestinal surgery. While traditional quantitative research methods are prevalent, they often overlook the invaluable insights of the surgeons who manage these complications firsthand. Subjects and Methods: This study employs a qualitative approach, utilizing semi-structured interviews with 40 surgeons from various specialties, including general, bariatric, colorectal, trauma, hepato-biliary, and thoracic surgery. The interviews were designed to probe the needs of surgeons, challenges currently faced, and gaps in clinical practice, research, and technology for detection and/or management of AL. The data were analyzed using thematic analysis, which revealed significant gaps in current technologies for early detection and prevention of leaks. Results: Surgeons expressed strong interest in FluidAI’s Stream™ Platform, a non-invasive medical device designed to monitor postoperative drainage fluid in real-time, providing continuous data on AL risk. The ability of this platform to offer early prediction through pH and electrical conductivity analysis was particularly appealing to participants, who emphasized the importance of timely interventions in improving patient outcomes. The study’s findings highlight not only the clinical challenges but also the emotional toll that AL takes on surgeons, underlining the need for innovations that are both data-driven and humanistic. Conclusion: By centering surgeons’ perspectives, this research advocates for a human-centered approach to technological advancement, ensuring that new tools are both clinically effective and aligned with the real-world needs of surgical practitioners.

Targeted multi-agent communication algorithm based on state control

As an important mechanism in multi-agent interaction,communication can make agents form complex team relationships rather than constitute a simple set of multiple independent agents.However,the existing communication schemes can bring much timing redundancy and irrelevant messages,which seriously affects their practical application.To solve this problem,this paper proposes a targeted multiagent communication algorithm based on state control(SCTC).The SCTC uses a gating mechanism based on state control to reduce the timing redundancy of communication between agents and determines the interaction relationship between agents and the importance weight of a communication message through a series connection of hard-and self-attention mechanisms,realizing targeted communication message processing.In addition,by minimizing the difference between the fusion message generated from a real communication message of each agent and a fusion message generated from the buffered message,the correctness of the final action choice of the agent is ensured.Our evaluation using a challenging set of Star Craft II benchmarks indicates that the SCTC can significantly improve the learning performance and reduce the communication overhead between agents,thus ensuring better cooperation between agents.

Multi-Agent Collaborative Task Planning with Uncertain Task Requirements

In response to the uncertainty of information of the injured in post disaster situations,considering constraints such as random chance and the quantity of rescue resource,the split deliv-ery vehicle routing problem with stochastic demands(SDVRPSD)model and the multi-depot split delivery heterogeneous vehicle routing problem with stochastic demands(MDSDHVRPSD)model are established.A two-stage hybrid variable neighborhood tabu search algorithm is designed for unmanned vehicle task planning to minimize the path cost of rescue plans.Simulation experiments show that the solution obtained by the algorithm can effectively reduce the rescue vehicle path cost and the rescue task completion time,with high optimization quality and certain portability.

Safety-Constrained Multi-Agent Reinforcement Learning for Power Quality Control in Distributed Renewable Energy Networks

This paper examines the difficulties of managing distributed power systems,notably due to the increasing use of renewable energy sources,and focuses on voltage control challenges exacerbated by their variable nature in modern power grids.To tackle the unique challenges of voltage control in distributed renewable energy networks,researchers are increasingly turning towards multi-agent reinforcement learning(MARL).However,MARL raises safety concerns due to the unpredictability in agent actions during their exploration phase.This unpredictability can lead to unsafe control measures.To mitigate these safety concerns in MARL-based voltage control,our study introduces a novel approach:Safety-ConstrainedMulti-Agent Reinforcement Learning(SC-MARL).This approach incorporates a specialized safety constraint module specifically designed for voltage control within the MARL framework.This module ensures that the MARL agents carry out voltage control actions safely.The experiments demonstrate that,in the 33-buses,141-buses,and 322-buses power systems,employing SC-MARL for voltage control resulted in a reduction of the Voltage Out of Control Rate(%V.out)from0.43,0.24,and 2.95 to 0,0.01,and 0.03,respectively.Additionally,the Reactive Power Loss(Q loss)decreased from 0.095,0.547,and 0.017 to 0.062,0.452,and 0.016 in the corresponding systems.

Mistreatment during Childbirth: Impact on Maternal Outcomes and Importance of Provider Perspectives

Background: Dying in childbirth is one of the most common causes of death for women. While maternal mortality rates, defined as deaths per 100,000 live births, have been steadily dropping in most countries worldwide, maternal mortality rates have doubled in the United States in the last twenty years. This commentary examines the various contributing factors to this trend. Methods: A literature review was performed using the keywords: maternal mortality, United States, disrespectful maternity care, obstetric violence, provider perspectives, and disparities. Maternal mortality statistics were obtained from the World Health Organization website. Results: Medical factors associated with maternal mortality include increased maternal age and cardiovascular conditions. Social factors include barriers to healthcare access, delays in receiving medical care, reduction in reproductive health services in some states, and non-obstetrical deaths such as accidents, domestic violence, and suicide. Racial inequities and disparities of care are reflected in higher maternal mortality rates for minorities and people of color. Disrespectful maternity care or obstetric violence has been reported worldwide as a factor in delay of lifesaving obstetrical care and reluctance by a pregnant person to access the healthcare system. About one in five US women has reported experiencing mistreatment, varying from verbal abuse to lack of privacy, from coerced procedures to neglect during childbirth. Conclusion: This commentary highlights the importance of inclusion of providers in research on respectful maternity care. Provider burnout, moral distress, limited time, and burden of clinical responsibilities are known challenges to respectful and comprehensive medical care. The association of disrespectful care with poor maternal outcomes needs to be studied. Exploring root causes of disrespectful childbirth care can empower nurses, midwives, and physicians to improve their environment and find solutions to reduce a potential cause of maternal mortality.

A coordinated operation method of wind-PV-hydrogenstorage multi-agent energy system

Wind-photovoltaic(PV)-hydrogen-storage multi-agent energy systems are expected to play an important role in promoting renewable power utilization and decarbonization.In this study,a coordinated operation method was proposed for a wind-PVhydrogen-storage multi-agent energy system.First,a coordinated operation model was formulated for each agent considering peer-to-peer power trading.Second,a coordinated operation interactive framework for a multi-agent energy system was proposed based on the theory of the alternating direction method of multipliers.Third,a distributed interactive algorithm was proposed to protect the privacy of each agent and solve coordinated operation strategies.Finally,the effectiveness of the proposed coordinated operation method was tested on multi-agent energy systems with different structures,and the operational revenues of the wind power,PV,hydrogen,and energy storage agents of the proposed coordinated operation model were improved by approximately 59.19%,233.28%,16.75%,and 145.56%,respectively,compared with the independent operation model.