Discrete decision model and multi-agent simulation of the Liang Zong two-chain hierarchical organization in a complex project

Different from the organization structure of complex projects in Western countries, the Liang Zong hierarchical organization structure of complex projects in China has two different chains, the chief-engineer chain and the general-director chain,to handle the trade-off between technical and management decisions. However, previous works on organization search have mainly focused on the single-chain hierarchical organization in which all decisions are regarded as homogeneous. The heterogeneity and the interdependency between technical decisions and management decisions have been neglected. A two-chain hierarchical organization structure mapped from a real complex project is constructed. Then, a discrete decision model for a Liang Zong two-chain hierarchical organization in an NK model framework is proposed. This model proves that this kind of organization structure can reduce the search space by a large amount and that the search process should reach a final stable state more quickly. For a more complicated decision mechanism, a multi-agent simulation based on the above NK model is used to explore the effect of the two-chain organization structure on the speed, stability, and performance of the search process. The results provide three insights into how, compared with the single-chain hierarchical organization, the two-chain organization can improve the search process: it can reduce the number of iterations efficiently; the search is more stable because the search space is a smoother hill-like fitness landscape; in general, the search performance can be improved.However, when the organization structure is very complicated, the performance of a two-chain organization is inferior to that of a single-chain organization. These findings about the efficiency of the unique Chinese-style organization structure can be used to guide organization design for complex projects.

Multi-agent Simulation for Strategic Bidding in Electricity Markets Using Reinforcement Learning

In this paper,a theoretical framework of Multiagent Simulation(MAS)is proposed for strategic bidding in electricity markets using reinforcement learning,which consists of two parts:one is a MAS system used to simulate the competitive bidding of the actual electricity market;the other is an adaptive learning strategy bidding system used to provide agents with more intelligent bidding strategies.An ExperienceWeighted Attraction(EWA)reinforcement learning algorithm(RLA)is applied to the MAS model and a new MAS method is presented for strategic bidding in electricity markets using a new Improved EWA(IEWA).From both qualitative and quantitative perspectives,it is compared with three other MAS methods using the Roth-Erev(RE),Q-learning and EWA.The results show that the performance of the MAS method using IEWA is proved to be better than the others.The four MAS models using four RLAs are built for strategic bidding in electricity markets.Through running the four MAS models,the rationality and correctness of the four MAS methods are verified for strategic bidding in electricity markets using reinforcement learning.

基于Multi-Agent的无人机集群体系自主作战系统设计

针对无人集群自主作战体系设计中的关键问题,提出基于Multi-Agent的无人集群自主作战系统设计方法。建立无人集群各节点的Agent模型及其推演规则;对于仿真系统模块化和通用化的需求,设计系统互操作式接口和无人集群自主作战的交互关系;开展无人集群系统仿真推演验证。仿真结果表明,所提设计方案不仅能够有效开展并完成自主作战网络生成-集群演化-效能评估的全过程动态演示验证,而且能够通过重复随机试验进一步评估无人集群的协同作战效能,最后总结了集群协同作战的策略和经验。

基于Multi-Agent的水电站变压器故障诊断系统

为了精准、快速完成水电站变压器的故障诊断,设计基于Multi-Agent的水电站变压器故障诊断系统。变压器状态监控agent将检测到的变压器故障信息发送给系统管理agent,系统管理agent通过通信agent将变压器故障信息发送给变压器故障诊断agent,变压器故障诊断agent利用小波变换方法提取变压器故障特征,并将其作为IFOA-SVM模型输入,完成变压器故障分类后,获取变压器故障诊断结果,该结果通过通信agent显示给用户。实验表明,该系统可有效诊断变压器故障诊断,诊断成功率受系统故障信息丢失率的影响较小,诊断耗时、耗能小,并具有较高故障诊断成功率。

基于Plant Simulation的化纤自动落丝系统仿真实验分析

基于Plant Simulation软件,构建一种化纤自动落丝系统的3D数字化模型,对系统效率关键输入因子进行参数化设置,将系统各工位三维数字模型导入软件中建立层次化运动机构图形结构,并运用Simltalk语言实现三维动作仿真,通过基础物理参数设置,保证了仿真数字化模型与现实系统更具一致性。通过多级实验设计分析了系统影响因子对于系统效率的影响特性曲线,并进一步通过动态参数化实验方法,计算出双输入因子对系统效能影响的敏感度。该实验结果可为化纤自动落丝系统的建设成本控制与可行性分析提供指导,具有较好的工程应用价值。

基于Simulation X的多轴转向系统功能安全仿真分析

基于ISO 26262《道路车辆功能安全》的标准要求,对特种车的多轴电液转向系统进行分析,以提高系统的安全性和可靠性。运用Simulation X软件建立详细的多轴特种车仿真模型,通过模拟故障模式注入进行仿真试验。对仿真结果和数据进行分析,评估得到故障的严重性、暴露度和可控性,从而确定相应的汽车安全完整性等级。基于故障注入仿真的汽车功能安全分析方法,在系统早期设计阶段可以作为评估架构安全性的重要手段。

基于Plant Simulation的压气机叶片型线加工产线分析与优化

运用专业仿真软件Plant Simulation,根据压气机叶片型线机械加工工艺特点和物料运行流程建立生产线仿真模型,从产能、设备利用率及产线瓶颈等多方面进行仿真分析与优化。结果表明:Plant Simulation仿真平台的仿真可以找出规划设计方案中存在的问题并验证方案的合理性。该仿真结果为型线机械加工产线的优化设计提供了可靠依据,达到了节约投资成本和缩短设计周期的目的。

UAV-Assisted Dynamic Avatar Task Migration for Vehicular Metaverse Services: A Multi-Agent Deep Reinforcement Learning Approach

Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metaverses. However, avatar tasks include a multitude of human-to-avatar and avatar-to-avatar interactive applications, e.g., augmented reality navigation,which consumes intensive computing resources. It is inefficient and impractical for vehicles to process avatar tasks locally. Fortunately, migrating avatar tasks to the nearest roadside units(RSU)or unmanned aerial vehicles(UAV) for execution is a promising solution to decrease computation overhead and reduce task processing latency, while the high mobility of vehicles brings challenges for vehicles to independently perform avatar migration decisions depending on current and future vehicle status. To address these challenges, in this paper, we propose a novel avatar task migration system based on multi-agent deep reinforcement learning(MADRL) to execute immersive vehicular avatar tasks dynamically. Specifically, we first formulate the problem of avatar task migration from vehicles to RSUs/UAVs as a partially observable Markov decision process that can be solved by MADRL algorithms. We then design the multi-agent proximal policy optimization(MAPPO) approach as the MADRL algorithm for the avatar task migration problem. To overcome slow convergence resulting from the curse of dimensionality and non-stationary issues caused by shared parameters in MAPPO, we further propose a transformer-based MAPPO approach via sequential decision-making models for the efficient representation of relationships among agents. Finally, to motivate terrestrial or non-terrestrial edge servers(e.g., RSUs or UAVs) to share computation resources and ensure traceability of the sharing records, we apply smart contracts and blockchain technologies to achieve secure sharing management. Numerical results demonstrate that the proposed approach outperforms the MAPPO approach by around 2% and effectively reduces approximately 20% of the latency of avatar task execution in UAV-assisted vehicular Metaverses.

基于Simulation的薄壁桶搬运过程的形变研究

桶料的搬运方式主要有托底式、夹取式和挂取(吊取)式,文中针对薄壁桶的搬运方式进行模拟分析,通过模拟分析的具体数值来进行合理的选择。主要对挂取(吊取)和夹取2种薄壁桶的搬运方式进行模拟分析,基于Soildworks中的Simulation进行计算,并得出具体数值,选取合理的薄壁桶搬运方式。模拟分析表明:在同等桶壁厚的情况下,夹取式桶料搬运形式薄壁桶的变形程度较大,主要体现在薄壁桶的夹持部位,如特定场景需夹持薄壁桶的桶身进行搬运时,还需适当加厚薄壁桶的桶壁来抵抗夹持板的夹持力,使薄壁桶不会产生较大的形变量。

The Probability Density Function Related to Shallow Cumulus Entrainment Rate and Its Influencing Factors in a Large-Eddy Simulation

The process of entrainment-mixing between cumulus clouds and the ambient air is important for the development of cumulus clouds.Accurately obtaining the entrainment rate(λ)is particularly important for its parameterization within the overall cumulus parameterization scheme.In this study,an improved bulk-plume method is proposed by solving the equations of two conserved variables simultaneously to calculateλof cumulus clouds in a large-eddy simulation.The results demonstrate that the improved bulk-plume method is more reliable than the traditional bulk-plume method,becauseλ,as calculated from the improved method,falls within the range ofλvalues obtained from the traditional method using different conserved variables.The probability density functions ofλfor all data,different times,and different heights can be well-fitted by a log-normal distribution,which supports the assumed stochastic entrainment process in previous studies.Further analysis demonstrate that the relationship betweenλand the vertical velocity is better than other thermodynamic/dynamical properties;thus,the vertical velocity is recommended as the primary influencing factor for the parameterization ofλin the future.The results of this study enhance the theoretical understanding ofλand its influencing factors and shed new light on the development ofλparameterization.

Global hybrid simulations of soft X-ray emissions in the Earth’s magnetosheath

Earth’s magnetopause is a thin boundary separating the shocked solar wind plasma from the magnetospheric plasmas,and it is also the boundary of the solar wind energy transport to the magnetosphere.Soft X-ray imaging allows investigation of the large-scale magnetopause by providing a two-dimensional(2-D)global view from a satellite.By performing 3-D global hybrid-particle-in-cell(hybrid-PIC)simulations,we obtain soft X-ray images of Earth’s magnetopause under different solar wind conditions,such as different plasma densities and directions of the southward interplanetary magnetic field.In all cases,magnetic reconnection occurs at low latitude magnetopause.The soft X-ray images observed by a hypothetical satellite are shown,with all of the following identified:the boundary of the magnetopause,the cusps,and the magnetosheath.Local X-ray emissivity in the magnetosheath is characterized by large amplitude fluctuations(up to 160%);however,the maximum line-of-sight-integrated X-ray intensity matches the tangent directions of the magnetopause well,indicating that these fluctuations have limited impact on identifying the magnetopause boundary in the X-ray images.Moreover,the magnetopause boundary can be identified using multiple viewing geometries.We also find that solar wind conditions have little effect on the magnetopause identification.The Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)mission will provide X-ray images of the magnetopause for the first time,and our global hybrid-PIC simulation results can help better understand the 2-D X-ray images of the magnetopause from a 3-D perspective,with particle kinetic effects considered.

Magnetopause properties at the dusk magnetospheric flank from global magnetohydrodynamic simulations,the kinetic Vlasov equilibrium,and in situ observations--Potential implications for SMILE

We derived the properties of the terrestrial magnetopause(MP)from two modeling approaches,one global–fluid,the other local–kinetic,and compared the results with data collected in situ by the Magnetospheric Multiscale 2(MMS2)spacecraft.We used global magnetohydrodynamic(MHD)simulations of the Earth’s magnetosphere(publicly available from the NASA-CCMC[National Aeronautics and Space Administration–Community Coordinated Modeling Center])and local Vlasov equilibrium models(based on kinetic models for tangential discontinuities)to extract spatial profiles of the plasma and field variables at the Earth’s MP.The global MHD simulations used initial solar wind conditions extracted from the OMNI database at the time epoch when the MMS2 observes the MP.The kinetic Vlasov model used asymptotic boundary conditions derived from the same in situ MMS measurements upstream or downstream of the MP.The global MHD simulations provide a three-dimensional image of the magnetosphere at the time when the MMS2 crosses the MP.The Vlasov model provides a one-dimensional local view of the MP derived from first principles of kinetic theory.The MMS2 experimental data also serve as a reference for comparing and validating the numerical simulations and modeling.We found that the MP transition layer formed in global MHD simulations was generally localized closer to the Earth(roughly by one Earth radius)from the position of the real MP observed by the MMS.We also found that the global MHD simulations overestimated the thickness of the MP transition by one order of magnitude for three analyzed variables:magnetic field,density,and tangential speed.The MP thickness derived from the local Vlasov equilibrium was consistent with observations for all three of these variables.The overestimation of density in the Vlasov equilibrium was reduced compared with the global MHD solutions.We discuss our results in the context of future SMILE(Solar wind Magnetosphere Ionosphere Link Explorer)campaigns for observing the Earth’s MP.

Hybrid-Vlasov simulation of soft X-ray emissions at the Earth’s dayside magnetospheric boundaries

Solar wind charge exchange produces emissions in the soft X-ray energy range which can enable the study of near-Earth space regions such as the magnetopause,the magnetosheath and the polar cusps by remote sensing techniques.The Solar wind Magnetosphere Ionosphere Link Explorer(SMILE)and Lunar Environment heliospheric X-ray Imager(LEXI)missions aim to obtain soft Xray images of near-Earth space thanks to their Soft X-ray Imager(SXI)instruments.While earlier modeling works have already simulated soft X-ray images as might be obtained by SMILE SXI during its mission,the numerical models used so far are all based on the magnetohydrodynamics description of the space plasma.To investigate the possible signatures of ion-kinetic-scale processes in soft Xray images,we use for the first time a global hybrid-Vlasov simulation of the geospace from the Vlasiator model.The simulation is driven by fast and tenuous solar wind conditions and purely southward interplanetary magnetic field.We first produce global X-ray images of the dayside near-Earth space by placing a virtual imaging satellite at two different locations,providing meridional and equatorial views.We then analyze regional features present in the images and show that they correspond to signatures in soft X-ray emissions of mirrormode wave structures in the magnetosheath and flux transfer events(FTEs)at the magnetopause.Our results suggest that,although the time scales associated with the motion of those transient phenomena will likely be significantly smaller than the integration time of the SMILE and LEXI imagers,mirror-mode structures and FTEs can cumulatively produce detectable signatures in the soft X-ray images.For instance,a local increase by 30%in the proton density at the dayside magnetopause resulting from the transit of multiple FTEs leads to a 12%enhancement in the line-of-sight-and time-integrated soft X-ray emissivity originating from this region.Likewise,a proton density increase by 14%in the magnetosheath associated with mirror-mode structures can result in an enhancement in the soft X-ray signal by 4%.These are likely conservative estimates,given that the solar wind conditions used in the Vlasiator run can be expected to generate weaker soft X-ray emissions than the more common denser solar wind.These results will contribute to the preparatory work for the SMILE and LEXI missions by providing the community with quantitative estimates of the effects of small-scale,transient phenomena occurring on the dayside.

Discovering Latent Variables for the Tasks With Confounders in Multi-Agent Reinforcement Learning

Efficient exploration in complex coordination tasks has been considered a challenging problem in multi-agent reinforcement learning(MARL). It is significantly more difficult for those tasks with latent variables that agents cannot directly observe. However, most of the existing latent variable discovery methods lack a clear representation of latent variables and an effective evaluation of the influence of latent variables on the agent. In this paper, we propose a new MARL algorithm based on the soft actor-critic method for complex continuous control tasks with confounders. It is called the multi-agent soft actor-critic with latent variable(MASAC-LV) algorithm, which uses variational inference theory to infer the compact latent variables representation space from a large amount of offline experience.Besides, we derive the counterfactual policy whose input has no latent variables and quantify the difference between the actual policy and the counterfactual policy via a distance function. This quantified difference is considered an intrinsic motivation that gives additional rewards based on how much the latent variable affects each agent. The proposed algorithm is evaluated on two collaboration tasks with confounders, and the experimental results demonstrate the effectiveness of MASAC-LV compared to other baseline algorithms.

CoopAI-Route: DRL Empowered Multi-Agent Cooperative System for Efficient QoS-Aware Routing for Network Slicing in Multi-Domain SDN

The emergence of beyond 5G networks has the potential for seamless and intelligent connectivity on a global scale.Network slicing is crucial in delivering services for different,demanding vertical applications in this context.Next-generation applications have time-sensitive requirements and depend on the most efficient routing path to ensure packets reach their intended destinations.However,the existing IP(Internet Protocol)over a multi-domain network faces challenges in enforcing network slicing due to minimal collaboration and information sharing among network operators.Conventional inter-domain routing methods,like Border Gateway Protocol(BGP),cannot make routing decisions based on performance,which frequently results in traffic flowing across congested paths that are never optimal.To address these issues,we propose CoopAI-Route,a multi-agent cooperative deep reinforcement learning(DRL)system utilizing hierarchical software-defined networks(SDN).This framework enforces network slicing in multi-domain networks and cooperative communication with various administrators to find performance-based routes in intra-and inter-domain.CoopAI-Route employs the Distributed Global Topology(DGT)algorithm to define inter-domain Quality of Service(QoS)paths.CoopAI-Route uses a DRL agent with a message-passing multi-agent Twin-Delayed Deep Deterministic Policy Gradient method to ensure optimal end-to-end routes adapted to the specific requirements of network slicing applications.Our evaluation demonstrates CoopAI-Route’s commendable performance in scalability,link failure handling,and adaptability to evolving topologies compared to state-of-the-art methods.

Bipartite consensus problems of Lurie multi-agent systems over signed graphs: A contraction approach

This paper examines the bipartite consensus problems for the nonlinear multi-agent systems in Lurie dynamics form with cooperative and competitive communication between different agents. Based on the contraction theory, some new conditions for the nonlinear Lurie multi-agent systems reaching bipartite leaderless consensus and bipartite tracking consensus are presented. Compared with the traditional methods, this approach degrades the dimensions of the conditions, eliminates some restrictions of the system matrix, and extends the range of the nonlinear function. Finally, two numerical examples are provided to illustrate the efficiency of our results.

Machine learning-enhanced Monte Carlo and subset simulations for advanced risk assessment in transportation infrastructure

The maintenance of safety and dependability in rail and road embankments is of utmost importance in order to facilitate the smooth operation of transportation networks.This study introduces a comprehensive methodology for soil slope stability evaluation,employing Monte Carlo Simulation(MCS)and Subset Simulation(SS)with the"UPSS 3.0 Add-in"in MS-Excel.Focused on an 11.693-meter embankment with a soil slope(inclination ratio of 2H:1V),the investigation considers earthquake coefficients(kh)and pore water pressure ratios(ru)following Indian zoning requirements.The chance of slope failure showed a considerable increase as the Coefficient of Variation(COV),seismic coefficients(kh),and pore water pressure ratios(ru)experienced an escalation.The SS approach showed exceptional efficacy in calculating odds of failure that are notably low.Within computational modeling,the study optimized the worst-case scenario using ANFIS-GA,ANFIS-GWO,ANFIS-PSO,and ANFIS-BBO models.The ANFIS-PSO model exhibits exceptional accuracy(training R2=0.9011,RMSE=0.0549;testing R2=0.8968,RMSE=0.0615),emerging as the most promising.This study highlights the significance of conducting thorough risk assessments and offers practical insights into evaluating and improving the stability of soil slopes in transportation infrastructure.These findings contribute to the enhancement of safety and reliability in real-world situations.

Hyperbolic Tangent Function-Based Protocols for Global/Semi-Global Finite-Time Consensus of Multi-Agent Systems

This paper investigates the problem of global/semi-global finite-time consensus for integrator-type multi-agent sys-tems.New hyperbolic tangent function-based protocols are pro-posed to achieve global and semi-global finite-time consensus for both single-integrator and double-integrator multi-agent systems with leaderless undirected and leader-following directed commu-nication topologies.These new protocols not only provide an explicit upper-bound estimate for the settling time,but also have a user-prescribed bounded control level.In addition,compared to some existing results based on the saturation function,the pro-posed approach considerably simplifies the protocol design and the stability analysis.Illustrative examples and an application demonstrate the effectiveness of the proposed protocols.