MADDPG-D2: An Intelligent Dynamic Task Allocation Algorithm Based on Multi-Agent Architecture Driven by Prior Knowledge

Aiming at the problems of low solution accuracy and high decision pressure when facing large-scale dynamic task allocation(DTA)and high-dimensional decision space with single agent,this paper combines the deep reinforce-ment learning(DRL)theory and an improved Multi-Agent Deep Deterministic Policy Gradient(MADDPG-D2)algorithm with a dual experience replay pool and a dual noise based on multi-agent architecture is proposed to improve the efficiency of DTA.The algorithm is based on the traditional Multi-Agent Deep Deterministic Policy Gradient(MADDPG)algorithm,and considers the introduction of a double noise mechanism to increase the action exploration space in the early stage of the algorithm,and the introduction of a double experience pool to improve the data utilization rate;at the same time,in order to accelerate the training speed and efficiency of the agents,and to solve the cold-start problem of the training,the a priori knowledge technology is applied to the training of the algorithm.Finally,the MADDPG-D2 algorithm is compared and analyzed based on the digital battlefield of ground and air confrontation.The experimental results show that the agents trained by the MADDPG-D2 algorithm have higher win rates and average rewards,can utilize the resources more reasonably,and better solve the problem of the traditional single agent algorithms facing the difficulty of solving the problem in the high-dimensional decision space.The MADDPG-D2 algorithm based on multi-agent architecture proposed in this paper has certain superiority and rationality in DTA.

Topological Pressures on Subsets for Nonautonomous Dynamical Systems

We introduce and study the relation between Pesin-Pitskel topological pressure on an arbitrary subset and measure theoretic pressure of Borel probability measure for nonautonomous dynamical systems,which is an extension of the classical definition of Bowen topological entropy.We show that the Pesin-Pitskel topological pressure can be determined by the local pressures of measures in nonautonomous case and establish a variational principle for Pesin-Pitskel topological pressure on compact subsets in the context of nonautonomous dynamical systems.

Research on the self-defence electronic jamming decision-making based on the discrete dynamic Bayesian network

The manner and conditions of running the decision-making system with self-defense electronic jamming are given. After proposing the scenario of applying discrete dynamic Bayesian network to the decision making with self-defense electronic jamming, a decision-making model with self-defense electronic jamming based on the discrete dynamic Bayesian network is established. Then jamming decision inferences by the aid of the algorithm of discrete dynamic Bayesian network are carried on. The simulating result shows that this method is able to synthesize different targets which are not predominant. In this way, various features at the same time, as well as the same feature appearing at different time complement mutually; in addition, the accuracy and reliability of electronic jamming decision making are enhanced significantly.

Approach of service recovery decision-making based on Bellman dynamic programming

Based on service-oriented architecture（SOA）,a Bellman-dynamic-programming-based approach of service recovery decision-making is proposed to make valid recovery decisions.Both the attribute and the process of services in the controllable distributed information system are analyzed as the preparatory work.Using the idea of service composition as a reference,the approach translates the recovery decision-making into a planning problem regarding artificial intelligence （AI） through two steps.The first is the self-organization based on a logical view of the network,and the second is the definition of evaluation standards.Applying Bellman dynamic programming to solve the planning problem,the approach offers timely emergency response and optimal recovery source selection,meeting multiple QoS （quality of service）requirements.Experimental results demonstrate the rationality and optimality of the approach,and the theoretical analysis of its computational complexity and the comparison with conventional methods exhibit its high efficiency.

Dynamic programming methodology for multi-criteria group decision-making under ordinal preferences

A method of minimizing rankings inconsistency is proposed for a decision-making problem with rankings of alternatives given by multiple decision makers according to multiple criteria. For each criteria, at first, the total inconsistency between the rankings of all alternatives for the group and the ones for every decision maker is defined after the decision maker weights in respect to the criteria are considered. Similarly, the total inconsistency between their final rankings for the group and the ones under every criteria is determined after the criteria weights are taken into account. Then two nonlinear integer programming models minimizing respectively the two total inconsistencies above are developed and then transformed to two dynamic programming models to obtain separately the rankings of all alternatives for the group with respect to each criteria and their final rankings. A supplier selection case illustrated the proposed method, and some discussions on the results verified its effectiveness. This work develops a new measurement of ordinal preferences’ inconsistency in multi-criteria group decision-making （MCGDM） and extends the cook-seiford social selection function to MCGDM considering weights of criteria and decision makers and can obtain unique ranking result.

Study on group air to ground attack-defends hierarchical dynamic decision-making

As to oppositional, multi-objective and hierarchical characteristic of air formation to ground attackdefends campaign, and using dynamic space state model of military campaign, this article establishes a principal and subordinate hierarchical interactive decision-making way, the Nash-Stackelberg-Nash model, to solve the problems in military operation, and find out the associated best strategy in hierarchical dynamic decision-making. The simulating result indicate that when applying the model to air formation to ground attack-defends decision-making system, it can solve the problems of two hierarchies, dynamic oppositional decision-making favorably, and reach preferable effect in battle. It proves that the model can provide an effective way for analyzing a battle,

Two Degree-of-Freedom Dynamic Theoretical Model on Tile Thermal Protection System

In order to study the dynamic behaviors of the thermal protection system(TPS)and dynamic strength of the strain-isolation-pad(SIP),a two degree-of-freedom dynamic theoretical model is presented under the acoustic excitation and base excitation. The tile and SIP are both considered as the elastic body and simplified as a mass point,a linear spring and a damping element. The theoretical solutions are derived,and the reasonability of theoretical model is verified by comparing the theoretical results with the numerical results. Finally,the influences on the dynamic responses of TPS by the structural damping coefficient of TPS,elasticity modulus and thickness of SIP are analyzed.The results show that the material with higher damping,and SIP with thicker size and lower elastic modulus should be considered to reduce the dynamic responses and intensify the security of TPS. The researches provide a theoretical reference for studying the dynamic behaviors of TPS and the dynamic strength of SIP. Besides,the dynamic theoretical model can be used as a quick analysis tool for analyzing the dynamic responses of TPS during the initial design phase.

Dynamic capabilities-based strategy innovation： a theoretical framework and empirical studies in Chinese firms

Based on investigations of 112 Chinese firms and studies on foreign leading corporations, a theoretical framework of dynamic capabilities based strategy innovation (SI) is put forward. Several large firms in China winning through SI were studied empirically. This paper complements previous publications on the theories of innovation and strategy. This work's findings will be useful for managers interested in our approach, which highlights the importance of SI and focuses on and points out the major pitfalls in the innovation processes. Implementing the dynamic capabilities based strategy innovation can effectively cultivate and develop core competences of corporations. It is concluded that implementing SI is the only path for Chinese enterprise growth in the intensified competition in the knowledge economy.

Dynamic hesitant fuzzy linguistic group decision-making from a reliability perspective

A dynamic hesitant fuzzy linguistic group decisionmaking(DHFLGDM) problem is studied from the perspective of information reliability based on the theory of hesitant fuzzy linguistic term sets(HFLTSs). First, an approach is applied to transform the dynamic HFLTSs(DHFLTSs) into a set of proportional linguistic terms to eliminate the time dimension. Second, expert reliability is measured by considering both group similarity and degree of certainty, and an optimization method is employed to quantify the linguistic terms by maximizing the group similarity. Third, through computing the attribute stability as well as its reliability, a combination rule which considers both reliability and weight is proposed to aggregate the information, and then the aggregated grade values and degree of stability are used to make a selection. Finally,the application and feasibility of the proposed method are verified through a case study and method comparison.

Decision-Making Model for Farmer Choosing Land Use Based upon Dynamic Optimization Theory

Using the dynamic optimization theory, we described a decision-making model for farmer choosing land use when there are several different kinds of uses for land. To obtain an empirical model that could be easily applied, decision rules for farmer with a single static expectation were given.

MODELLING OF MECHANICAL MECHANISM OF CHROMATOGRAPHIC SYSTEM AND THEORETICAL EQUATIONS SHOWING DYNAMICAL CHARACTERISTICS OF CHROMATOGRAPHY

A simple model of chromatographic mechanical mechanism is present, and then a scrics of theoretical chromatographic equations and fundamental Formulae are derived. These theoretical equations and formulae not only reserve thermodynamic characteristics in the current fundamental chromatographic formulae, but also introduce one or more kinetic parameter, so it is possible to make the macroscopic-control on the effect of kinetic characteristics on chromatographic system.

Compounding effects of human activities and climatic changes on coexistence of oasis-desert ecosystems:Prioritizing resilient decision-making for a riskier world

Water-salt balance is critical for the stable coexistence of salt-affected and groundwater-fed oasis-desert ecosystems. Yet, a comprehensive investigation of how soil salinization and groundwater degradation threaten the coexistence of oasis-desert ecosystems is still scarce, especially under the compounding effects of human activities and climatic changes. Here, we assessed the impacts of irrigated agriculture on hydrological regimes in oasisdesert systems, investigated the spatio-temporal variations of soil salinization in irrigated cropland, and evaluated the implications of the interplays of soil salinization and groundwater degradation on the coexistence of oasis-desert ecosystems in northwestern China, based on meaningful modelling approaches and comprehensive measurements over 1995–2020. The results showed that the irrigation return flow coefficient decreased sharply from 0.21 ± 0.09 in the traditional irrigation period to 0.09 ± 0.01 in the water-saving irrigation period. The continuous drop in groundwater tables and significant degradation of groundwater quality are occurring throughout this watershed. The eco-environmental flows are reaching to their limit with watershed closures(i.e.,the drainage from the oasis region into the desert region is being weakened or even eliminated), although these progressions were largely hidden by regional precipitation and streamflow variability. The process of salt migration and accumulation across different landscapes in oasis-desert system is being reshaped, and soil salinization in water-saving agricultural irrigated lands is accelerating with a regional average annual growth rate of18%. The vegetation in this watershed is degrading, and anthropogenic disturbance accelerates this trend. Our results highlight that environmental stress adaptation strategies must account for resilience maintenance to avoid accelerating catastrophic transitions in oasis-desert ecosystems. Determining the optimal oasis scales and formulating the best irrigation management plans are effective and resilient decision-making ways to maintain the coexistence relationship of oasis-desert ecosystem in drylands.

Damage-ignition mechanism studies on modified propellant with different crosslinking density under dynamic loading

The study of high-energy and low-vulnerability propellants is important for the power performance and safety of solid propellant rocket motors.The modified split Hopkinson pressure bar(SHPB)tests are performed on two kinds of propellant with different crosslinking density to study the dynamic mechanical responses and damage-ignition mechanism.SHPB apparatus is equipped with a highperformance infrared camera and high-speed camera to capture the deformation,damage-ignition feature and temperature evolution images in the impact process.The results suggested that the mechanical responses and damage-ignition mechanism of the propellants were affected by the strain rates and crosslinking density.The damage-ignition degree is more intense and the reaction occurs earlier with the increase of strain rates.For propellant 1 with higher crosslinking density,the critical ignition strain rate is 4500 s^(-1).Two kinds of propellants show different ignition mechanism,i.e.crack generation,propagation and final fracture for propellant 1 while viscous shear flow for propellant 2.Meanwhile,the SEM images also reveal the difference of damage-ignition mechanism of the two kinds of propellants.Finally,the ignition mechanism under different strain rates and critical ignition strain rate of propellants are further explained by the theoretical calculation of temperature variations.

Principal axes of M-DOF structures PartⅡ:Dynamic loading

This paper is the second in a two-part series that discusses the principal axes of M-DOF structures subjected to static and dynamic loads.The primary purpose of this series is to understand the magnitude of the dynamie response of structures to enable better design of structures and response modification devices/systems.Under idealized design condi- tions,the structural responses are obtained by using single directinn input ground motions in the direction of the intended response modification devices/systems,and by assuming that the responses of the structure is deconpleable in three mutual- ly perpendicular directions.This standard practice has been applied to both new and retrofitted structures using various seis- mic protective systems.Very limited information is available on the effects of neglecting the impact of directional couplings (cross effects of which torsion is a component)of the dynamic response of structures.In order to quantify such effects,it is necessary to examine the principal axes of structures under both static and dynamic loading.In this twn-part series,the first paper is concerned with static loading,which provides definitions and fundamental formulations,with the conclusion that cross effects of a statically loaded M-DOF structure resulting from the lack of principal axes are of insignificant magnitude. However,under dynamic or earthquake loading,a relatively small amount of energy transferred across perpendicular direc- tions is accumulated,which may result in significant enlargement of the structural response.This paper deals with a formu- lation to define the principal axes of M-DOF structures under dynamic loading and develops quantitative measures to identify cross effects resuhing from the non-existence of principal axes.

IDMI Analysis of Regional Low-Carbon Development Based on System Dynamic Simulation

During the decision-making process, especially in multi-disciplinary complex cases, assessment technique is needed to assist policy-makers in making the right decision. Many of such assessment techniques have been developed for policy-makers, but the inevitable subjectivity of policy-makers often becomes the main obstacle in making the right or proper policy. Interlink decision-making index （IDMI） is a newly proposed assessment method with the advantages of being simple to use and having less human interference over other methods, as it does not require a weighting process of each selection criterion. This paper implements IDMI to assist with decision-making in national or regional low-carbon development, using China as a case study. The Chinese government has annotmced its carbon emission reduction target along with other development targets by 2020. Many policy settings can be chosen in order to achieve those targets. The problem is how to determine the best setting and the means by which decision-makers can avoid subjectivity and extremes. A number of policy setting options are generated carefully by a system dynamic model under different policy scenarios. The IDMI demonstrates a perfect way to assist in selecting the ＂best＂ among all the options that can achieve the goals within the acceptable range.

Path Planning of Quadrotors in a Dynamic Environment Using a Multicriteria Multi-Verse Optimizer

Paths planning of Unmanned Aerial Vehicles(UAVs)in a dynamic environment is considered a challenging task in autonomous flight control design.In this work,an efficient method based on a Multi-Objective MultiVerse Optimization(MOMVO)algorithm is proposed and successfully applied to solve the path planning problem of quadrotors with moving obstacles.Such a path planning task is formulated as a multicriteria optimization problem under operational constraints.The proposed MOMVO-based planning approach aims to lead the drone to traverse the shortest path from the starting point and the target without collision with moving obstacles.The vehicle moves to the next position from its current one such that the line joining minimizes the total path length and allows aligning its direction towards the goal.To choose the best compromise solution among all the non-dominated Pareto ones obtained for compromise objectives,the modified Technique for Order Preference by Similarity to Ideal Solution(TOPSIS)is investigated.A set of homologous metaheuristics such as Multiobjective Salp Swarm Algorithm(MSSA),Multi-Objective Grey Wolf Optimizer(MOGWO),Multi-Objective Particle Swarm Optimization(MOPSO),and Non-Dominated Genetic Algorithm II(NSGAII)is used as a basis for the performance comparison.Demonstrative results and statistical analyses show the superiority and effectiveness of the proposed MOMVO-based planning method.The obtained results are satisfactory and encouraging for future practical implementation of the path planning strategy.

Dynamic quasi-continuum model for plate-type nano-materials and analysis of fundamental frequency

A dynamic quasi-continuum model is presented to analyze free vibration of plate-type cubic crystal nano-materials.According to the Hamilton principle,fundamental governing equations in terms of displacement components and angles of rotations are given.As an application of the model,the cylindrical bending deformation of the structure fixed at two ends is analyzed,and a theoretical formula evaluating the fundamental frequency is obtained by using Galerkin's method.Meanwhile,the solution for the classical continuous plate model is also derived,and the size-dependent elastic modulus and Poisson's ratio are taken in computation.The frequencies corresponding to different atomic layers are numerically presented for the plate-type NaC l nano-materials.Furthermore,a molecular dynamics(MD)simulation is conducted with the code LAMMPS.The comparison shows that the present quasi-continuum model is valid,and it may be used as an alternative model,which reflects scale effects in analyzing dynamic behaviors of such plate-type nano-materials.

Dynamic probability evaluation of safety levels of earth-rockfill dams using Bayesian approach

In order to accurately predict and control the aging process of dams, new information should be collected continuously to renew the quantitative evaluation of dam safety levels. Owing to the complex structural characteristics of dams, it is quite difficult to predict the time-varying factors affecting their safety levels. It is not feasible to employ dynamic reliability indices to evaluate the actual safety levels of dams. Based on the relevant regulations for dam safety classification in China, a dynamic probability description of dam safety levels was developed. Using the Bayesian approach and effective information mining, as well as real-time information, this study achieved more rational evaluation and prediction of dam safety levels. With the Bayesian expression of discrete stochastic variables, the a priori probabilities of the dam safety levels determined by experts were combined wfth the likelihood probability of the real-time check information, and the probability information for the evaluation of dam safety levels was renewed. The probability index was then applied to dam rehabilitation decision-making. This method helps reduce the difficulty and uncertainty of the evaluation of dam safety levels and complies with the current safe decision-making regulations for dams in China. It also enhances the application of current risk analysis methods for dam safety levels.

Development of a global high-resolution marine dynamic environmental forecasting system

A project entitled‘Development of a Global High-resolution Marine Dynamic Environmental Forecasting System’has been funded by‘The Program on Marine Environmental Safety Guarantee’of The National Key Research and Development Program of China.This project will accomplish its objectives through basic theoretical research,model development and expansion,and system establishment and application,with a focus on four key issues separated into nine tasks.A series of research achievements have already been obtained,including datasets,observations,theories,and model results.

不同储粮工况下柱承式立筒仓结构动力特性

柱承式立筒仓广泛应用于国家粮食储备,不同储粮工况对其结构动力特性影响显著。为揭示粮食散体对柱承式立筒仓动力特性的影响规律,结合某实际柱承式立筒仓设计制作了缩尺比例为1/25的有机玻璃筒仓模型,在空仓、半仓、3/4仓和满仓4种储粮状态下,进行了振动台模态试验、有限元数值分析和自振频率理论计算。结果表明:不同储粮工况对柱承式立筒仓试验模型的固有频率影响显著,随储粮状态变化,固有频率减小幅度较大,应在结构设计中加以考虑;空仓状态下阻尼比最小,满仓状态比空仓增大42.65%,仓内原有储粮越多,阻尼比增值越大,减震耗能效果越明显;有限元模型一阶固有频率与试验值平均误差为5.1%,所建有限元模型较为合理,为结构动力响应分析及结构设计提供一种合理的数值模拟方法;简化的三质点串联多自由度的弹性动力模型较为准确计算柱承式立筒仓在4种储粮工况下的固有频率,试验值与理论值平均误差为5.6%。研究结果可为柱承式立筒仓结构动力特性计算提供参考,为其抗震性能设计提供理论基础和试验依据。