DISTRIBUTED OPTIMAL LOCAL DOUBLE LOOP NETWORK

A distibuted optimal local double loop(DOLDL) network is presented. Emphasis is laid on the topology and distributed routing algorithms for the DOLDL. On the basis of building an abstract model, a set of definitions and theorems are described and proved. An algorithm which can optimize the double loop networks is presented. The optimal values of the topologic parameters for the DOLDL have been obtained by the algorithm, and these numerical results are analyzed. The study shows that the bounds of the optimal diameter (d) and average hop distance (a) for this class of networks are [square-root 3N -2] less-than-or-equal-to d less-than-or-equal-to [square-root 3N+1] and (5N/9(N-1)) (square-root 3N-1.8) < a < (5N/9 (N-1)). (square-root 3N - 0.23), respectively (N is the number of nodes in the network. (3 less-than-or-equal-to N less-than-or-equal-to 10(4)). A class of the distributed routing algorithms for the DOLDL and the implementation procedure of an adaptive fault-tolerant algorithm are proposed. The correctness of the algorithm has been also verified by simulating.

An Optimal Control-Based Distributed Reinforcement Learning Framework for A Class of Non-Convex Objective Functionals of the Multi-Agent Network

This paper studies a novel distributed optimization problem that aims to minimize the sum of the non-convex objective functionals of the multi-agent network under privacy protection, which means that the local objective of each agent is unknown to others. The above problem involves complexity simultaneously in the time and space aspects. Yet existing works about distributed optimization mainly consider privacy protection in the space aspect where the decision variable is a vector with finite dimensions. In contrast, when the time aspect is considered in this paper, the decision variable is a continuous function concerning time. Hence, the minimization of the overall functional belongs to the calculus of variations. Traditional works usually aim to seek the optimal decision function. Due to privacy protection and non-convexity, the Euler-Lagrange equation of the proposed problem is a complicated partial differential equation.Hence, we seek the optimal decision derivative function rather than the decision function. This manner can be regarded as seeking the control input for an optimal control problem, for which we propose a centralized reinforcement learning(RL) framework. In the space aspect, we further present a distributed reinforcement learning framework to deal with the impact of privacy protection. Finally, rigorous theoretical analysis and simulation validate the effectiveness of our framework.

Distributed Stochastic Optimization with Compression for Non-Strongly Convex Objectives

We are investigating the distributed optimization problem,where a network of nodes works together to minimize a global objective that is a finite sum of their stored local functions.Since nodes exchange optimization parameters through the wireless network,large-scale training models can create communication bottlenecks,resulting in slower training times.To address this issue,CHOCO-SGD was proposed,which allows compressing information with arbitrary precision without reducing the convergence rate for strongly convex objective functions.Nevertheless,most convex functions are not strongly convex(such as logistic regression or Lasso),which raises the question of whether this algorithm can be applied to non-strongly convex functions.In this paper,we provide the first theoretical analysis of the convergence rate of CHOCO-SGD on non-strongly convex objectives.We derive a sufficient condition,which limits the fidelity of compression,to guarantee convergence.Moreover,our analysis demonstrates that within the fidelity threshold,this algorithm can significantly reduce transmission burden while maintaining the same convergence rate order as its no-compression equivalent.Numerical experiments further validate the theoretical findings by demonstrating that CHOCO-SGD improves communication efficiency and keeps the same convergence rate order simultaneously.And experiments also show that the algorithm fails to converge with low compression fidelity and in time-varying topologies.Overall,our study offers valuable insights into the potential applicability of CHOCO-SGD for non-strongly convex objectives.Additionally,we provide practical guidelines for researchers seeking to utilize this algorithm in real-world scenarios.

Fully Distributed Learning for Deep Random Vector Functional-Link Networks

In the contemporary era, the proliferation of information technology has led to an unprecedented surge in data generation, with this data being dispersed across a multitude of mobile devices. Facing these situations and the training of deep learning model that needs great computing power support, the distributed algorithm that can carry out multi-party joint modeling has attracted everyone’s attention. The distributed training mode relieves the huge pressure of centralized model on computer computing power and communication. However, most distributed algorithms currently work in a master-slave mode, often including a central server for coordination, which to some extent will cause communication pressure, data leakage, privacy violations and other issues. To solve these problems, a decentralized fully distributed algorithm based on deep random weight neural network is proposed. The algorithm decomposes the original objective function into several sub-problems under consistency constraints, combines the decentralized average consensus (DAC) and alternating direction method of multipliers (ADMM), and achieves the goal of joint modeling and training through local calculation and communication of each node. Finally, we compare the proposed decentralized algorithm with several centralized deep neural networks with random weights, and experimental results demonstrate the effectiveness of the proposed algorithm.

Distributed Periodic Event-Triggered Optimal Control of DC Microgrids Based on Virtual Incremental Cost

This article presents a distributed periodic eventtriggered(PET)optimal control scheme to achieve generation cost minimization and average bus voltage regulation in DC microgrids.In order to accommodate the generation constraints of the distributed generators(DGs),a virtual incremental cost is firstly designed,based on which an optimality condition is derived to facilitate the control design.To meet the discrete-time(DT)nature of modern control systems,the optimal controller is directly developed in the DT domain.Afterward,to reduce the communication requirement among the controllers,a distributed event-triggered mechanism is introduced for the DT optimal controller.The event-triggered condition is detected periodically and therefore naturally avoids the Zeno phenomenon.The closed-loop system stability is proved by the Lyapunov synthesis for switched systems.The generation cost minimization and average bus voltage regulation are obtained at the equilibrium point.Finally,switch-level microgrid simulations validate the performance of the proposed optimal controller.

Superconvergence and L^(∞)-Error Estimates of the Lowest Order Mixed Methods for Distributed Optimal Control Problems Governed by Semilinear Elliptic Equations

In this paper, we investigate the superconvergence property and the L∞-errorestimates of mixed finite element methods for a semilinear elliptic control problem. Thestate and co-state are approximated by the lowest order Raviart-Thomas mixed finite element spaces and the control variable is approximated by piecewise constant functions.We derive some superconvergence results for the control variable. Moreover, we derive L^(∞)-error estimates both for the control variable and the state variables. Finally, anumerical example is given to demonstrate the theoretical results.

Distributed Optimal Control of Nonlinear Time-Delay System Subject to Delayed Measurements and Communication Disruptions

This paper is focused on a distributed optimal control design for a class of nonlinear timedelay systems with delayed measurements and communication disruptions.The innovation lies in three aspects.The distributed optimal control method which includes an optimal controller and a bounded controller is designed based on Lyapunov function.The availability of data transmitted through the communication channel depends on a feasibility problem.And a sufficient condition to guarantee ultimate boundedness of the system is given based on appropriate assumptions.The significance of this paper is that this distributed optimal control method is applied to time-delay system.Finally,a simulation example is given to verify the effectiveness of the proposed method.

Fully asynchronous distributed optimization with linear convergence over directed networks

We study distributed optimization problems over a directed network,where nodes aim to minimize the sum of local objective functions via directed communications with neighbors.Many algorithms are designed to solve it for synchronized or randomly activated implementation,which may create deadlocks in practice.In sharp contrast,we propose a fully asynchronous push-pull gradient(APPG) algorithm,where each node updates without waiting for any other node by using possibly delayed information from neighbors.Then,we construct two novel augmented networks to analyze asynchrony and delays,and quantify its convergence rate from the worst-case point of view.Particularly,all nodes of APPG converge to the same optimal solution at a linear rate of O(λ^(k)) if local functions have Lipschitz-continuous gradients and their sum satisfies the Polyak-?ojasiewicz condition(convexity is not required),where λ ∈(0,1) is explicitly given and the virtual counter k increases by one when any node updates.Finally,the advantage of APPG over the synchronous counterpart and its linear speedup efficiency are numerically validated via a logistic regression problem.

Distributed Momentum-Based Frank-Wolfe Algorithm for Stochastic Optimization

This paper considers distributed stochastic optimization,in which a number of agents cooperate to optimize a global objective function through local computations and information exchanges with neighbors over a network.Stochastic optimization problems are usually tackled by variants of projected stochastic gradient descent.However,projecting a point onto a feasible set is often expensive.The Frank-Wolfe(FW)method has well-documented merits in handling convex constraints,but existing stochastic FW algorithms are basically developed for centralized settings.In this context,the present work puts forth a distributed stochastic Frank-Wolfe solver,by judiciously combining Nesterov's momentum and gradient tracking techniques for stochastic convex and nonconvex optimization over networks.It is shown that the convergence rate of the proposed algorithm is O(k^(-1/2))for convex optimization,and O(1/log_(2)(k))for nonconvex optimization.The efficacy of the algorithm is demonstrated by numerical simulations against a number of competing alternatives.

A Cooperative Security Monitoring Mechanism Aided by Optimal Multiple Slave Cluster Heads for UASNs

As each cluster head(CH)sensor node is used to aggregate,fuse,and forward data from different sensor nodes in an underwater acoustic sensor network(UASN),guaranteeing the data security in a CH is very critical.In this paper,a cooperative security monitoring mechanism aided by multiple slave cluster heads(SCHs)is proposed to keep track of the data security of a CH.By designing a low complexity“equilateral triangle algorithm(ETA)”,the optimal SCHs(named as ETA-based multiple SCHs)are selected from the candidate SCHs so as to improve the dispersion and coverage of SCHs and achieve largescale data security monitoring.In addition,by analyzing the entire monitoring process,the close form expression of the probability of the failure attack identification for the SCHs with respect to the probability of attack launched by ordinary nodes is deduced.The simulation results show that the proposed optimal ETA-based multiple SCH cooperation scheme has lower probability of the failure attack identification than that of the existing schemes.In addition,the numerical simulation results are consistent with the theoretical analysis results,thus verifying the effectiveness of the proposed scheme.

Distributed Robust Optimal Dispatch of Regional Integrated Energy Systems Based on ADMM Algorithm with Adaptive Step Size

This paper proposes a distributed robust optimal dispatch model to enhance information security and interaction among the operators in the regional integrated energy system(RIES).Our model regards the distribution network and each energy hub(EH)as independent operators and employs robust optimization to improve operational security caused by wind and photovoltaic(PV)power output uncertainties,with only deterministic information exchanged across boundaries.This paper also adopts the alternating direction method of multipliers(ADMM)algorithm to facilitate secure information interaction among multiple RIES operators,maximizing the benefit for each subject.Furthermore,the traditional ADMM algorithm with fixed step size is modified to be adaptive,addressing issues of redundant interactions caused by suboptimal initial step size settings.A case study validates the effectiveness of the proposed model,demonstrating the superiority of the ADMM algorithm with adaptive step size and the economic benefits of the distributed robust optimal dispatch model over the distributed stochastic optimal dispatch model.

Leader-follower Optimal Selection Method for Distributed Control System in Active Distribution Networks

Aiming at the shortcomings of a traditional centralized control in an active distribution network(AND),this paper proposes a leader-follower distributed group cooperative control strategy to realize multiple operation and control tasks for an ADN.The distributed information exchange protocols of the distributed generation(DG)group devoted to node voltage regulation or exchange power control are developed using a DG power utilization ratio as the consensus variable.On these bases,this study further investigates the leader optimal selection method for a DG group to improve the response speed of the distributed control system.Furthermore,a single or multiple leader selection model is established to minimize the constraints of the one-step convergence factor and the number of leaders to improve the response speed of the distributed control system.The simulation results of the IEEE 33 bus standard test system show the effectiveness of the proposed distributed control strategy.In addition,the response speed of a DG control group can be improved effectively when the single or multiple leaders are selected optimally.

Distributed Subgradient Algorithm for Multi-Agent Optimization With Dynamic Stepsize

In this paper,we consider distributed convex optimization problems on multi-agent networks.We develop and analyze the distributed gradient method which allows each agent to compute its dynamic stepsize by utilizing the time-varying estimate of the local function value at the global optimal solution.Our approach can be applied to both synchronous and asynchronous communication protocols.Specifically,we propose the distributed subgradient with uncoordinated dynamic stepsizes(DS-UD)algorithm for synchronous protocol and the AsynDGD algorithm for asynchronous protocol.Theoretical analysis shows that the proposed algorithms guarantee that all agents reach a consensus on the solution to the multi-agent optimization problem.Moreover,the proposed approach with dynamic stepsizes eliminates the requirement of diminishing stepsize in existing works.Numerical examples of distributed estimation in sensor networks are provided to illustrate the effectiveness of the proposed approach.

Distributed optimization of electricity-Gas-Heat integrated energy system with multi-agent deep reinforcement learning

The coordinated optimization problem of the electricity-gas-heat integrated energy system(IES)has the characteristics of strong coupling,non-convexity,and nonlinearity.The centralized optimization method has a high cost of communication and complex modeling.Meanwhile,the traditional numerical iterative solution cannot deal with uncertainty and solution efficiency,which is difficult to apply online.For the coordinated optimization problem of the electricity-gas-heat IES in this study,we constructed a model for the distributed IES with a dynamic distribution factor and transformed the centralized optimization problem into a distributed optimization problem in the multi-agent reinforcement learning environment using multi-agent deep deterministic policy gradient.Introducing the dynamic distribution factor allows the system to consider the impact of changes in real-time supply and demand on system optimization,dynamically coordinating different energy sources for complementary utilization and effectively improving the system economy.Compared with centralized optimization,the distributed model with multiple decision centers can achieve similar results while easing the pressure on system communication.The proposed method considers the dual uncertainty of renewable energy and load in the training.Compared with the traditional iterative solution method,it can better cope with uncertainty and realize real-time decision making of the system,which is conducive to the online application.Finally,we verify the effectiveness of the proposed method using an example of an IES coupled with three energy hub agents.

A Primal-Dual SGD Algorithm for Distributed Nonconvex Optimization

The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of n local cost functions by using local information exchange is considered.This problem is an important component of many machine learning techniques with data parallelism,such as deep learning and federated learning.We propose a distributed primal-dual stochastic gradient descent(SGD)algorithm,suitable for arbitrarily connected communication networks and any smooth(possibly nonconvex)cost functions.We show that the proposed algorithm achieves the linear speedup convergence rate O(1/(√nT))for general nonconvex cost functions and the linear speedup convergence rate O(1/(nT)) when the global cost function satisfies the Polyak-Lojasiewicz(P-L)condition,where T is the total number of iterations.We also show that the output of the proposed algorithm with constant parameters linearly converges to a neighborhood of a global optimum.We demonstrate through numerical experiments the efficiency of our algorithm in comparison with the baseline centralized SGD and recently proposed distributed SGD algorithms.

Distributed optimization for discrete-time multiagent systems with nonconvex control input constraints and switching topologies

This paper addresses the distributed optimization problem of discrete-time multiagent systems with nonconvex control input constraints and switching topologies.We introduce a novel distributed optimization algorithm with a switching mechanism to guarantee that all agents eventually converge to an optimal solution point,while their control inputs are constrained in their own nonconvex region.It is worth noting that the mechanism is performed to tackle the coexistence of the nonconvex constraint operator and the optimization gradient term.Based on the dynamic transformation technique,the original nonlinear dynamic system is transformed into an equivalent one with a nonlinear error term.By utilizing the nonnegative matrix theory,it is shown that the optimization problem can be solved when the union of switching communication graphs is jointly strongly connected.Finally,a numerical simulation example is used to demonstrate the acquired theoretical results.

Distributed Optimization for Heterogenous Second⁃Order Multi⁃Agent Systems

A continuous⁃time distributed optimization was researched for second⁃order heterogeneous multi⁃agent systems.The aim of this study is to keep the velocities of all agents the same and make the velocities converge to the optimal value to minimize the sum of local cost functions.First,an effective distributed controller which only uses local information was designed.Then,the stability and optimization of the systems were verified.Finally,a simulation case was used to illustrate the analytical results.

Optimal distribution of reliability for a large network based on connectivity

It is a non-polynomial complexity problem to calculate connectivity of the complex network. When the system reliability cannot be expressed as a function of element reliability, we have to apply some heuristic methods for optimization based on connectivity of the network. The calculation structure of connectivity of complex network is analyzed in the paper. The coefficient matrixes of Taylor second order expansion of the system connectivity is generated based on the calculation structure of connectivity of complex network. An optimal schedule is achieved based on genetic algorithms （GA）. Fitness of seeds is calculated using the Taylor expansion function of system connectivity. Precise connectivity of the optimal schedule and the Taylor expansion function of system connectivity can be achieved by the approved Minty method or the recursive decomposition algorithm. When error between approximate connectivity and the precise value exceeds the assigned value, the optimization process is continued using GA, and the Taylor function of system connectivity needs to be renewed. The optimization process is called iterative GA. Iterative GA can be used in the large network for optimal reliability attribution. One temporary optimal result will be generated every time in the iteration process. These temporary optimal results approach the real optimal results. They can be regarded as a group of approximate optimal results useful in the real project.

THE OPTIMAL ACTIVITY DISTRIBUTION IN NONISOTHERMAL PELLETS

The nonisothermal effectiveness fcator for reaction with kinetics r=kc^m/(l+Kc)~a can be improved bycatalysts with nonuniform activity distribution.The optimal distribution function in one-dimensional modelwith which the effectiveness factor can be maximized is a δ-function which means that the activity of thecatalyst should be concentrated on a layer with negligible thickness in a precise locationfrom the centerof pellets.The general equations for predicting the value ofand maximum effectiveness factor as a functionof thermodynamic,kinetic and transport parameters are derived and they can be given explicitly in the case ofa=O,m=a or isothermal reaction.An active layer with definite thickness and a deviation from the optimal locationboth decrease thevalue of the effectiveness factor.It has been shown numerically that the effectiveness factor decreases slightlywith an active layer at the inner side of x but seriously at outer side.

OPTIMAL DYNAMIC LOAD DISTRIBUTION OF MULTIPLE COOPERATING ROBOT MANIPULATORS

For the situation of multiple cooperating manipulators handling a single object,an equilibrium equation is presented in which the manipulator dynamics and control forces/torques are taken into account,and a expression is derived to allow the optimal dynamic load distribution of the combined system can be made.