Autonomous Vehicle Platoons In Urban Road Networks:A Joint Distributed Reinforcement Learning and Model Predictive Control Approach

In this paper, platoons of autonomous vehicles operating in urban road networks are considered. From a methodological point of view, the problem of interest consists of formally characterizing vehicle state trajectory tubes by means of routing decisions complying with traffic congestion criteria. To this end, a novel distributed control architecture is conceived by taking advantage of two methodologies: deep reinforcement learning and model predictive control. On one hand, the routing decisions are obtained by using a distributed reinforcement learning algorithm that exploits available traffic data at each road junction. On the other hand, a bank of model predictive controllers is in charge of computing the more adequate control action for each involved vehicle. Such tasks are here combined into a single framework:the deep reinforcement learning output(action) is translated into a set-point to be tracked by the model predictive controller;conversely, the current vehicle position, resulting from the application of the control move, is exploited by the deep reinforcement learning unit for improving its reliability. The main novelty of the proposed solution lies in its hybrid nature: on one hand it fully exploits deep reinforcement learning capabilities for decisionmaking purposes;on the other hand, time-varying hard constraints are always satisfied during the dynamical platoon evolution imposed by the computed routing decisions. To efficiently evaluate the performance of the proposed control architecture, a co-design procedure, involving the SUMO and MATLAB platforms, is implemented so that complex operating environments can be used, and the information coming from road maps(links,junctions, obstacles, semaphores, etc.) and vehicle state trajectories can be shared and exchanged. Finally by considering as operating scenario a real entire city block and a platoon of eleven vehicles described by double-integrator models, several simulations have been performed with the aim to put in light the main f eatures of the proposed approach. Moreover, it is important to underline that in different operating scenarios the proposed reinforcement learning scheme is capable of significantly reducing traffic congestion phenomena when compared with well-reputed competitors.

Distributed Economic MPC for Synergetic Regulation of the Voltage of an Island DC Micro-Grid

In this paper,distributed model predictive control(DMPC) for island DC micro-grids(MG) with wind/photovoltaic(PV)/battery power is proposed,which coordinates all distributed generations(DG) to stabilize the bus voltage together with the insurance of having computational efficiency under a real-time requirement.Based on the feedback of the bus voltage,the deviation of the current is dispatched to each DG according to cost over the prediction horizon.Moreover,to avoid the excessive fluctuation of the battery power,both the discharge-charge switching times and costs are considered in the model predictive control(MPC) optimization problems.A Lyapunov constraint with a time-varying steady-state is designed in each local MPC to guarantee the stabilization of the entire system.The voltage stabilization of the MG is achieved by this strategy with the cooperation of DGs.The numeric results of applying the proposed method to a MG of the Shanghai Power Supply Company shows the effectiveness of the distributed economic MPC.

Observer-based dynamic event-triggered control for distributed parameter systems over mobile sensor-plus-actuator networks

We develop a policy of observer-based dynamic event-triggered state feedback control for distributed parameter systems over a mobile sensor-plus-actuator network.It is assumed that the mobile sensing devices that provide spatially averaged state measurements can be used to improve state estimation in the network.For the purpose of decreasing the update frequency of controller and unnecessary sampled data transmission, an efficient dynamic event-triggered control policy is constructed.In an event-triggered system, when an error signal exceeds a specified time-varying threshold, it indicates the occurrence of a typical event.The global asymptotic stability of the event-triggered closed-loop system and the boundedness of the minimum inter-event time can be guaranteed.Based on the linear quadratic optimal regulator, the actuator selects the optimal displacement only when an event occurs.A simulation example is finally used to verify that the effectiveness of such a control strategy can enhance the system performance.

Virtually coupled train set control subject to space-time separation:A distributed economic MPC approach with emergency braking configuration

The emerging virtual coupling technology aims to operate multiple train units in a Virtually Coupled Train Set(VCTS)at a minimal but safe distance.To guarantee collision avoidance,the safety distance should be calculated using the state-of-the-art space-time separation principle that separates the Emergency Braking(EB)trajectories of two successive units during the whole EB process.In this case,the minimal safety distance is usually numerically calculated without an analytic formulation.Thus,the constrained VCTS control problem is hard to address with space-time separation,which is still a gap in the existing literature.To solve this problem,we propose a Distributed Economic Model Predictive Control(DEMPC)approach with computation efficiency and theoretical guarantee.Specifically,to alleviate the computation burden,we transform implicit safety constraints into explicitly linear ones,such that the optimal control problem in DEMPC is a quadratic programming problem that can be solved efficiently.For theoretical analysis,sufficient conditions are derived to guarantee the recursive feasibility and stability of DEMPC,employing compatibility constraints,tube techniques and terminal ingredient tuning.Moreover,we extend our approach with globally optimal and distributed online EB configuration methods to shorten the minimal distance among VCTS.Finally,experimental results demonstrate the performance and advantages of the proposed approaches.

Operation Control Method of Relay Protection in Flexible DC Distribution Network Compatible with Distributed Power Supply

A novel operation control method for relay protection in flexible DC distribution networks with distributed power supply is proposed to address the issue of inaccurate fault location during relay protection,leading to poor performance.The method combines a fault-tolerant fault location method based on long-term and short-term memory networks to accurately locate the fault section.Then,an operation control method for relay protection based on adaptive weight and whale optimization algorithm(WOA)is used to construct an objective function considering the shortest relay protection action time and the smallest impulse current.The adaptive weight and WOA are employed to obtain the optimal strategy for relay protection operation control,reducing the action time and impulse current.Experimental results demonstrate the effectiveness of the proposed method in accurately locating faults and improving relay protection performance.The longest operation time is reduced by 4.7023 s,and the maximum impulse current is limited to 0.3 A,effectively controlling the impact of large impulse currents and enhancing control efficiency.

基于DCS-惯性权重组合的柔性机械臂运动轨迹控制系统研究

为了有效调控机械臂运动幅度,避免柔性机械臂实际运动轨迹与目标轨迹发生较大的偏差,设计一种基于分散控制系统(DCS)-惯性权重组合的柔性机械臂运动轨迹控制系统,它是一个集合了计算机、通信、显示和控制的计算机系统,该系统由过程控制和过程监控。通过DCS算法控制监测对象行为幅度并计算柔性机械臂惯性权重,利用DCS-惯性权重组合求解素数控制指标的具体数值,实现了对柔性机械臂运动轨迹控制系统的软件设计。实验结果表明,DCS-惯性权重组合算法作用下的机械臂末端坐标在横轴、纵轴、空间轴方向上的运动幅值均可以被控制在10个单位长度之内,并且在0.52 s内进入机械臂运动轨迹最佳控制状态,运动轨迹差值最大仅为0.01 rad,验证了该系统具备可行性和有效性。

基于CNN的OCR技术在核电厂DCS系统测试中的应用和实现

核电厂分布式控制系统(DCS)的输入/输出模块在运行期间,随着电子器件性能下降以及时漂的影响,需要定期进行进度复测和校准。针对传统的DCS输入/输出通道测试覆盖率不足,测试效率低及人因问题,本文提出一种基于卷积神经网络(CNN)的光学字符识别(OCR)技术应用在DCS系统的在线测试方法。通过模拟设备和视频采集设备完成画面的自动切换,并读取画面信息,截取特定画面后对其图像预处理,再使用OCR识别模型识别画面内容,将得到的识别结果与期望值进行比较判断,从而实现自动化测试。测试结果表明,通过CNN训练后,显控设备画面字符识别率能达到100%,该方法可以突破设备厂家的专有通信协议的壁垒,可有效降低操作员的人因失误,提升测试效率和核电厂的经济性。

DCS控制器中电表接触传感器计量误差检测方法

由于DCS控制器中电表传感器在计量检测过程中,传统的B-MAC-DCS协议能耗和丢包率较高,无法缓解汇聚节点的漏斗效应,导致在远程抄表过程中传感器计量误差增大。提出一种机械电表接触传感器计量误差检测方法。采用小波基函数对DCS控制器中的接触传感器计量数据抗干扰处理,并通过动态选取阈值的方法,对经过小波变换后的数据去除噪声。使用低功耗自适应集簇分层型(low energy adaptive clustering hierarchy,LEACH)协议分簇代替传统的B-MAC协议;根据簇内监测值,引入阈值分析方法获取传感器计量指标,并将其作为判定依据进行误差检测,根据计量指标的变化情况判断是否存在计量误差。实验结果表明,所提方法可以准确且有效检测出机械电表接触传感器计量误差,解决DCS中机械电表的运行隐患问题。

DCS devices based non-linear process control system design for plants with distributed time-delay using particle filter

Remote control process system with distributed time-delay has attracted much attention in different fields.In this paper,non-linear remote control of a single tank process system with wireless network is considered.To deal with the distributed time-delay in a large-scale plant,the time-delay compensation controller based on DCS devices is designed by using operator theory and particle filter.Distributed control system(DCS)device is developed to monitor and control from the central monitoring room to each process.The particle filter is a probabilistic method to estimate unobservable information from observable information.First,remote control system and experimental equipment are introduced.Second,control system based on an operator theory is designed.Then,process system with distributed time-delay using particle filter is carried out.Finally,the actual experiment is conducted by using the proposed time-delay compensation controller.When estimating with the proposed method,the result is close to the case in which the distributed time-delay does not exist.The effectiveness of the proposed control system is confirmed by experiment results.

基于SCADA-DCS通讯技术的油气开采数据自动化采集与控制系统

设计基于SCADA-DCS通讯技术的油气开采数据自动化采集与控制系统。系统以SCADA服务器为上层监控服务器,通过与井站现场仪器仪表实时通信,监控整个开采过程。当油气缓冲罐液位越限时,SCADA服务器自动下达指令至原油处理站DCS,启动基于智能PID的油泵控制器,调节油泵变频器,控制油气液位不溢出。系统使用SCADA-DCS通讯技术的MODBUS通信协议,并根据通信中断优先级分配方法,确保对中断处理时间要求高的通信请求能实时响应。实验结果表明,该系统能提升油气液位控制和紧急信息通讯效率。

Optimal Cooperative Secondary Control for Islanded DC Microgrids via a Fully Actuated Approach

DC-DC converter-based multi-bus DC microgrids(MGs) in series have received much attention, where the conflict between voltage recovery and current balancing has been a hot topic. The lack of models that accurately portray the electrical characteristics of actual MGs while is controller design-friendly has kept the issue active. To this end, this paper establishes a large-signal model containing the comprehensive dynamical behavior of the DC MGs based on the theory of high-order fully actuated systems, and proposes distributed optimal control based on this. The proposed secondary control method can achieve the two goals of voltage recovery and current sharing for multi-bus DC MGs. Additionally, the simple structure of the proposed approach is similar to one based on droop control, which allows this control technique to be easily implemented in a variety of modern microgrids with different configurations. In contrast to existing studies, the process of controller design in this paper is closely tied to the actual dynamics of the MGs. It is a prominent feature that enables engineers to customize the performance metrics of the system. In addition, the analysis of the stability of the closed-loop DC microgrid system, as well as the optimality and consensus of current sharing are given. Finally, a scaled-down solar and battery-based microgrid prototype with maximum power point tracking controller is developed in the laboratory to experimentally test the efficacy of the proposed control method.

Data-Driven Control of Distributed Event-Triggered Network Systems

The present paper deals with data-driven event-triggered control of a class of unknown discrete-time interconnected systems(a.k.a.network systems).To this end,we start by putting forth a novel distributed event-triggering transmission strategy based on periodic sampling,under which a model-based stability criterion for the closed-loop network system is derived,by leveraging a discrete-time looped-functional approach.Marrying the model-based criterion with a data-driven system representation recently developed in the literature,a purely data-driven stability criterion expressed in the form of linear matrix inequalities(LMIs)is established.Meanwhile,the data-driven stability criterion suggests a means for co-designing the event-triggering coefficient matrix and the feedback control gain matrix using only some offline collected state-input data.Finally,numerical results corroborate the efficacy of the proposed distributed data-driven event-triggered network system(ETS)in cutting off data transmissions and the co-design procedure.

核电厂安全级DCS缺省值设置策略研究

针对数字化仪控系统中无效信号的质量位随意蔓延使系统处于一种不确定状态的问题,结合核电厂运行工况和信号特性,对龙鳞平台故障诊断机制和信号质量位标识进行研究。考虑故障安全准则,系统性地提出缺省值设置原则。从信号执行功能和信号边界两个维度进行分析,确认缺省值的设置范围,并详细给出执行保护功能、报警功能、维护和试验功能信号的缺省值设置策略。同时,针对传统的缺省值验证方式无法全面、有效地进行缺省值验证的问题,提出一种利用全范围模拟机和虚拟数字化控制系统(DCS)进行缺省值验证的新方法。利用该方法可有效地对DCS内设置的缺省值进行系统性的验证。所提出的缺省值设置策略和验证方法可为后续核电厂安全级DCS的缺省值分析和设置提供全面的指导。

An Optimal Control-Based Distributed Reinforcement Learning Framework for A Class of Non-Convex Objective Functionals of the Multi-Agent Network

This paper studies a novel distributed optimization problem that aims to minimize the sum of the non-convex objective functionals of the multi-agent network under privacy protection, which means that the local objective of each agent is unknown to others. The above problem involves complexity simultaneously in the time and space aspects. Yet existing works about distributed optimization mainly consider privacy protection in the space aspect where the decision variable is a vector with finite dimensions. In contrast, when the time aspect is considered in this paper, the decision variable is a continuous function concerning time. Hence, the minimization of the overall functional belongs to the calculus of variations. Traditional works usually aim to seek the optimal decision function. Due to privacy protection and non-convexity, the Euler-Lagrange equation of the proposed problem is a complicated partial differential equation.Hence, we seek the optimal decision derivative function rather than the decision function. This manner can be regarded as seeking the control input for an optimal control problem, for which we propose a centralized reinforcement learning(RL) framework. In the space aspect, we further present a distributed reinforcement learning framework to deal with the impact of privacy protection. Finally, rigorous theoretical analysis and simulation validate the effectiveness of our framework.

DCS在电除尘系统自动控制的应用研究

传统的电除尘器自动控制系统采用可编程逻辑控制器(PLC)控制,其逻辑复杂、可读性差、可维护性低。PLC系统无法与主控系统完成一体化,导致工艺上的割裂,额外地增加了运维成本。本文提出了一种基于分散控制系统(DCS)的电除尘器自动控制方案。

Optimal Configuration of Fault Location Measurement Points in DC Distribution Networks Based on Improved Particle Swarm Optimization Algorithm

The escalating deployment of distributed power sources and random loads in DC distribution networks hasamplified the potential consequences of faults if left uncontrolled. To expedite the process of achieving an optimalconfiguration of measurement points, this paper presents an optimal configuration scheme for fault locationmeasurement points in DC distribution networks based on an improved particle swarm optimization algorithm.Initially, a measurement point distribution optimization model is formulated, leveraging compressive sensing.The model aims to achieve the minimum number of measurement points while attaining the best compressivesensing reconstruction effect. It incorporates constraints from the compressive sensing algorithm and networkwide viewability. Subsequently, the traditional particle swarm algorithm is enhanced by utilizing the Haltonsequence for population initialization, generating uniformly distributed individuals. This enhancement reducesindividual search blindness and overlap probability, thereby promoting population diversity. Furthermore, anadaptive t-distribution perturbation strategy is introduced during the particle update process to enhance the globalsearch capability and search speed. The established model for the optimal configuration of measurement points issolved, and the results demonstrate the efficacy and practicality of the proposed method. The optimal configurationreduces the number of measurement points, enhances localization accuracy, and improves the convergence speedof the algorithm. These findings validate the effectiveness and utility of the proposed approach.

Research on Scheduling Strategy of Flexible Interconnection Distribution Network Considering Distributed Photovoltaic and Hydrogen Energy Storage

Distributed photovoltaic(PV)is one of the important power sources for building a new power system with new energy as the main body.The rapid development of distributed PV has brought new challenges to the operation of distribution networks.In order to improve the absorption ability of large-scale distributed PV access to the distribution network,the AC/DC hybrid distribution network is constructed based on flexible interconnection technology,and a coordinated scheduling strategy model of hydrogen energy storage(HS)and distributed PV is established.Firstly,the mathematical model of distributed PV and HS system is established,and a comprehensive energy storage system combining seasonal hydrogen energy storage(SHS)and battery(BT)is proposed.Then,a flexible interconnected distribution network scheduling optimization model is established to minimize the total active power loss,voltage deviation and system operating cost.Finally,simulation analysis is carried out on the improved IEEE33 node,the NSGA-II algorithm is used to solve specific examples,and the optimal scheduling results of the comprehensive economy and power quality of the distribution network are obtained.Compared with the method that does not consider HS and flexible interconnection technology,the network loss and voltage deviation of this method are lower,and the total system cost can be reduced by 3.55%,which verifies the effectiveness of the proposed method.

DCS系统在燃气输配控制中的应用研究进展

为探讨DCS系统在燃气输配控制中的应用,并分析其通过实时监测和控制关键参数来提高系统效率和安全性的能力。采用DCS系统对天然气输配网络进行实时监测和控制。通过对天然气管道的压力、温度、流量等关键参数进行实时采集和调节,确保系统运行在稳定、高效的状态。同时,利用DCS系统的强大数据采集、处理和分析能力,对输配过程中的故障和异常情况进行快速诊断和处理,以提高故障排除的效率。此外,DCS系统还支持网络化和远程控制功能,实现对不同地理位置的天然气输配网络的集中监管和管理。结果表明:通过应用DCS系统,燃气输配控制实现了高效、准确和可靠的管理。实时监测和调节关键参数确保了系统运行的安全性和稳定性。快速诊断和处理故障和异常情况提高了故障排除的效率。网络化和远程控制功能实现了对不同地理位置的天然气输配网络的统一监管和管理,提高了管理效率。DCS系统在燃气输配控制中的应用具有重要意义和潜力。通过实时监测和控制关键参数,可以提高系统的效率和安全性。然而,该系统的应用也面临一些挑战,如高成本、技术难题以及应急处理等方面的问题。因此,需要进一步的技术研发和应用实践来不断提升DCS系统的性能和可靠性,以更好地满足燃气输配控制的需求。

Rapid Parameter-Optimizing Strategy for Plug-and-Play Devices in DC Distribution Systems under the Background of Digital Transformation

By integrating advanced digital technologies such as cloud computing and the Internet of Things in sensor measurement,information communication,and other fields,the digital DC distribution network can efficiently and reliably access DistributedGenerator(DG)and Energy Storage Systems(ESS),exhibiting significant advantages in terms of controllability and meeting requirements of Plug-and-Play(PnP)operations.However,during device plug-in and-out processes,improper systemparametersmay lead to small-signal stability issues.Therefore,before executing PnP operations,conducting stability analysis and adjusting parameters swiftly is crucial.This study introduces a four-stage strategy for parameter optimization to enhance systemstability efficiently.In the first stage,state-of-the-art technologies in measurement and communication are utilized to correct model parameters.Then,a novel indicator is adopted to identify the key parameters that influence stability in the second stage.Moreover,in the third stage,a local-parameter-tuning strategy,which leverages rapid parameter boundary calculations as a more efficient alternative to plotting root loci,is used to tune the selected parameters.Considering that the local-parameter-tuning strategy may fail due to some operating parameters being limited in adjustment,a multiparameter-tuning strategy based on the particle swarm optimization(PSO)is proposed to comprehensively adjust the dominant parameters to improve the stability margin of the system.Lastly,system stability is reassessed in the fourth stage.The proposed parameter-optimization strategy’s effectiveness has been validated through eigenvalue analysis and nonlinear time-domain simulations.

Differential flatness-based distributed control of underactuated robot swarms

This paper proposes a distributed control method based on the differential flatness(DF) property of robot swarms. The swarm DF mapping is established for underactuated differentially flat dynamics, according to the control objective. The DF mapping refers to the fact that the system state and input of each robot can be derived algebraically from the flat outputs of the leaders and the cooperative errors and their finite order derivatives. Based on the proposed swarm DF mapping, a distributed controller is designed. The distributed implementation of swarm DF mapping is achieved through observer design. The effectiveness of the proposed method is validated through a numerical simulation of quadrotor swarm synchronization.