At present,albeit the dexterous hand prostheses of multiple degrees of freedom(DOFs)have become prosperous on the market,the user’s demand on intuitively operating these devices have not been well addressed so that t...At present,albeit the dexterous hand prostheses of multiple degrees of freedom(DOFs)have become prosperous on the market,the user’s demand on intuitively operating these devices have not been well addressed so that their acceptance rate is relatively low.The unintuitive control method and inadequate sensory feedback are frequently cited as the two barriers to the successful application of these dexterous products.Recently,driven by the wave of artificial intelligence(AI),a series of shared control methods have emerged,in which"bodily function"(myoelectric control)and"artificial intelligence"(local autonomy,computer vision,etc.)are tightly integrated,and provided a new conceptual solution for the intuitive operation of dexterous prostheses.In this paper,the background and development trends of this type of methods are described in detail,and the potential development directions and the key technologies that need breakthroughs are indicated.In practice,we instantiate this shared control strategy by proposing a new method combining simultaneous myoelectric control,multi-finger grasp autonomy,and augmented reality(AR)feedback together.This method"divides"the human sophisticated reach-and-grasp task into several subtasks,and then"conquers"them by using different strategies from either human or machine perspective.It is highly expected that the shared control methods with hybrid human-machine intelligence could address the control problem of dexterous prostheses.展开更多
Intelligent vehicle(Ⅳ)technology has developed rapidly in recent years.However,achieving fully unmanned driving still presents numerous challenges,which means that human drivers will continue to play a vital role in ...Intelligent vehicle(Ⅳ)technology has developed rapidly in recent years.However,achieving fully unmanned driving still presents numerous challenges,which means that human drivers will continue to play a vital role in vehicle operation for the foreseeable future.Human-machine shared driving,involving cooperation between a human driver and an automated driving system(AVS),has been widely regarded as a necessary stage for the development of IVs.Focusing onⅣdriving safety,this study proposed a human-machine shared lateral control strategy(HSLCS)based on the reliability of driver risk perception.The HSLCS starts by identifying the effective areas of driver risk perception based on eye movements.It establishes an anisotropic driving risk field,which serves as the foundation for the AVS to assess risk levels.Building upon the cumulative and diminishing effects of risk perception,the proposed approach leverages the driver's risk perception effective area and converts the risk field into a representation aligned with the driver's perspective.Subsequently,it quantifies the reliability of the driver's risk perception by using area-matching rules.Finally,based on the driver’s risk perception reliability and dif-ferences in lateral driving operation between the human driver and the AVS,the dynamic distribution of driving authority is achieved through a fuzzy rule-based system,and the human-machine shared lateral control is completed by using model predictive control.The HSLCS was tested across various scenarios on a driver-in-the-loop test platform.The results show that the HSLCS can realize the synergy and complementarity of human and machine intelligence,effectively ensuring the safety ofⅣoperation.展开更多
Shared control schemes allow a human driver to work with an automated driving agent in driver-vehicle systems while retaining the driver’s abilities to control.The human driver,as an essential agent in the driver-veh...Shared control schemes allow a human driver to work with an automated driving agent in driver-vehicle systems while retaining the driver’s abilities to control.The human driver,as an essential agent in the driver-vehicle shared control systems,should be precisely modeled regarding their cognitive processes,control strategies,and decision-making processes.The interactive strategy design between drivers and automated driving agents brings an excellent challenge for human-centric driver assistance systems due to the inherent characteristics of humans.Many open-ended questions arise,such as what proper role of human drivers should act in a shared control scheme?How to make an intelligent decision capable of balancing the benefits of agents in shared control systems?Due to the advent of these attentions and questions,it is desirable to present a survey on the decision making between human drivers and highly automated vehicles,to understand their architectures,human driver modeling,and interaction strategies under the driver-vehicle shared schemes.Finally,we give a further discussion on the key future challenges and opportunities.They are likely to shape new potential research directions.展开更多
A shared control of highly automated Steer-by-Wire system is proposed for cooperative driving between the driver and vehicle in the face of driver's abnormal driving. A fault detection scheme is designed to detect...A shared control of highly automated Steer-by-Wire system is proposed for cooperative driving between the driver and vehicle in the face of driver's abnormal driving. A fault detection scheme is designed to detect the abnormal driving behaviour and transfer the control of the car to the automatic system designed based on a fault tolerant model predictive control(MPC) controller driving the vehicle along an optimal safe path.The proposed concept and control algorithm are tested in a number of scenarios representing intersection, lane change and different types of driver's abnormal behaviour. The simulation results show the feasibility and effectiveness of the proposed method.展开更多
Due to the critical defects of techniques in fully autonomous vehicles,man-machine cooperative driving is still of great significance in today’s transportation system.Unlike the previous shared control structure,this...Due to the critical defects of techniques in fully autonomous vehicles,man-machine cooperative driving is still of great significance in today’s transportation system.Unlike the previous shared control structure,this paper introduces a double loop structure which is applied to indirect shared steering control between driver and automation.In contrast to the tandem indirect shared control,the parallel indirect shared control put the authority allocation system of steering angle into the framework to allocate the corresponding weighting coefficients reasonably and output the final desired steering angle according to the current deviation of vehicle and the accuracy of steering angles.Besides,the active disturbance rejection controller(ADRC)is also added in the frame in order to track the desired steering angle fleetly and accurately as well as restrain the internal and external disturbances effectively which including the steering friction torque,wind speed and ground interference etc.Eventually,we validated the advantages of double loop framework through three sets of double lane change and slalom experiments,respectively.Exactly as we expected,the simulation results show that the double loop structure can effectively reduce the lateral displacement error caused by the driver or the controller,significantly improve the tracking precision and keep great performance in trajectory tracking characteristics when driving errors occur in one of driver and controller.展开更多
The driver-automation shared driving is a transition to fully-autonomous driving,in which human driver and vehicular controller cooperatively share the control authority.This paper investigates the shared steering con...The driver-automation shared driving is a transition to fully-autonomous driving,in which human driver and vehicular controller cooperatively share the control authority.This paper investigates the shared steering control of semi-autonomous vehicles with uncertainty from imprecise parameter.By considering driver’s lane-keeping behavior on the vehicle system,a driver-automation shared driving model is introduced for control purpose.Based on the interval type-2(IT2)fuzzy theory,moreover,the driver-automation shared driving model with uncertainty from imprecise parameter is described using an IT2 fuzzy model.After that,the corresponding IT2 fuzzy controller is designed and a direct Lyapunov method is applied to analyze the system stability.In this work,sufficient design conditions in terms of linear matrix inequalities are derived,to guarantee the closed-loop stability of the driver-automation shared control system.In addition,an H∞performance is studied to ensure the robustness of control system.Finally,simulation-based results are provided to demonstrate the performance of proposed control method.Furthermore,an existing type-1 fuzzy controller is introduced as comparison to verify the superiority of the proposed IT2 fuzzy controller.展开更多
A concurrency control mechanism for collaborative work is akey element in a mixed reality environment. However, conventional lockingmechanisms restrict potential tasks or the support of non-owners, thusincreasing the ...A concurrency control mechanism for collaborative work is akey element in a mixed reality environment. However, conventional lockingmechanisms restrict potential tasks or the support of non-owners, thusincreasing the working time because of waiting to avoid conflicts. Herein, wepropose an adaptive concurrency control approach that can reduce conflictsand work time. We classify shared object manipulation in mixed reality intodetailed goals and tasks. Then, we model the relationships among goal,task, and ownership. As the collaborative work progresses, the proposedsystem adapts the different concurrency control mechanisms of shared objectmanipulation according to the modeling of goal–task–ownership. With theproposed concurrency control scheme, users can hold shared objects andmove and rotate together in a mixed reality environment similar to realindustrial sites. Additionally, this system provides MS Hololens and Myosensors to recognize inputs from a user and provides results in a mixed realityenvironment. The proposed method is applied to install an air conditioneras a case study. Experimental results and user studies show that, comparedwith the conventional approach, the proposed method reduced the number ofconflicts, waiting time, and total working time.展开更多
Data trading enables data owners and data requesters to sell and purchase data.With the emergence of blockchain technology,research on blockchain-based data trading systems is receiving a lot of attention.Particularly...Data trading enables data owners and data requesters to sell and purchase data.With the emergence of blockchain technology,research on blockchain-based data trading systems is receiving a lot of attention.Particularly,to reduce the on-chain storage cost,a novel paradigm of blockchain and cloud fusion has been widely considered as a promising data trading platform.Moreover,the fact that data can be used for commercial purposes will encourage users and organizations from various fields to participate in the data marketplace.In the data marketplace,it is a challenge how to trade the data securely outsourced to the external cloud in a way that restricts access to the data only to authorized users across multiple domains.In this paper,we propose a cross-domain bilateral access control protocol for blockchain-cloud based data trading systems.We consider a system model that consists of domain authorities,data senders,data receivers,a blockchain layer,and a cloud provider.The proposed protocol enables access control and source identification of the outsourced data by leveraging identity-based cryptographic techniques.In the proposed protocol,the outsourced data of the sender is encrypted under the target receiver’s identity,and the cloud provider performs policy-match verification on the authorization tags of the sender and receiver generated by the identity-based signature scheme.Therefore,data trading can be achieved only if the identities of the data sender and receiver simultaneously meet the policies specified by each other.To demonstrate efficiency,we evaluate the performance of the proposed protocol and compare it with existing studies.展开更多
This article studies the effective traffic signal control problem of multiple intersections in a city-level traffic system.A novel regional multi-agent cooperative reinforcement learning algorithm called RegionSTLight...This article studies the effective traffic signal control problem of multiple intersections in a city-level traffic system.A novel regional multi-agent cooperative reinforcement learning algorithm called RegionSTLight is proposed to improve the traffic efficiency.Firstly a regional multi-agent Q-learning framework is proposed,which can equivalently decompose the global Q value of the traffic system into the local values of several regions Based on the framework and the idea of human-machine cooperation,a dynamic zoning method is designed to divide the traffic network into several strong-coupled regions according to realtime traffic flow densities.In order to achieve better cooperation inside each region,a lightweight spatio-temporal fusion feature extraction network is designed.The experiments in synthetic real-world and city-level scenarios show that the proposed RegionS TLight converges more quickly,is more stable,and obtains better asymptotic performance compared to state-of-theart models.展开更多
The Controller Area Network (CAN) is a well established control network for automotive and automation control applications. Time-Triggered Controller Area Network (TTCAN) is a recent development which introduces a ses...The Controller Area Network (CAN) is a well established control network for automotive and automation control applications. Time-Triggered Controller Area Network (TTCAN) is a recent development which introduces a session layer,for message scheduling,to the existing CAN standard,which is a two layer standard comprising of a physical layer and a data link layer. TTCAN facilitates network communication in a time-triggered fashion,by introducing a Time Division Multiple Access style communication scheme. This allows deterministic network behavior,where maximum message latency times can be quantified and guaranteed. In order to solve the problem of determinate time latency and synchronization among several districted units in one auto panel CAN systems,this paper proposed a prototype design implementation for a shared-clock scheduler based on PIC18F458 MCU. This leads to improved CAN system performance and avoid the latency jitters and guarantee a deterministic communication pattern on the bus. The real runtime performance is satisfied.展开更多
The theory of shared control combines organically the control of every controlled ele-ments and with it all the controlled elements share the same control element. Applying theschemes of shared control searched by ass...The theory of shared control combines organically the control of every controlled ele-ments and with it all the controlled elements share the same control element. Applying theschemes of shared control searched by assembly programs, an integrated control of all the ele-ments is fulfilled. The distinguishing point of the method is that the maximum control output canbe obtained with the least input information. Hence it is the optimum for the conversion of com-bination states. Finally, a thared rotary valve is designed, and it is the simplest with only onegroup of control holes.展开更多
With integration of large-scale renewable energy,new controllable devices,and required reinforcement of power grids,modern power systems have typical characteristics such as uncertainty,vulnerability and openness,whic...With integration of large-scale renewable energy,new controllable devices,and required reinforcement of power grids,modern power systems have typical characteristics such as uncertainty,vulnerability and openness,which makes operation and control of power grids face severe security challenges.Application of artificial intelligence(AI)technologies represented by machine learning in power grid regulation is limited by reliability,interpretability and generalization ability of complex modeling.Mode of hybrid-augmented intelligence(HAI)based on human-machine collaboration(HMC)is a pivotal direction for future development of AI technology in this field.Based on characteristics of applications in power grid regulation,this paper discusses system architecture and key technologies of human-machine hybrid-augmented intelligence(HHI)system for large-scale power grid dispatching and control(PGDC).First,theory and application scenarios of HHI are introduced and analyzed;then physical and functional architectures of HHI system and human-machine collaborative regulation process are proposed.Key technologies are discussed to achieve a thorough integration of human/machine intelligence.Finally,state-of-theart and future development of HHI in power grid regulation are summarized,aiming to efficiently improve the intelligent level of power grid regulation in a human-machine interactive and collaborative way.展开更多
This paper presents a Shared Control Architecture(SCA)between a human pilot and a smart inceptor for nonlinear Pilot Induced Oscillations(PIOs),e.g.,category II or III PIOs.One innovation of this paper is that an inte...This paper presents a Shared Control Architecture(SCA)between a human pilot and a smart inceptor for nonlinear Pilot Induced Oscillations(PIOs),e.g.,category II or III PIOs.One innovation of this paper is that an intelligent shared control architecture is developed based on the intelligent active inceptor technique,i.e.,Smart Adaptive Flight Effective Cue(SAFE-Cue).A deep reinforcement learning approach namely Deep Deterministic Policy Gradient(DDPG)method is chosen to design a gain adaptation mechanism for the SAFE-Cue module.By doing this,the gains of the SAFE-Cue will be intelligently tuned once nonlinear PIOs triggered;meanwhile,the human pilot will receive a force cue from the SAFE-Cue,and will consequently adapting his/her control policy.The second innovation of this paper is that the reward function of the DDPG based gain adaptation approach is constructed according to flying qualities.Under the premise of considering failure situation,task completion qualities and pilot workload are also taken into account.Finally,the proposed approach is validated using numerical simulation experiments with two types of scenarios:lower actuator rate limits and airframe damages.The Inceptor Peak Power-Phase(IPPP)metric is adopted to analyze the human-vehicle system simulation results.Results and analysis show that the DDPG based sharing control approach can well address nonlinear PIO problems consisting of Categories Ⅱ and Ⅲ PIO events.展开更多
Power sharing among multiterminal high voltage direct current terminals(MT-HVDC)is mainly developed based on a priority or sequential manners,which uses to prevent the problem of overloading due to a predefined contro...Power sharing among multiterminal high voltage direct current terminals(MT-HVDC)is mainly developed based on a priority or sequential manners,which uses to prevent the problem of overloading due to a predefined controller coefficient.Furthermore,fixed power sharing control also suffers from an inability to identify power availability at a rectification station.There is a need for a controller that ensures an efficient power sharing among the MT-HVDC terminals,prevents the possibility of overloading,and utilizes the available power sharing.A new adaptive wireless control for active power sharing among multiterminal(MT-HVDC)systems,including power availability and power management policy,is proposed in this paper.The proposed control strategy solves these issues and,this proposed controller strategy is a generic method that can be applied for unlimited number of converter stations.The rational of this proposed controller is to increase the system reliability by avoiding the necessity of fast communication links.The test system in this paper consists of four converter stations based on three phase-two AC voltage levels.The proposed control strategy for a multiterminal HVDC system is conducted in the power systems computer aided design/electromagnetic transient design and control(PSCAD/EMTDC)simulation environment.The simulation results significantly show the flexibility and usefulness of the proposed power sharing control provided by the new adaptive wireless method.展开更多
基金supported by the National Key R&D Program of China(Grant No.2018YFB1307201)the National Natural Science Foundation of China(Grant No.51675123)the Postdoctoral Scientific Research Development Fund(Grant No.LBH-W18058)。
文摘At present,albeit the dexterous hand prostheses of multiple degrees of freedom(DOFs)have become prosperous on the market,the user’s demand on intuitively operating these devices have not been well addressed so that their acceptance rate is relatively low.The unintuitive control method and inadequate sensory feedback are frequently cited as the two barriers to the successful application of these dexterous products.Recently,driven by the wave of artificial intelligence(AI),a series of shared control methods have emerged,in which"bodily function"(myoelectric control)and"artificial intelligence"(local autonomy,computer vision,etc.)are tightly integrated,and provided a new conceptual solution for the intuitive operation of dexterous prostheses.In this paper,the background and development trends of this type of methods are described in detail,and the potential development directions and the key technologies that need breakthroughs are indicated.In practice,we instantiate this shared control strategy by proposing a new method combining simultaneous myoelectric control,multi-finger grasp autonomy,and augmented reality(AR)feedback together.This method"divides"the human sophisticated reach-and-grasp task into several subtasks,and then"conquers"them by using different strategies from either human or machine perspective.It is highly expected that the shared control methods with hybrid human-machine intelligence could address the control problem of dexterous prostheses.
基金supported by the National Natural Science Foundation of China under Grant 52172386the National Natural Science Foundation of China under Grant U22A20247+1 种基金the Jilin Province Science and Technology Development Plan Projects under Grant 20210101057JCthe Jilin Provincial Department of Science and Technology under Grant 20220301009GX.
文摘Intelligent vehicle(Ⅳ)technology has developed rapidly in recent years.However,achieving fully unmanned driving still presents numerous challenges,which means that human drivers will continue to play a vital role in vehicle operation for the foreseeable future.Human-machine shared driving,involving cooperation between a human driver and an automated driving system(AVS),has been widely regarded as a necessary stage for the development of IVs.Focusing onⅣdriving safety,this study proposed a human-machine shared lateral control strategy(HSLCS)based on the reliability of driver risk perception.The HSLCS starts by identifying the effective areas of driver risk perception based on eye movements.It establishes an anisotropic driving risk field,which serves as the foundation for the AVS to assess risk levels.Building upon the cumulative and diminishing effects of risk perception,the proposed approach leverages the driver's risk perception effective area and converts the risk field into a representation aligned with the driver's perspective.Subsequently,it quantifies the reliability of the driver's risk perception by using area-matching rules.Finally,based on the driver’s risk perception reliability and dif-ferences in lateral driving operation between the human driver and the AVS,the dynamic distribution of driving authority is achieved through a fuzzy rule-based system,and the human-machine shared lateral control is completed by using model predictive control.The HSLCS was tested across various scenarios on a driver-in-the-loop test platform.The results show that the HSLCS can realize the synergy and complementarity of human and machine intelligence,effectively ensuring the safety ofⅣoperation.
文摘Shared control schemes allow a human driver to work with an automated driving agent in driver-vehicle systems while retaining the driver’s abilities to control.The human driver,as an essential agent in the driver-vehicle shared control systems,should be precisely modeled regarding their cognitive processes,control strategies,and decision-making processes.The interactive strategy design between drivers and automated driving agents brings an excellent challenge for human-centric driver assistance systems due to the inherent characteristics of humans.Many open-ended questions arise,such as what proper role of human drivers should act in a shared control scheme?How to make an intelligent decision capable of balancing the benefits of agents in shared control systems?Due to the advent of these attentions and questions,it is desirable to present a survey on the decision making between human drivers and highly automated vehicles,to understand their architectures,human driver modeling,and interaction strategies under the driver-vehicle shared schemes.Finally,we give a further discussion on the key future challenges and opportunities.They are likely to shape new potential research directions.
文摘A shared control of highly automated Steer-by-Wire system is proposed for cooperative driving between the driver and vehicle in the face of driver's abnormal driving. A fault detection scheme is designed to detect the abnormal driving behaviour and transfer the control of the car to the automatic system designed based on a fault tolerant model predictive control(MPC) controller driving the vehicle along an optimal safe path.The proposed concept and control algorithm are tested in a number of scenarios representing intersection, lane change and different types of driver's abnormal behaviour. The simulation results show the feasibility and effectiveness of the proposed method.
基金supported by the National Natural Science Foundation of China(U1664263)。
文摘Due to the critical defects of techniques in fully autonomous vehicles,man-machine cooperative driving is still of great significance in today’s transportation system.Unlike the previous shared control structure,this paper introduces a double loop structure which is applied to indirect shared steering control between driver and automation.In contrast to the tandem indirect shared control,the parallel indirect shared control put the authority allocation system of steering angle into the framework to allocate the corresponding weighting coefficients reasonably and output the final desired steering angle according to the current deviation of vehicle and the accuracy of steering angles.Besides,the active disturbance rejection controller(ADRC)is also added in the frame in order to track the desired steering angle fleetly and accurately as well as restrain the internal and external disturbances effectively which including the steering friction torque,wind speed and ground interference etc.Eventually,we validated the advantages of double loop framework through three sets of double lane change and slalom experiments,respectively.Exactly as we expected,the simulation results show that the double loop structure can effectively reduce the lateral displacement error caused by the driver or the controller,significantly improve the tracking precision and keep great performance in trajectory tracking characteristics when driving errors occur in one of driver and controller.
基金Supported by Defense Industrial Technology Development Program.
文摘The driver-automation shared driving is a transition to fully-autonomous driving,in which human driver and vehicular controller cooperatively share the control authority.This paper investigates the shared steering control of semi-autonomous vehicles with uncertainty from imprecise parameter.By considering driver’s lane-keeping behavior on the vehicle system,a driver-automation shared driving model is introduced for control purpose.Based on the interval type-2(IT2)fuzzy theory,moreover,the driver-automation shared driving model with uncertainty from imprecise parameter is described using an IT2 fuzzy model.After that,the corresponding IT2 fuzzy controller is designed and a direct Lyapunov method is applied to analyze the system stability.In this work,sufficient design conditions in terms of linear matrix inequalities are derived,to guarantee the closed-loop stability of the driver-automation shared control system.In addition,an H∞performance is studied to ensure the robustness of control system.Finally,simulation-based results are provided to demonstrate the performance of proposed control method.Furthermore,an existing type-1 fuzzy controller is introduced as comparison to verify the superiority of the proposed IT2 fuzzy controller.
基金supported by“Regional Innovation Strategy (RIS)”through the National Research Foundation of Korea (NRF)funded by the Ministry of Education (MOE) (2021RIS-004).
文摘A concurrency control mechanism for collaborative work is akey element in a mixed reality environment. However, conventional lockingmechanisms restrict potential tasks or the support of non-owners, thusincreasing the working time because of waiting to avoid conflicts. Herein, wepropose an adaptive concurrency control approach that can reduce conflictsand work time. We classify shared object manipulation in mixed reality intodetailed goals and tasks. Then, we model the relationships among goal,task, and ownership. As the collaborative work progresses, the proposedsystem adapts the different concurrency control mechanisms of shared objectmanipulation according to the modeling of goal–task–ownership. With theproposed concurrency control scheme, users can hold shared objects andmove and rotate together in a mixed reality environment similar to realindustrial sites. Additionally, this system provides MS Hololens and Myosensors to recognize inputs from a user and provides results in a mixed realityenvironment. The proposed method is applied to install an air conditioneras a case study. Experimental results and user studies show that, comparedwith the conventional approach, the proposed method reduced the number ofconflicts, waiting time, and total working time.
基金supported by Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(No.2022R1I1A3063257)supported by the MSIT(Ministry of Science and ICT),Korea,under the Special R&D Zone Development Project(R&D)—Development of R&D Innovation Valley Support Program(2023-DD-RD-0152)supervised by the Innovation Foundation.
文摘Data trading enables data owners and data requesters to sell and purchase data.With the emergence of blockchain technology,research on blockchain-based data trading systems is receiving a lot of attention.Particularly,to reduce the on-chain storage cost,a novel paradigm of blockchain and cloud fusion has been widely considered as a promising data trading platform.Moreover,the fact that data can be used for commercial purposes will encourage users and organizations from various fields to participate in the data marketplace.In the data marketplace,it is a challenge how to trade the data securely outsourced to the external cloud in a way that restricts access to the data only to authorized users across multiple domains.In this paper,we propose a cross-domain bilateral access control protocol for blockchain-cloud based data trading systems.We consider a system model that consists of domain authorities,data senders,data receivers,a blockchain layer,and a cloud provider.The proposed protocol enables access control and source identification of the outsourced data by leveraging identity-based cryptographic techniques.In the proposed protocol,the outsourced data of the sender is encrypted under the target receiver’s identity,and the cloud provider performs policy-match verification on the authorization tags of the sender and receiver generated by the identity-based signature scheme.Therefore,data trading can be achieved only if the identities of the data sender and receiver simultaneously meet the policies specified by each other.To demonstrate efficiency,we evaluate the performance of the proposed protocol and compare it with existing studies.
基金supported by the National Science and Technology Major Project (2021ZD0112702)the National Natural Science Foundation (NNSF)of China (62373100,62233003)the Natural Science Foundation of Jiangsu Province of China (BK20202006)。
文摘This article studies the effective traffic signal control problem of multiple intersections in a city-level traffic system.A novel regional multi-agent cooperative reinforcement learning algorithm called RegionSTLight is proposed to improve the traffic efficiency.Firstly a regional multi-agent Q-learning framework is proposed,which can equivalently decompose the global Q value of the traffic system into the local values of several regions Based on the framework and the idea of human-machine cooperation,a dynamic zoning method is designed to divide the traffic network into several strong-coupled regions according to realtime traffic flow densities.In order to achieve better cooperation inside each region,a lightweight spatio-temporal fusion feature extraction network is designed.The experiments in synthetic real-world and city-level scenarios show that the proposed RegionS TLight converges more quickly,is more stable,and obtains better asymptotic performance compared to state-of-theart models.
文摘The Controller Area Network (CAN) is a well established control network for automotive and automation control applications. Time-Triggered Controller Area Network (TTCAN) is a recent development which introduces a session layer,for message scheduling,to the existing CAN standard,which is a two layer standard comprising of a physical layer and a data link layer. TTCAN facilitates network communication in a time-triggered fashion,by introducing a Time Division Multiple Access style communication scheme. This allows deterministic network behavior,where maximum message latency times can be quantified and guaranteed. In order to solve the problem of determinate time latency and synchronization among several districted units in one auto panel CAN systems,this paper proposed a prototype design implementation for a shared-clock scheduler based on PIC18F458 MCU. This leads to improved CAN system performance and avoid the latency jitters and guarantee a deterministic communication pattern on the bus. The real runtime performance is satisfied.
文摘The theory of shared control combines organically the control of every controlled ele-ments and with it all the controlled elements share the same control element. Applying theschemes of shared control searched by assembly programs, an integrated control of all the ele-ments is fulfilled. The distinguishing point of the method is that the maximum control output canbe obtained with the least input information. Hence it is the optimum for the conversion of com-bination states. Finally, a thared rotary valve is designed, and it is the simplest with only onegroup of control holes.
基金supported by the National Key R&D Program of China(2018AAA0101500).
文摘With integration of large-scale renewable energy,new controllable devices,and required reinforcement of power grids,modern power systems have typical characteristics such as uncertainty,vulnerability and openness,which makes operation and control of power grids face severe security challenges.Application of artificial intelligence(AI)technologies represented by machine learning in power grid regulation is limited by reliability,interpretability and generalization ability of complex modeling.Mode of hybrid-augmented intelligence(HAI)based on human-machine collaboration(HMC)is a pivotal direction for future development of AI technology in this field.Based on characteristics of applications in power grid regulation,this paper discusses system architecture and key technologies of human-machine hybrid-augmented intelligence(HHI)system for large-scale power grid dispatching and control(PGDC).First,theory and application scenarios of HHI are introduced and analyzed;then physical and functional architectures of HHI system and human-machine collaborative regulation process are proposed.Key technologies are discussed to achieve a thorough integration of human/machine intelligence.Finally,state-of-theart and future development of HHI in power grid regulation are summarized,aiming to efficiently improve the intelligent level of power grid regulation in a human-machine interactive and collaborative way.
基金co-supported by the Fundamental Research Funds for the Central Universities of China(No.YWF-23-SDHK-L-005)the 1912 Project,China and the Aeronautical Science Foundation of China(No.20220048051001).
文摘This paper presents a Shared Control Architecture(SCA)between a human pilot and a smart inceptor for nonlinear Pilot Induced Oscillations(PIOs),e.g.,category II or III PIOs.One innovation of this paper is that an intelligent shared control architecture is developed based on the intelligent active inceptor technique,i.e.,Smart Adaptive Flight Effective Cue(SAFE-Cue).A deep reinforcement learning approach namely Deep Deterministic Policy Gradient(DDPG)method is chosen to design a gain adaptation mechanism for the SAFE-Cue module.By doing this,the gains of the SAFE-Cue will be intelligently tuned once nonlinear PIOs triggered;meanwhile,the human pilot will receive a force cue from the SAFE-Cue,and will consequently adapting his/her control policy.The second innovation of this paper is that the reward function of the DDPG based gain adaptation approach is constructed according to flying qualities.Under the premise of considering failure situation,task completion qualities and pilot workload are also taken into account.Finally,the proposed approach is validated using numerical simulation experiments with two types of scenarios:lower actuator rate limits and airframe damages.The Inceptor Peak Power-Phase(IPPP)metric is adopted to analyze the human-vehicle system simulation results.Results and analysis show that the DDPG based sharing control approach can well address nonlinear PIO problems consisting of Categories Ⅱ and Ⅲ PIO events.
文摘Power sharing among multiterminal high voltage direct current terminals(MT-HVDC)is mainly developed based on a priority or sequential manners,which uses to prevent the problem of overloading due to a predefined controller coefficient.Furthermore,fixed power sharing control also suffers from an inability to identify power availability at a rectification station.There is a need for a controller that ensures an efficient power sharing among the MT-HVDC terminals,prevents the possibility of overloading,and utilizes the available power sharing.A new adaptive wireless control for active power sharing among multiterminal(MT-HVDC)systems,including power availability and power management policy,is proposed in this paper.The proposed control strategy solves these issues and,this proposed controller strategy is a generic method that can be applied for unlimited number of converter stations.The rational of this proposed controller is to increase the system reliability by avoiding the necessity of fast communication links.The test system in this paper consists of four converter stations based on three phase-two AC voltage levels.The proposed control strategy for a multiterminal HVDC system is conducted in the power systems computer aided design/electromagnetic transient design and control(PSCAD/EMTDC)simulation environment.The simulation results significantly show the flexibility and usefulness of the proposed power sharing control provided by the new adaptive wireless method.