It is impossible to plan in advance unpredictable phenomena at monitoring, diagnosis and control of industrial batch and continuous equipment and processes such as chemical composition of the raw materials, the proces...It is impossible to plan in advance unpredictable phenomena at monitoring, diagnosis and control of industrial batch and continuous equipment and processes such as chemical composition of the raw materials, the process leads to unexpected reactions and changes its parameters, etc. The agent is active, a program entity, has its own ideas how to perform the tasks of the own agenda. Agents perceive, behave ＂reasonably＂, communicate with other agents. Agents can represent equipment and operations in batch processes as recommended by the ISA $88. Jadex system is based on Java language and on FIPA org. recommendations. The description of ripening tank T406 and recipe for yogurt production in the holding of MADETA Corp. in the Czech Rep. It is described modeling and displaying of＂normal＂ and error, fault unit state of the ripening tank. Agents are within the Jadex system and describing the behavior of ripening tank T406 with state diagrams-automata and assist in diagnosing of fault states. States are described in XML language-SCXML （State Charts XML）. Jadex Control Center-JCC represents a major access point to use for operating in real time.展开更多
A soccer robot system (HIT 1) was built to participate in MIROSOT_China99 held in Harbin Institute of Technology. Robot soccer game is a very complex robot application that incorporates real time vision system, robot ...A soccer robot system (HIT 1) was built to participate in MIROSOT_China99 held in Harbin Institute of Technology. Robot soccer game is a very complex robot application that incorporates real time vision system, robot control, wireless communication and control of multiple robots. In the paper, we present the design and the hardware architecture and software architecture of our distributed multiple robot system.展开更多
Cement production is characterized by its great capacity, long-time delay, multi variables, difficult measurement and multi disturbances. According to the distributed intelligent control strategy based on the multi (a...Cement production is characterized by its great capacity, long-time delay, multi variables, difficult measurement and multi disturbances. According to the distributed intelligent control strategy based on the multi (agent,) the multi agent control system of cement production is built, which includes integrated optimal control and diagnosis control. The distributed and multiple level structure of multi agent system for the cement control is studied. The optimal agent is in the distributed state, which aims at the partial process of the cement production, and forms the optimal layer. The diagnosis agent located on the diagnosis layer is the diagnosis unit which aims at the whole process of the cement production, and the central management unit of the system. The system cooperation is realized by the communication among optimal agents and diagnosis agent. The architecture of the optimal agent and the diagnosis agent are designed. The detailed functions of the optimal agent and the diagnosis agent are analyzed. At last the realization methods of the agents are given, and the application of the multi agent control system is presented. The multi agent system has been successfully applied to the off-line control of one cement plant with capacity of 5 000 t/d. The results show that the average yield of the clinker increases 9.3% and the coal consumption decreases 7.5 kg/t.展开更多
PDM (product data management) is one kind of techniques based on software and database, which integrates information and process related to products. But it is not enough to perform the complication of PDM in enterpri...PDM (product data management) is one kind of techniques based on software and database, which integrates information and process related to products. But it is not enough to perform the complication of PDM in enterprises. Then the mechanism to harmonize all kinds of information and process is needed. The paper introduces a novel approach to implement the intelligent monitor of PDM based on MAS (multi agent system). It carries out the management of information and process by MC (monitor center). The paper first puts forward the architecture of the whole system, then defines the structure of MC and its interoperation mode.展开更多
The MACE - a Multi agent based distributed measurement architecture in CORBA environment used to develop intelligent distributed measurement system for remote control and monitoring of instruments over network such as...The MACE - a Multi agent based distributed measurement architecture in CORBA environment used to develop intelligent distributed measurement system for remote control and monitoring of instruments over network such as Internet and Ethernet was proposed. The architecture is characterized by interoperability, collaboration and intelligence by means of CORBA and multi agent technologies. The architecture and exemplifies it by a common project was described.展开更多
AGVs dispatching, one of the hot problems in FMS, has attracted widespread interest in recent years. It is hard to dynamically schedule AGVs with pre designed rule because of the uncertainty and dynamic nature of AGVs...AGVs dispatching, one of the hot problems in FMS, has attracted widespread interest in recent years. It is hard to dynamically schedule AGVs with pre designed rule because of the uncertainty and dynamic nature of AGVs dispatching progress, so the AGVs system in this paper is treated as a cooperative learning multiagent system, in which each agent adopts multilevel decision method, which includes two level decisions: the option level and the action level. On the option level, an agent learns a policy to execute a subtask with the best response to the other AGVs’ current options. On the action level, an agent learns an optimal policy of actions for achieving his planned option. The method is applied to a AGVs’ dispatching simulation, and the performance of the AGVs system based on this method is verified.展开更多
A continuous⁃time distributed optimization was researched for second⁃order heterogeneous multi⁃agent systems.The aim of this study is to keep the velocities of all agents the same and make the velocities converge to t...A continuous⁃time distributed optimization was researched for second⁃order heterogeneous multi⁃agent systems.The aim of this study is to keep the velocities of all agents the same and make the velocities converge to the optimal value to minimize the sum of local cost functions.First,an effective distributed controller which only uses local information was designed.Then,the stability and optimization of the systems were verified.Finally,a simulation case was used to illustrate the analytical results.展开更多
Microgrid systems are built to integrate a generation mix of solar and wind renewable energy resources that are generally intermittent in nature. This paper presents a novel decentralized multi-agent system to securel...Microgrid systems are built to integrate a generation mix of solar and wind renewable energy resources that are generally intermittent in nature. This paper presents a novel decentralized multi-agent system to securely operate microgrids in real-time while maintaining generation</span><span style="font-family:Verdana;">,</span><span style="font-family:Verdana;"> load balance. Agents provide a normal operation in a grid-connected mode and a contingency operation in an islanded mode for fault handling. Fault handling is especially critical in microgrid operation to simulate possible contingencies and microgrid outages in a real-world scenario. A robust agent design has been implemented using MATLAB</span><span style="font-family:Verdana;">-</span><span style="font-family:Verdana;">Simulink and Java Agent Development Framework technologies to simulate microgrids with load management and distributed generators control. The microgrid of the German Jordanian University has been used for simulation for Summer and Winter photovoltaic generation and load profiles. The results show agent capabilities to operate microgrid in real-time and its ability to coordinate and adjust generation and load. In a simulated fault incident, agents coordinate and adjust to a normal operation in 0.012 seconds, a negligible time for microgrid restoration. This clearly shows that the multi-agent system is a viable solution to operate MG in real-time.展开更多
Multi‐agent reinforcement learning relies on reward signals to guide the policy networks of individual agents.However,in high‐dimensional continuous spaces,the non‐stationary environment can provide outdated experi...Multi‐agent reinforcement learning relies on reward signals to guide the policy networks of individual agents.However,in high‐dimensional continuous spaces,the non‐stationary environment can provide outdated experiences that hinder convergence,resulting in ineffective training performance for multi‐agent systems.To tackle this issue,a novel reinforcement learning scheme,Mutual Information Oriented Deep Skill Chaining(MioDSC),is proposed that generates an optimised cooperative policy by incorporating intrinsic rewards based on mutual information to improve exploration efficiency.These rewards encourage agents to diversify their learning process by engaging in actions that increase the mutual information between their actions and the environment state.In addition,MioDSC can generate cooperative policies using the options framework,allowing agents to learn and reuse complex action sequences and accelerating the convergence speed of multi‐agent learning.MioDSC was evaluated in the multi‐agent particle environment and the StarCraft multi‐agent challenge at varying difficulty levels.The experimental results demonstrate that MioDSC outperforms state‐of‐the‐art methods and is robust across various multi‐agent system tasks with high stability.展开更多
提出了一种基于M u lti-A gen t的虚拟维修训练系统(VM TS)结构框架,整个系统分别由主控A gen t、仿真A gen t、和接口A gen t3个具有交互作用的A gen t组成,从而将虚拟维修训练系统的开发转化为一个多A gen t系统的设计与开发。基于多A...提出了一种基于M u lti-A gen t的虚拟维修训练系统(VM TS)结构框架,整个系统分别由主控A gen t、仿真A gen t、和接口A gen t3个具有交互作用的A gen t组成,从而将虚拟维修训练系统的开发转化为一个多A gen t系统的设计与开发。基于多A gen t的框架结构可实现受训者的智能模型及虚拟训练场景中虚拟物体的行为模型,从而可以提高VM TS的健壮性和可重用性。基于A gen t的概念模型实现了A gen t之间的交互和协作,并介绍了主控A gen t和仿真A gen t的具体实现方法。展开更多
文摘It is impossible to plan in advance unpredictable phenomena at monitoring, diagnosis and control of industrial batch and continuous equipment and processes such as chemical composition of the raw materials, the process leads to unexpected reactions and changes its parameters, etc. The agent is active, a program entity, has its own ideas how to perform the tasks of the own agenda. Agents perceive, behave ＂reasonably＂, communicate with other agents. Agents can represent equipment and operations in batch processes as recommended by the ISA $88. Jadex system is based on Java language and on FIPA org. recommendations. The description of ripening tank T406 and recipe for yogurt production in the holding of MADETA Corp. in the Czech Rep. It is described modeling and displaying of＂normal＂ and error, fault unit state of the ripening tank. Agents are within the Jadex system and describing the behavior of ripening tank T406 with state diagrams-automata and assist in diagnosing of fault states. States are described in XML language-SCXML （State Charts XML）. Jadex Control Center-JCC represents a major access point to use for operating in real time.
基金Supported by the High Technology Research and Developmeent Program of China
文摘A soccer robot system (HIT 1) was built to participate in MIROSOT_China99 held in Harbin Institute of Technology. Robot soccer game is a very complex robot application that incorporates real time vision system, robot control, wireless communication and control of multiple robots. In the paper, we present the design and the hardware architecture and software architecture of our distributed multiple robot system.
文摘Cement production is characterized by its great capacity, long-time delay, multi variables, difficult measurement and multi disturbances. According to the distributed intelligent control strategy based on the multi (agent,) the multi agent control system of cement production is built, which includes integrated optimal control and diagnosis control. The distributed and multiple level structure of multi agent system for the cement control is studied. The optimal agent is in the distributed state, which aims at the partial process of the cement production, and forms the optimal layer. The diagnosis agent located on the diagnosis layer is the diagnosis unit which aims at the whole process of the cement production, and the central management unit of the system. The system cooperation is realized by the communication among optimal agents and diagnosis agent. The architecture of the optimal agent and the diagnosis agent are designed. The detailed functions of the optimal agent and the diagnosis agent are analyzed. At last the realization methods of the agents are given, and the application of the multi agent control system is presented. The multi agent system has been successfully applied to the off-line control of one cement plant with capacity of 5 000 t/d. The results show that the average yield of the clinker increases 9.3% and the coal consumption decreases 7.5 kg/t.
文摘PDM (product data management) is one kind of techniques based on software and database, which integrates information and process related to products. But it is not enough to perform the complication of PDM in enterprises. Then the mechanism to harmonize all kinds of information and process is needed. The paper introduces a novel approach to implement the intelligent monitor of PDM based on MAS (multi agent system). It carries out the management of information and process by MC (monitor center). The paper first puts forward the architecture of the whole system, then defines the structure of MC and its interoperation mode.
文摘The MACE - a Multi agent based distributed measurement architecture in CORBA environment used to develop intelligent distributed measurement system for remote control and monitoring of instruments over network such as Internet and Ethernet was proposed. The architecture is characterized by interoperability, collaboration and intelligence by means of CORBA and multi agent technologies. The architecture and exemplifies it by a common project was described.
文摘AGVs dispatching, one of the hot problems in FMS, has attracted widespread interest in recent years. It is hard to dynamically schedule AGVs with pre designed rule because of the uncertainty and dynamic nature of AGVs dispatching progress, so the AGVs system in this paper is treated as a cooperative learning multiagent system, in which each agent adopts multilevel decision method, which includes two level decisions: the option level and the action level. On the option level, an agent learns a policy to execute a subtask with the best response to the other AGVs’ current options. On the action level, an agent learns an optimal policy of actions for achieving his planned option. The method is applied to a AGVs’ dispatching simulation, and the performance of the AGVs system based on this method is verified.
基金Sponsored by the National Natural Science Foundation of China(Grant Nos.61573199 and 61571441)。
文摘A continuous⁃time distributed optimization was researched for second⁃order heterogeneous multi⁃agent systems.The aim of this study is to keep the velocities of all agents the same and make the velocities converge to the optimal value to minimize the sum of local cost functions.First,an effective distributed controller which only uses local information was designed.Then,the stability and optimization of the systems were verified.Finally,a simulation case was used to illustrate the analytical results.
文摘Microgrid systems are built to integrate a generation mix of solar and wind renewable energy resources that are generally intermittent in nature. This paper presents a novel decentralized multi-agent system to securely operate microgrids in real-time while maintaining generation</span><span style="font-family:Verdana;">,</span><span style="font-family:Verdana;"> load balance. Agents provide a normal operation in a grid-connected mode and a contingency operation in an islanded mode for fault handling. Fault handling is especially critical in microgrid operation to simulate possible contingencies and microgrid outages in a real-world scenario. A robust agent design has been implemented using MATLAB</span><span style="font-family:Verdana;">-</span><span style="font-family:Verdana;">Simulink and Java Agent Development Framework technologies to simulate microgrids with load management and distributed generators control. The microgrid of the German Jordanian University has been used for simulation for Summer and Winter photovoltaic generation and load profiles. The results show agent capabilities to operate microgrid in real-time and its ability to coordinate and adjust generation and load. In a simulated fault incident, agents coordinate and adjust to a normal operation in 0.012 seconds, a negligible time for microgrid restoration. This clearly shows that the multi-agent system is a viable solution to operate MG in real-time.
基金National Natural Science Foundation of China,Grant/Award Number:61872171The Belt and Road Special Foundation of the State Key Laboratory of Hydrology‐Water Resources and Hydraulic Engineering,Grant/Award Number:2021490811。
文摘Multi‐agent reinforcement learning relies on reward signals to guide the policy networks of individual agents.However,in high‐dimensional continuous spaces,the non‐stationary environment can provide outdated experiences that hinder convergence,resulting in ineffective training performance for multi‐agent systems.To tackle this issue,a novel reinforcement learning scheme,Mutual Information Oriented Deep Skill Chaining(MioDSC),is proposed that generates an optimised cooperative policy by incorporating intrinsic rewards based on mutual information to improve exploration efficiency.These rewards encourage agents to diversify their learning process by engaging in actions that increase the mutual information between their actions and the environment state.In addition,MioDSC can generate cooperative policies using the options framework,allowing agents to learn and reuse complex action sequences and accelerating the convergence speed of multi‐agent learning.MioDSC was evaluated in the multi‐agent particle environment and the StarCraft multi‐agent challenge at varying difficulty levels.The experimental results demonstrate that MioDSC outperforms state‐of‐the‐art methods and is robust across various multi‐agent system tasks with high stability.
文摘提出了一种基于M u lti-A gen t的虚拟维修训练系统(VM TS)结构框架,整个系统分别由主控A gen t、仿真A gen t、和接口A gen t3个具有交互作用的A gen t组成,从而将虚拟维修训练系统的开发转化为一个多A gen t系统的设计与开发。基于多A gen t的框架结构可实现受训者的智能模型及虚拟训练场景中虚拟物体的行为模型,从而可以提高VM TS的健壮性和可重用性。基于A gen t的概念模型实现了A gen t之间的交互和协作,并介绍了主控A gen t和仿真A gen t的具体实现方法。
