In response to the uncertainty of information of the injured in post disaster situations,considering constraints such as random chance and the quantity of rescue resource,the split deliv-ery vehicle routing problem wi...In response to the uncertainty of information of the injured in post disaster situations,considering constraints such as random chance and the quantity of rescue resource,the split deliv-ery vehicle routing problem with stochastic demands(SDVRPSD)model and the multi-depot split delivery heterogeneous vehicle routing problem with stochastic demands(MDSDHVRPSD)model are established.A two-stage hybrid variable neighborhood tabu search algorithm is designed for unmanned vehicle task planning to minimize the path cost of rescue plans.Simulation experiments show that the solution obtained by the algorithm can effectively reduce the rescue vehicle path cost and the rescue task completion time,with high optimization quality and certain portability.展开更多
The unreasonable observation arrangements in the satellite operation control center(SOCC)may result in the observation data cannot be downloaded as scheduled.Meanwhile,if the operation instructions released by the sat...The unreasonable observation arrangements in the satellite operation control center(SOCC)may result in the observation data cannot be downloaded as scheduled.Meanwhile,if the operation instructions released by the satellite telemetry tracking center(STTC)for the on-board payloads are not injected on the specific satellites in time,the corresponding satellites cannot perform the observation operations as planned.Therefore,there is an urgent need to design an integrated instruction release,and observation task planning(I-IRO-TP)scheme by efficiently collaborating the SOCC and STTC.Motivated by this fact,we design an interaction mechanism between the SOCC and the STTC,where we first formulate the I-IRO-TP problem as a constraint satisfaction problem aiming at maximizing the number of completed tasks.Furthermore,we propose an interactive imaging task planning algorithm based on the analysis of resource distribution in the STTC during the previous planning periods to preferentially select the observation arcs that not only satisfy the requirements in the observation resource allocation phase but also facilitate the arrangement of measurement and control instruction release.We conduct extensive simulations to demonstrate the effectiveness of the proposed algorithm in terms of the number of completed tasks.展开更多
With the new development trend of multi-resource coordinated Earth observation and the new goal of Earth observation application of“short response time,high observation accuracy,and wide coverage”,space-aeronautics ...With the new development trend of multi-resource coordinated Earth observation and the new goal of Earth observation application of“short response time,high observation accuracy,and wide coverage”,space-aeronautics cooperative complex task planning problem has become an urgent problem to be solved.The focus of this problem is to use multiple resources to perform collaborative observations on complex tasks.By analyzing the process from task assignment to receiving task observation results,we propose a multi-layer interactive task planning framework which is composed of a preprocessing method for complex tasks,a task allocation layer,a task planning layer,and a task coordination layer.According to the characteristics of the framework,a hybrid genetic parallel tabu(HGPT)algorithm is proposed on this basis.The algorithm uses genetic annealing algorithm(GAA),parallel tabu(PT)algorithm,and heuristic rules to achieve task allocation,task planning,and task coordination.At the same time,coding improvements,operator design,annealing operations,and parallel calculations are added to the algorithm.In order to verify the effectiveness of the algorithm,simulation experiments under complex task scenarios of different scales are carried out.Experimental results show that this method can effectively solve the problems of observing complex tasks.Meanwhile,the optimization effect and convergence speed of the HGPT is better than that of the related algorithms.展开更多
Multiple earth observing satellites need to communicate with each other to observe plenty of targets on the Earth together. The factors, such as external interference, result in satellite information interaction delay...Multiple earth observing satellites need to communicate with each other to observe plenty of targets on the Earth together. The factors, such as external interference, result in satellite information interaction delays, which is unable to ensure the integrity and timeliness of the information on decision making for satellites. And the optimization of the planning result is affected. Therefore, the effect of communication delay is considered during the multi-satel ite coordinating process. For this problem, firstly, a distributed cooperative optimization problem for multiple satellites in the delayed communication environment is formulized. Secondly, based on both the analysis of the temporal sequence of tasks in a single satellite and the dynamically decoupled characteristics of the multi-satellite system, the environment information of multi-satellite distributed cooperative optimization is constructed on the basis of the directed acyclic graph(DAG). Then, both a cooperative optimization decision making framework and a model are built according to the decentralized partial observable Markov decision process(DEC-POMDP). After that, a satellite coordinating strategy aimed at different conditions of communication delay is mainly analyzed, and a unified processing strategy on communication delay is designed. An approximate cooperative optimization algorithm based on simulated annealing is proposed. Finally, the effectiveness and robustness of the method presented in this paper are verified via the simulation.展开更多
The results of analyzing the managerial characteristics and complexity of product cooperative development suggest that task planning is an important aspect for process management of product cooperative development and...The results of analyzing the managerial characteristics and complexity of product cooperative development suggest that task planning is an important aspect for process management of product cooperative development and the method for planning tasks should be able to model the dependency between tasks and iterations during the development process. In this paper, a DSM-based method and its corresponding optimization algorithms are developed. At first the coupled task sets and uncoupled task sets are identified, and the tasks are then optimized by the corresponding algorithms. The optimal tasks plan will reduce the development time and cost. Considering the practical requirements in real world, a Multilayer DSM is proposed, and its information communication techniques between DSM and traversing principle are described in details.展开更多
In an Internet based multi-operator and multi-robot system (IMOMR), operators have to work collaboratively to overcome the constraints of space and time. Inherently, the activities among them can be defined as a compu...In an Internet based multi-operator and multi-robot system (IMOMR), operators have to work collaboratively to overcome the constraints of space and time. Inherently, the activities among them can be defined as a computer-supported cooperative work (CSCW). As a practical application of CSCW, a collaborative task planning system (CTPS) for IMOMR is proposed in this paper on the basis of Petri nets. Its definition, components design, and concrete implementation are given in detail, respectively. As a result, a clear collaboration mechanism of multiple operators in an IMOMR is obtained to guarantee their task planning.展开更多
A free-flying space robot will accomplish manufacturing, assembling and repair instead of astronauts in the future unmanned space flight hbecause of its flexible maneuverability in space. This paper presents a task pl...A free-flying space robot will accomplish manufacturing, assembling and repair instead of astronauts in the future unmanned space flight hbecause of its flexible maneuverability in space. This paper presents a task planning algorithm of retrieving invalid satellite for free-fiving space robot. First we discuss kinematics model and deduct cinematics equations of dual-arm space robot. Then the process of retrieving an invalid satellite, which is divided into eleven motion procedures. At the same time, we have developed a free-flying space robot task planning simulation system and the experimental results show that this algorithm is feasible and correct.展开更多
The complexity and uncertainty in power systems cause great challenges to controlling power grids.As a popular data-driven technique,deep reinforcement learning(DRL)attracts attention in the control of power grids.How...The complexity and uncertainty in power systems cause great challenges to controlling power grids.As a popular data-driven technique,deep reinforcement learning(DRL)attracts attention in the control of power grids.However,DRL has some inherent drawbacks in terms of data efficiency and explainability.This paper presents a novel hierarchical task planning(HTP)approach,bridging planning and DRL,to the task of power line flow regulation.First,we introduce a threelevel task hierarchy to model the task and model the sequence of task units on each level as a task planning-Markov decision processes(TP-MDPs).Second,we model the task as a sequential decision-making problem and introduce a higher planner and a lower planner in HTP to handle different levels of task units.In addition,we introduce a two-layer knowledge graph that can update dynamically during the planning procedure to assist HTP.Experimental results conducted on the IEEE 118-bus and IEEE 300-bus systems demonstrate our HTP approach outperforms proximal policy optimization,a state-of-the-art deep reinforcement learning(DRL)approach,improving efficiency by 26.16%and 6.86%on both systems.展开更多
This paper studies the coordinated planning of transmission tasks in the heterogeneous space networks to enable efficient sharing of ground stations cross satellite systems.Specifically,we first formulate the coordina...This paper studies the coordinated planning of transmission tasks in the heterogeneous space networks to enable efficient sharing of ground stations cross satellite systems.Specifically,we first formulate the coordinated planning problem into a mixed integer liner programming(MILP)problem based on time expanded graph.Then,the problem is transferred and reformulated into a consensus optimization framework which can be solved by satellite systems parallelly.With alternating direction method of multipliers(ADMM),a semi-distributed coordinated transmission task planning algorithm is proposed,in which each satellite system plans its own tasks based on local information and limited communication with the coordination center.Simulation results demonstrate that compared with the centralized and fully-distributed methods,the proposed semi-distributed coordinated method can strike a better balance among task complete rate,complexity,and the amount of information required to be exchanged.展开更多
Many heat transfer tubes are distributed on the tube plates of a steam generator that requires periodic inspection by robots.Existing inspection robots are usually involved in issues:Robots with manipulators need comp...Many heat transfer tubes are distributed on the tube plates of a steam generator that requires periodic inspection by robots.Existing inspection robots are usually involved in issues:Robots with manipulators need complicated installation due to their fixed base;tube mobile robots suffer from low running efficiency because of their structural restricts.Since there are thousands of tubes to be checked,task planning is essential to guarantee the precise,orderly,and efficient inspection process.Most in-service robots check the task tubes using row-by-row and column-bycolumn planning.This leads to unnecessary inspections,resulting in a long shutdown and affecting the regular operation of a nuclear power plant.Therefore,this paper introduces the structure and control system of a dexterous robot and proposes a task planning method.This method proceeds into three steps:task allocation,base position search,and sequence planning.To allocate the task regions,this method calculates the tool work matrix and proposes a criterion to evaluate a sub-region.And then all tasks contained in the sub-region are considered globally to search the base positions.Lastly,we apply an improved ant colony algorithm for base sequence planning and determine the inspection orders according to the planned path.We validated the optimized algorithm by conducting task planning experiments using our robot on a tube sheet.The results show that the proposed method can accomplish full task coverage with few repetitive or redundant inspections and it increases the efficiency by 33.31% compared to the traditional planning algorithms.展开更多
interaction pipelines while maintaining interfaces for task-specific customization.The Structural-BT framework supports the modular design of structure functionalities and allows easy extensibility of the inner planni...interaction pipelines while maintaining interfaces for task-specific customization.The Structural-BT framework supports the modular design of structure functionalities and allows easy extensibility of the inner planning flows between BT components.With the Structural-BT framework,software engineers can develop robotic software by flexibly composing BT structures to formulate the skeleton software architecture and implement task-specific algorithms when necessary.In the experiment,this paper develops robotic software for diverse task scenarios and selects the baseline approaches of Robot Operating System(ROS)and classical BT development frameworks for comparison.By quantitatively measuring the reuse frequencies and ratios of BT structures,the Structural-BT framework has been shown to be more efficient than the baseline approaches for robotic software development.展开更多
Traditionally, heuristic re-planning algorithms are used to tackle the problem of dynamic task planning for multiple satellites. However, the traditional heuristic strategies depend on the concrete tasks, which often ...Traditionally, heuristic re-planning algorithms are used to tackle the problem of dynamic task planning for multiple satellites. However, the traditional heuristic strategies depend on the concrete tasks, which often affect the result’s optimality. Noticing that the historical information of cooperative task planning will impact the latter planning results, we propose a hybrid learning algorithm for dynamic multi-satellite task planning, which is based on the multi-agent reinforcement learning of policy iteration and the transfer learning. The reinforcement learning strategy of each satellite is described with neural networks. The policy neural network individuals with the best topological structure and weights are found by applying co-evolutionary search iteratively. To avoid the failure of the historical learning caused by the randomly occurring observation requests, a novel approach is proposed to balance the quality and efficiency of the task planning, which converts the historical learning strategy to the current initial learning strategy by applying the transfer learning algorithm. The simulations and analysis show the feasibility and adaptability of the proposed approach especially for the situation with randomly occurring observation requests.展开更多
Unmanned Aerial Vehicles(UAVs)are useful in dangerous and dynamic tasks such as search-and-rescue,forest surveillance,and anti-terrorist operations.These tasks can be solved better through the collaboration of multipl...Unmanned Aerial Vehicles(UAVs)are useful in dangerous and dynamic tasks such as search-and-rescue,forest surveillance,and anti-terrorist operations.These tasks can be solved better through the collaboration of multiple UAVs under human supervision.However,it is still difficult for human to monitor,understand,predict and control the behaviors of the UAVs due to the task complexity as well as the black-box machine learning and planning algorithms being used.In this paper,the coactive design method is adopted to analyze the cognitive capabilities required for the tasks and design the interdependencies among the heterogeneous teammates of UAVs or human for coherent collaboration.Then,an agent-based task planner is proposed to automatically decompose a complex task into a sequence of explainable subtasks under constrains of resources,execution time,social rules and costs.Besides,a deep reinforcement learning approach is designed for the UAVs to learn optimal policies of a flocking behavior and a path planner that are easy for the human operator to understand and control.Finally,a mixed-initiative action selection mechanism is used to evaluate the learned policies as well as the human’s decisions.Experimental results demonstrate the effectiveness of the proposed methods.展开更多
Task planning and collaboration of multiple robots have broad application prospects and value in the field of robotics.To improve the performance and working efficiency of our Spherical Underwater Robot(SUR),we propos...Task planning and collaboration of multiple robots have broad application prospects and value in the field of robotics.To improve the performance and working efficiency of our Spherical Underwater Robot(SUR),we propose a multi-robot control strategy that can realize the task planning and collaboration of multiple robots.To complete real-time information sharing of multiple robots,we first build an acoustic communication system with excellent communication performance under low noise ratio conditions.Then,the task planning and collaboration control strategy adjust the SURs so that they maintain their positions in the desired formation when the formation moves.Multiple SURs can move along desired trajectories in the expected formation.The control strategy of each SUR uses only its information and limited information of its neighboring SURs.Finally,based on theoretical analysis and experiments,we evaluate the validity and reliability of the proposed strategy.In comparison to the traditional leader–follower method,it is not necessary to designate a leader and its followers explicitly in our system;thus,important advantages,such as fault tolerance,are achieved.展开更多
Recently, crowdsourcing platforms have attracted a number of citizens to perform a variety of location- specific tasks. However, most existing approaches consider the arrangement of a set of tasks for a set of crowd w...Recently, crowdsourcing platforms have attracted a number of citizens to perform a variety of location- specific tasks. However, most existing approaches consider the arrangement of a set of tasks for a set of crowd workers, while few consider crowd workers arriving in a dynamic manner. Therefore, how to arrange suitable location-specific tasks to a set of crowd workers such that the crowd workers obtain maximum satisfaction when arriving sequentially represents a challenge. To address the limitation of existing approaches, we first identify a more general and useful model that considers not only the arrangement of a set of tasks to a set of crowd workers, but also all the dynamic arrivals of all crowd workers. Then, we present an effective crowd-task model which is applied to offiine and online settings, respectively. To solve the problem in an offiine setting, we first observe the characteristics of task planning (CTP) and devise a CTP algorithm to solve the problem. We also propose an effective greedy method and integrated simulated annealing (ISA) techniques to improve the algorithm performance. To solve the problem in an online setting, we develop a greedy algorithm for task planning. Finally, we verify the effectiveness and efficiency of the proposed solutions through extensive experiments using real and synthetic datasets.展开更多
In this paper,a resource mobility aware two-stage hybrid task planning algorithm is proposed to reduce the resource conflict between emergency tasks and the common tasks,so as to improve the overall performance of spa...In this paper,a resource mobility aware two-stage hybrid task planning algorithm is proposed to reduce the resource conflict between emergency tasks and the common tasks,so as to improve the overall performance of space information networks.Specifically,in the common task planning stage,a resource fragment avoidance task planning algorithm is proposed,which reduces the contention between emergency tasks and the planned common tasks in the next stage by avoiding the generation of resource fragments.For emergency tasks,we design a metric to quantify the revenue of the candidate resource combination of emergency tasks,which considers both the priority of the tasks and the impact on the planned common tasks.Based on this,a resource mobility aware emergency task planning algorithm is proposed,which strikes a good balance between improving the sum priority and avoiding disturbing the planned common tasks.Finally,simulation results show that the proposed algorithm is superior to the existing algorithms in both the sum task priority and the task completion rate.展开更多
Robots need task planning algorithms to sequence actions toward accomplishing goals that are impossible through individual actions. Off-the-shelf task planners can be used by intelligent robotics practitioners to solv...Robots need task planning algorithms to sequence actions toward accomplishing goals that are impossible through individual actions. Off-the-shelf task planners can be used by intelligent robotics practitioners to solve a variety of planning problems. However, many different planners exist, each with different strengths and weaknesses,and there are no general rules for which planner would be best to apply to a given problem. In this study, we empirically compare the performance of state-of-the-art planners that use either the planning domain description language(PDDL) or answer set programming(ASP) as the underlying action language. PDDL is designed for task planning, and PDDL-based planners are widely used for a variety of planning problems. ASP is designed for knowledge-intensive reasoning, but can also be used to solve task planning problems. Given domain encodings that are as similar as possible, we find that PDDL-based planners perform better on problems with longer solutions,and ASP-based planners are better on tasks with a large number of objects or tasks in which complex reasoning is required to reason about action preconditions and effects. The resulting analysis can inform selection among general-purpose planning systems for particular robot task planning domains.展开更多
t In this paper an overall scheme of the task management system of ternary optical computer (TOC) is proposed, and the software architecture chart is given. The function and accomplishment of each module in the syst...t In this paper an overall scheme of the task management system of ternary optical computer (TOC) is proposed, and the software architecture chart is given. The function and accomplishment of each module in the system are described in general. In addition, according to the aforementioned scheme a prototype of TOC task management system is implemented, and the feasibility, rationality and completeness of the scheme are verified via running and testing the prototype.展开更多
Based on the modeling of robot working environment, the shortest distance matrix between points is solved by Floyd algorithm. With the objective of minimizing the sum of the fixed cost of robot and the cost of robot o...Based on the modeling of robot working environment, the shortest distance matrix between points is solved by Floyd algorithm. With the objective of minimizing the sum of the fixed cost of robot and the cost of robot operation, an integer programming model is established and a genetic algorithm for solving the model is designed. In order to make coordination to accomplish their respective tasks for each robot with high efficiency, this paper uses natural number encoding way. The objective function is based on penalty term constructed with the total number of collisions in the running path of robots. The fitness function is constructed by using the objective function with penalty term. Based on elitist retention strategy, a genetic algorithm with collision detection is designed. Using this algorithm for task allocation and path planning of multi-robot, it can effectively avoid or reduce the number of collisions in the process of multi-robot performing tasks. Finally, an example is used to validate the method.展开更多
A theoretical approach of ordered emergency tasks generation is proposed for dealing with a specific emergency event rapidly, exactly and effectively. According to the general principles of an emergency plan developed...A theoretical approach of ordered emergency tasks generation is proposed for dealing with a specific emergency event rapidly, exactly and effectively. According to the general principles of an emergency plan developed to response to an emergency management, a workflow model is employed to complete the formal modeling of concrete emergency plan firstly. Then the HTN planning system SHOP2 is introduced, the transformation method of domain knowledge from emergency domain to SHOP2 domain is studied. At last, the general procedure to solve the emergency decision prob-lems and to generate executive emergency tasks is set up drawing support from SHOP2 planning system, which will combine the principles (or knowledge) of emergency plan and the real emergency situations.展开更多
基金supported by the National Natural Science Foundation of China(No.61903036)。
文摘In response to the uncertainty of information of the injured in post disaster situations,considering constraints such as random chance and the quantity of rescue resource,the split deliv-ery vehicle routing problem with stochastic demands(SDVRPSD)model and the multi-depot split delivery heterogeneous vehicle routing problem with stochastic demands(MDSDHVRPSD)model are established.A two-stage hybrid variable neighborhood tabu search algorithm is designed for unmanned vehicle task planning to minimize the path cost of rescue plans.Simulation experiments show that the solution obtained by the algorithm can effectively reduce the rescue vehicle path cost and the rescue task completion time,with high optimization quality and certain portability.
基金supported by the Natural Science Foundation of China under Grants U19B2025,62121001,and 62001347in part by Key Research and Development Program of Shaanxi(ProgramNo.2022ZDLGY05-02)in part by Young Talent Support Program of Xi’an Association for Science and Technology(No.095920221337).
文摘The unreasonable observation arrangements in the satellite operation control center(SOCC)may result in the observation data cannot be downloaded as scheduled.Meanwhile,if the operation instructions released by the satellite telemetry tracking center(STTC)for the on-board payloads are not injected on the specific satellites in time,the corresponding satellites cannot perform the observation operations as planned.Therefore,there is an urgent need to design an integrated instruction release,and observation task planning(I-IRO-TP)scheme by efficiently collaborating the SOCC and STTC.Motivated by this fact,we design an interaction mechanism between the SOCC and the STTC,where we first formulate the I-IRO-TP problem as a constraint satisfaction problem aiming at maximizing the number of completed tasks.Furthermore,we propose an interactive imaging task planning algorithm based on the analysis of resource distribution in the STTC during the previous planning periods to preferentially select the observation arcs that not only satisfy the requirements in the observation resource allocation phase but also facilitate the arrangement of measurement and control instruction release.We conduct extensive simulations to demonstrate the effectiveness of the proposed algorithm in terms of the number of completed tasks.
基金the National Natural Science Foundation of China(72001212).
文摘With the new development trend of multi-resource coordinated Earth observation and the new goal of Earth observation application of“short response time,high observation accuracy,and wide coverage”,space-aeronautics cooperative complex task planning problem has become an urgent problem to be solved.The focus of this problem is to use multiple resources to perform collaborative observations on complex tasks.By analyzing the process from task assignment to receiving task observation results,we propose a multi-layer interactive task planning framework which is composed of a preprocessing method for complex tasks,a task allocation layer,a task planning layer,and a task coordination layer.According to the characteristics of the framework,a hybrid genetic parallel tabu(HGPT)algorithm is proposed on this basis.The algorithm uses genetic annealing algorithm(GAA),parallel tabu(PT)algorithm,and heuristic rules to achieve task allocation,task planning,and task coordination.At the same time,coding improvements,operator design,annealing operations,and parallel calculations are added to the algorithm.In order to verify the effectiveness of the algorithm,simulation experiments under complex task scenarios of different scales are carried out.Experimental results show that this method can effectively solve the problems of observing complex tasks.Meanwhile,the optimization effect and convergence speed of the HGPT is better than that of the related algorithms.
基金supported by the National Science Foundation for Young Scholars of China(6130123471401175)
文摘Multiple earth observing satellites need to communicate with each other to observe plenty of targets on the Earth together. The factors, such as external interference, result in satellite information interaction delays, which is unable to ensure the integrity and timeliness of the information on decision making for satellites. And the optimization of the planning result is affected. Therefore, the effect of communication delay is considered during the multi-satel ite coordinating process. For this problem, firstly, a distributed cooperative optimization problem for multiple satellites in the delayed communication environment is formulized. Secondly, based on both the analysis of the temporal sequence of tasks in a single satellite and the dynamically decoupled characteristics of the multi-satellite system, the environment information of multi-satellite distributed cooperative optimization is constructed on the basis of the directed acyclic graph(DAG). Then, both a cooperative optimization decision making framework and a model are built according to the decentralized partial observable Markov decision process(DEC-POMDP). After that, a satellite coordinating strategy aimed at different conditions of communication delay is mainly analyzed, and a unified processing strategy on communication delay is designed. An approximate cooperative optimization algorithm based on simulated annealing is proposed. Finally, the effectiveness and robustness of the method presented in this paper are verified via the simulation.
文摘The results of analyzing the managerial characteristics and complexity of product cooperative development suggest that task planning is an important aspect for process management of product cooperative development and the method for planning tasks should be able to model the dependency between tasks and iterations during the development process. In this paper, a DSM-based method and its corresponding optimization algorithms are developed. At first the coupled task sets and uncoupled task sets are identified, and the tasks are then optimized by the corresponding algorithms. The optimal tasks plan will reduce the development time and cost. Considering the practical requirements in real world, a Multilayer DSM is proposed, and its information communication techniques between DSM and traversing principle are described in details.
文摘In an Internet based multi-operator and multi-robot system (IMOMR), operators have to work collaboratively to overcome the constraints of space and time. Inherently, the activities among them can be defined as a computer-supported cooperative work (CSCW). As a practical application of CSCW, a collaborative task planning system (CTPS) for IMOMR is proposed in this paper on the basis of Petri nets. Its definition, components design, and concrete implementation are given in detail, respectively. As a result, a clear collaboration mechanism of multiple operators in an IMOMR is obtained to guarantee their task planning.
文摘A free-flying space robot will accomplish manufacturing, assembling and repair instead of astronauts in the future unmanned space flight hbecause of its flexible maneuverability in space. This paper presents a task planning algorithm of retrieving invalid satellite for free-fiving space robot. First we discuss kinematics model and deduct cinematics equations of dual-arm space robot. Then the process of retrieving an invalid satellite, which is divided into eleven motion procedures. At the same time, we have developed a free-flying space robot task planning simulation system and the experimental results show that this algorithm is feasible and correct.
基金supported in part by the National Key R&D Program(2018AAA0101501)of Chinathe science and technology project of SGCC(State Grid Corporation of China).
文摘The complexity and uncertainty in power systems cause great challenges to controlling power grids.As a popular data-driven technique,deep reinforcement learning(DRL)attracts attention in the control of power grids.However,DRL has some inherent drawbacks in terms of data efficiency and explainability.This paper presents a novel hierarchical task planning(HTP)approach,bridging planning and DRL,to the task of power line flow regulation.First,we introduce a threelevel task hierarchy to model the task and model the sequence of task units on each level as a task planning-Markov decision processes(TP-MDPs).Second,we model the task as a sequential decision-making problem and introduce a higher planner and a lower planner in HTP to handle different levels of task units.In addition,we introduce a two-layer knowledge graph that can update dynamically during the planning procedure to assist HTP.Experimental results conducted on the IEEE 118-bus and IEEE 300-bus systems demonstrate our HTP approach outperforms proximal policy optimization,a state-of-the-art deep reinforcement learning(DRL)approach,improving efficiency by 26.16%and 6.86%on both systems.
基金supported in part by the NSF China under Grant(61701365,61801365,62001347)in part by Natural Science Foundation of Shaanxi Province(2020JQ-686)+4 种基金in part by the China Postdoctoral Science Foundation under Grant(2018M643581,2019TQ0210,2019TQ0241,2020M673344)in part by Young Talent fund of University Association for Science and Technology in Shaanxi,China(20200112)in part by Key Research and Development Program in Shaanxi Province of China(2021GY066)in part by Postdoctoral Foundation in Shaanxi Province of China(2018BSHEDZZ47)the Fundamental Research Funds for the Central Universities。
文摘This paper studies the coordinated planning of transmission tasks in the heterogeneous space networks to enable efficient sharing of ground stations cross satellite systems.Specifically,we first formulate the coordinated planning problem into a mixed integer liner programming(MILP)problem based on time expanded graph.Then,the problem is transferred and reformulated into a consensus optimization framework which can be solved by satellite systems parallelly.With alternating direction method of multipliers(ADMM),a semi-distributed coordinated transmission task planning algorithm is proposed,in which each satellite system plans its own tasks based on local information and limited communication with the coordination center.Simulation results demonstrate that compared with the centralized and fully-distributed methods,the proposed semi-distributed coordinated method can strike a better balance among task complete rate,complexity,and the amount of information required to be exchanged.
基金supported by the National Natural Science Foundation of China(Grant No.U2013214)the Self-Planned Task of the State Key Laboratory of Robotics and System(HIT),China(Grant No.SKLRS202001A03).
文摘Many heat transfer tubes are distributed on the tube plates of a steam generator that requires periodic inspection by robots.Existing inspection robots are usually involved in issues:Robots with manipulators need complicated installation due to their fixed base;tube mobile robots suffer from low running efficiency because of their structural restricts.Since there are thousands of tubes to be checked,task planning is essential to guarantee the precise,orderly,and efficient inspection process.Most in-service robots check the task tubes using row-by-row and column-bycolumn planning.This leads to unnecessary inspections,resulting in a long shutdown and affecting the regular operation of a nuclear power plant.Therefore,this paper introduces the structure and control system of a dexterous robot and proposes a task planning method.This method proceeds into three steps:task allocation,base position search,and sequence planning.To allocate the task regions,this method calculates the tool work matrix and proposes a criterion to evaluate a sub-region.And then all tasks contained in the sub-region are considered globally to search the base positions.Lastly,we apply an improved ant colony algorithm for base sequence planning and determine the inspection orders according to the planned path.We validated the optimized algorithm by conducting task planning experiments using our robot on a tube sheet.The results show that the proposed method can accomplish full task coverage with few repetitive or redundant inspections and it increases the efficiency by 33.31% compared to the traditional planning algorithms.
文摘interaction pipelines while maintaining interfaces for task-specific customization.The Structural-BT framework supports the modular design of structure functionalities and allows easy extensibility of the inner planning flows between BT components.With the Structural-BT framework,software engineers can develop robotic software by flexibly composing BT structures to formulate the skeleton software architecture and implement task-specific algorithms when necessary.In the experiment,this paper develops robotic software for diverse task scenarios and selects the baseline approaches of Robot Operating System(ROS)and classical BT development frameworks for comparison.By quantitatively measuring the reuse frequencies and ratios of BT structures,the Structural-BT framework has been shown to be more efficient than the baseline approaches for robotic software development.
文摘Traditionally, heuristic re-planning algorithms are used to tackle the problem of dynamic task planning for multiple satellites. However, the traditional heuristic strategies depend on the concrete tasks, which often affect the result’s optimality. Noticing that the historical information of cooperative task planning will impact the latter planning results, we propose a hybrid learning algorithm for dynamic multi-satellite task planning, which is based on the multi-agent reinforcement learning of policy iteration and the transfer learning. The reinforcement learning strategy of each satellite is described with neural networks. The policy neural network individuals with the best topological structure and weights are found by applying co-evolutionary search iteratively. To avoid the failure of the historical learning caused by the randomly occurring observation requests, a novel approach is proposed to balance the quality and efficiency of the task planning, which converts the historical learning strategy to the current initial learning strategy by applying the transfer learning algorithm. The simulations and analysis show the feasibility and adaptability of the proposed approach especially for the situation with randomly occurring observation requests.
基金co-supported by the National Natural Science Foundation of China(Nos.61906203,61876187)the National Key Laboratory of Science and Technology on UAV,Northwestern Polytechnical University,China(No.614230110080817)。
文摘Unmanned Aerial Vehicles(UAVs)are useful in dangerous and dynamic tasks such as search-and-rescue,forest surveillance,and anti-terrorist operations.These tasks can be solved better through the collaboration of multiple UAVs under human supervision.However,it is still difficult for human to monitor,understand,predict and control the behaviors of the UAVs due to the task complexity as well as the black-box machine learning and planning algorithms being used.In this paper,the coactive design method is adopted to analyze the cognitive capabilities required for the tasks and design the interdependencies among the heterogeneous teammates of UAVs or human for coherent collaboration.Then,an agent-based task planner is proposed to automatically decompose a complex task into a sequence of explainable subtasks under constrains of resources,execution time,social rules and costs.Besides,a deep reinforcement learning approach is designed for the UAVs to learn optimal policies of a flocking behavior and a path planner that are easy for the human operator to understand and control.Finally,a mixed-initiative action selection mechanism is used to evaluate the learned policies as well as the human’s decisions.Experimental results demonstrate the effectiveness of the proposed methods.
文摘Task planning and collaboration of multiple robots have broad application prospects and value in the field of robotics.To improve the performance and working efficiency of our Spherical Underwater Robot(SUR),we propose a multi-robot control strategy that can realize the task planning and collaboration of multiple robots.To complete real-time information sharing of multiple robots,we first build an acoustic communication system with excellent communication performance under low noise ratio conditions.Then,the task planning and collaboration control strategy adjust the SURs so that they maintain their positions in the desired formation when the formation moves.Multiple SURs can move along desired trajectories in the expected formation.The control strategy of each SUR uses only its information and limited information of its neighboring SURs.Finally,based on theoretical analysis and experiments,we evaluate the validity and reliability of the proposed strategy.In comparison to the traditional leader–follower method,it is not necessary to designate a leader and its followers explicitly in our system;thus,important advantages,such as fault tolerance,are achieved.
基金supported by the National High-Tech R&D Program(863) of China(No.2014AA015203)
文摘Recently, crowdsourcing platforms have attracted a number of citizens to perform a variety of location- specific tasks. However, most existing approaches consider the arrangement of a set of tasks for a set of crowd workers, while few consider crowd workers arriving in a dynamic manner. Therefore, how to arrange suitable location-specific tasks to a set of crowd workers such that the crowd workers obtain maximum satisfaction when arriving sequentially represents a challenge. To address the limitation of existing approaches, we first identify a more general and useful model that considers not only the arrangement of a set of tasks to a set of crowd workers, but also all the dynamic arrivals of all crowd workers. Then, we present an effective crowd-task model which is applied to offiine and online settings, respectively. To solve the problem in an offiine setting, we first observe the characteristics of task planning (CTP) and devise a CTP algorithm to solve the problem. We also propose an effective greedy method and integrated simulated annealing (ISA) techniques to improve the algorithm performance. To solve the problem in an online setting, we develop a greedy algorithm for task planning. Finally, we verify the effectiveness and efficiency of the proposed solutions through extensive experiments using real and synthetic datasets.
基金supported by the National Natural Science Foundation of China(61701365,61801365 and 91638202)China Postdoctoral Science Foundation(2018M643581,2019TQ0241)+2 种基金National Natural Science Foundation of Shaanxi Province(2019JQ-152)Postdoctoral Foundation in Shaanxi Province of Chinathe Fundamental Research Funds for the Central Universities.
文摘In this paper,a resource mobility aware two-stage hybrid task planning algorithm is proposed to reduce the resource conflict between emergency tasks and the common tasks,so as to improve the overall performance of space information networks.Specifically,in the common task planning stage,a resource fragment avoidance task planning algorithm is proposed,which reduces the contention between emergency tasks and the planned common tasks in the next stage by avoiding the generation of resource fragments.For emergency tasks,we design a metric to quantify the revenue of the candidate resource combination of emergency tasks,which considers both the priority of the tasks and the impact on the planned common tasks.Based on this,a resource mobility aware emergency task planning algorithm is proposed,which strikes a good balance between improving the sum priority and avoiding disturbing the planned common tasks.Finally,simulation results show that the proposed algorithm is superior to the existing algorithms in both the sum task priority and the task completion rate.
基金supported in part by NSF (IIS1637736, IIS-1651089, IIS-1724157)ONR (N00014-182243)+2 种基金FLI (RFP2-000)Intel, RaytheonLockheed Martin
文摘Robots need task planning algorithms to sequence actions toward accomplishing goals that are impossible through individual actions. Off-the-shelf task planners can be used by intelligent robotics practitioners to solve a variety of planning problems. However, many different planners exist, each with different strengths and weaknesses,and there are no general rules for which planner would be best to apply to a given problem. In this study, we empirically compare the performance of state-of-the-art planners that use either the planning domain description language(PDDL) or answer set programming(ASP) as the underlying action language. PDDL is designed for task planning, and PDDL-based planners are widely used for a variety of planning problems. ASP is designed for knowledge-intensive reasoning, but can also be used to solve task planning problems. Given domain encodings that are as similar as possible, we find that PDDL-based planners perform better on problems with longer solutions,and ASP-based planners are better on tasks with a large number of objects or tasks in which complex reasoning is required to reason about action preconditions and effects. The resulting analysis can inform selection among general-purpose planning systems for particular robot task planning domains.
基金Project supported by the National Natural Science Foundation of China(Grant No.61073049)the Ph D Programs Foundation of the Ministry of Education of China(Grant No.20093108110016)the Shanghai Leading Academic Discipline Project(Grant No.J50103)
文摘t In this paper an overall scheme of the task management system of ternary optical computer (TOC) is proposed, and the software architecture chart is given. The function and accomplishment of each module in the system are described in general. In addition, according to the aforementioned scheme a prototype of TOC task management system is implemented, and the feasibility, rationality and completeness of the scheme are verified via running and testing the prototype.
文摘Based on the modeling of robot working environment, the shortest distance matrix between points is solved by Floyd algorithm. With the objective of minimizing the sum of the fixed cost of robot and the cost of robot operation, an integer programming model is established and a genetic algorithm for solving the model is designed. In order to make coordination to accomplish their respective tasks for each robot with high efficiency, this paper uses natural number encoding way. The objective function is based on penalty term constructed with the total number of collisions in the running path of robots. The fitness function is constructed by using the objective function with penalty term. Based on elitist retention strategy, a genetic algorithm with collision detection is designed. Using this algorithm for task allocation and path planning of multi-robot, it can effectively avoid or reduce the number of collisions in the process of multi-robot performing tasks. Finally, an example is used to validate the method.
文摘A theoretical approach of ordered emergency tasks generation is proposed for dealing with a specific emergency event rapidly, exactly and effectively. According to the general principles of an emergency plan developed to response to an emergency management, a workflow model is employed to complete the formal modeling of concrete emergency plan firstly. Then the HTN planning system SHOP2 is introduced, the transformation method of domain knowledge from emergency domain to SHOP2 domain is studied. At last, the general procedure to solve the emergency decision prob-lems and to generate executive emergency tasks is set up drawing support from SHOP2 planning system, which will combine the principles (or knowledge) of emergency plan and the real emergency situations.