This paper focuses on the solution to the dynamic affine formation control problem for multiple networked underactuated quad-rotor unmanned aerial vehicles(UAVs)to achieve a configuration that preserves collinearity a...This paper focuses on the solution to the dynamic affine formation control problem for multiple networked underactuated quad-rotor unmanned aerial vehicles(UAVs)to achieve a configuration that preserves collinearity and ratios of distances for a target configuration.In particular,it is investigated that the quad-rotor UAVs are steered to track a reference linear velocity while maintaining a desired three-dimensional target formation.Firstly,by integrating the properties of the affine transformation and the stress matrix,the design of the target formation is convenient and applicable for various three-dimensional geometric patterns.Secondly,a distributed control method is proposed under a hierarchical framework.By introducing an intermediary control input for each quad-rotor UAV in the position loop,the necessary thrust input and the desired attitude are extracted.In the attitude loop,the desired attitude represented by the unit quaternion is tracked by the designed torque input.Both conditions of linear velocity unavailability and mutual collision avoidance are also tackled.In terms of Lyapunov theory,it is prooved that the overall closed-loop error system is asymptotically stable.Finally,two illustrative examples are simulated to validate the effectiveness of the proposed theoretical results.展开更多
Current fusion methods for infrared and visible images tend to extract features at a single scale,which results in insufficient detail and incomplete feature preservation.To address these issues,we propose an infrared...Current fusion methods for infrared and visible images tend to extract features at a single scale,which results in insufficient detail and incomplete feature preservation.To address these issues,we propose an infrared and visible image fusion network based on a multiscale feature learning and attention mechanism(MsAFusion).A multiscale dilation convolution framework is employed to capture image features across various scales and broaden the perceptual scope.Furthermore,an attention network is introduced to enhance the focus on salient targets in infrared images and detailed textures in visible images.To compensate for information loss during convolution,jump connections are utilized during the image reconstruction phase.The fusion process utilizes a combined loss function consisting of pixel loss and gradient loss for unsupervised fusion of infrared and visible images.Extensive experiments on the dataset of electricity facilities demonstrate that our proposed method outperforms nine state-of-theart methods in terms of visual perception and four objective evaluation metrics.展开更多
With more multi-modal data available for visual classification tasks,human action recognition has become an increasingly attractive topic.However,one of the main challenges is to effectively extract complementary feat...With more multi-modal data available for visual classification tasks,human action recognition has become an increasingly attractive topic.However,one of the main challenges is to effectively extract complementary features from different modalities for action recognition.In this work,a novel multimodal supervised learning framework based on convolution neural networks(Conv Nets)is proposed to facilitate extracting the compensation features from different modalities for human action recognition.Built on information aggregation mechanism and deep Conv Nets,our recognition framework represents spatial-temporal information from the base modalities by a designed frame difference aggregation spatial-temporal module(FDA-STM),that the networks bridges information from skeleton data through a multimodal supervised compensation block(SCB)to supervise the extraction of compensation features.We evaluate the proposed recognition framework on three human action datasets,including NTU RGB+D 60,NTU RGB+D 120,and PKU-MMD.The results demonstrate that our model with FDA-STM and SCB achieves the state-of-the-art recognition performance on three benchmark datasets.展开更多
This paper considers an affine maneuver tracking control problem for leader-follower type second-order multi-agent systems in the presence of time-varying delays, where the interaction topology is directed. Using the ...This paper considers an affine maneuver tracking control problem for leader-follower type second-order multi-agent systems in the presence of time-varying delays, where the interaction topology is directed. Using the property of the affine transformation,this paper gives the sufficient and necessary conditions of achieving the affine localizability and extends it to the second-order condition. Under the(n + 1)-reachable condition of the given n-dimensional nominal formation with n + 1 leaders, a formation of agents can be reshaped in arbitrary dimension by only controlling these leaders. When the neighboring positions and velocities are available, a formation maneuver tracking control protocol with time-varying delays is constructed with the form of linear systems, where the tracking errors of the followers can be specified. Based on Lyapunov-Krasovskii stability theory, sufficient conditions to realize affine maneuvers are proposed and proved, and the unknown control gain matrix can be solved only by four linear matrix inequalities independent of the number of agents. Finally, corresponding simulations are carried out to verify the theoretical results, which show that these followers can track the time-varying references accurately and continuously.展开更多
Autonomous aerial robotics has become a hot direction ofresearch inside the community of robotics and control. Theprimary problem addressed by formation control is to steermultiple aerial robots to form desired geomet...Autonomous aerial robotics has become a hot direction ofresearch inside the community of robotics and control. Theprimary problem addressed by formation control is to steermultiple aerial robots to form desired geometric patterns and,at the same time, realize desired collective swarming behaviorsin a decentralized or distributed manner. In contrast toground vehicles, aerial robots have the ability to work inthree-dimensional (3D) airspace. Equipped with electric orhydraulic motors, the vertical take-off and landing (VTOL)capability is a typical performance of aerial robots. Formationcontrol technology for such aerial robots is incessantlyspringing up to satisfy the requirements of highly intelligentautonomous systems, which affects both military and civilareas, including missile defense, battlefield surveillance,satellite network construction, fire suppression, power gridinspection, commercial show, etc. [1–5]. Such a problem ofmultiple aerial robots formation control is exceptionallychallenging to analyze if practical constraints such as complexdynamics, motion constraints, and imperfect measurementsare incorporated.展开更多
The rendezvous and formation problem is a significant part for the unmanned aerial vehicle(UAV) autonomous aerial refueling(AAR) technique. It can be divided into two major phases: the long-range guidance phase a...The rendezvous and formation problem is a significant part for the unmanned aerial vehicle(UAV) autonomous aerial refueling(AAR) technique. It can be divided into two major phases: the long-range guidance phase and the formation phase. In this paper, an iterative computation guidance law(ICGL) is proposed to compute a series of state variables to get the solution of a control variable for a UAV conducting rendezvous with a tanker in AAR. The proposed method can make the control variable converge to zero when the tanker and the UAV receiver come to a formation flight eventually. For the long-range guidance phase, the ICGL divides it into two sub-phases: the correction sub-phase and the guidance sub-phase. The two sub-phases share the same iterative process. As for the formation phase, a velocity coordinate system is created by which control accelerations are designed to make the speed of the UAV consistent with that of the tanker.The simulation results demonstrate that the proposed ICGL is effective and robust against wind disturbance.展开更多
For the tracking control problems of affine formation maneuvers with discrete leader-following multi-agent systems, various distributed control schemes based on the directed graphs are designed in this paper. Consider...For the tracking control problems of affine formation maneuvers with discrete leader-following multi-agent systems, various distributed control schemes based on the directed graphs are designed in this paper. Consider the single and double-integrator models, different types of formation maneuvers can be achieved subject to the states of leaders with the novel characteristic of affine localizability. Meanwhile, the properties of affine transformation and signed Laplacian are introduced, which simplify the structures of controllers with distinct constraints to a great extent. Moreover, the convergence analysis of proposed protocols is proven. Static, constant and time-varying target formations can be tracked successfully. In the end, corresponding numerical simulations are carried out to certify the validity of theoretical results.展开更多
This paper presents a distributed planar leader-follower formation maneuver control strategy for multi-agent systems with different agent dynamic models.This method is based on the barycentric coordinate-based(BCB)con...This paper presents a distributed planar leader-follower formation maneuver control strategy for multi-agent systems with different agent dynamic models.This method is based on the barycentric coordinate-based(BCB)control,which can be performed in the local coordinate frame of each agent with required local measurements.By exploring the properties of BCB Laplacians,a time-varying target formation can be BCB localizable by a sufficient number of leaders uniquely,and this formation is converted from a given nominal formation with geometrical similarity transformation.The proposed control laws can continuously maneuver collective single-and double-integrator agents to achieve a translation,scale,rotation,or even their compositions in various directions.For the formation shape control problem of multi-car systems with/without saturation constraints,the obtained control performance can preserve good robustness.Global stability is also proven by mathematical derivations and verified by numerical simulations.展开更多
基金supported by the National Natural Science Foundation of China(61673327)the Industrial Development and Foster Project of Yangtze River Delta Research Institute of NPU,Taicang(CY20210202)+1 种基金the Fundamental Research Funds for the Central Universities(G2021KY05116,G2022WD01026)the Basic Research Programs of Taicang(TC2021JC28)。
文摘This paper focuses on the solution to the dynamic affine formation control problem for multiple networked underactuated quad-rotor unmanned aerial vehicles(UAVs)to achieve a configuration that preserves collinearity and ratios of distances for a target configuration.In particular,it is investigated that the quad-rotor UAVs are steered to track a reference linear velocity while maintaining a desired three-dimensional target formation.Firstly,by integrating the properties of the affine transformation and the stress matrix,the design of the target formation is convenient and applicable for various three-dimensional geometric patterns.Secondly,a distributed control method is proposed under a hierarchical framework.By introducing an intermediary control input for each quad-rotor UAV in the position loop,the necessary thrust input and the desired attitude are extracted.In the attitude loop,the desired attitude represented by the unit quaternion is tracked by the designed torque input.Both conditions of linear velocity unavailability and mutual collision avoidance are also tackled.In terms of Lyapunov theory,it is prooved that the overall closed-loop error system is asymptotically stable.Finally,two illustrative examples are simulated to validate the effectiveness of the proposed theoretical results.
基金supported by the project of CSG Electric Power Research Institute(Grant No.SEPRI-K22B100)。
文摘Current fusion methods for infrared and visible images tend to extract features at a single scale,which results in insufficient detail and incomplete feature preservation.To address these issues,we propose an infrared and visible image fusion network based on a multiscale feature learning and attention mechanism(MsAFusion).A multiscale dilation convolution framework is employed to capture image features across various scales and broaden the perceptual scope.Furthermore,an attention network is introduced to enhance the focus on salient targets in infrared images and detailed textures in visible images.To compensate for information loss during convolution,jump connections are utilized during the image reconstruction phase.The fusion process utilizes a combined loss function consisting of pixel loss and gradient loss for unsupervised fusion of infrared and visible images.Extensive experiments on the dataset of electricity facilities demonstrate that our proposed method outperforms nine state-of-theart methods in terms of visual perception and four objective evaluation metrics.
基金This work was supported by the Natural Science Foundation of Guangdong Province(Grant Nos.2022A1515140119 and 2023A1515011307)the National Key Laboratory of Air-based Information Perception and Fusion and the Aeronautic Science Foundation of China(Grant No.20220001068001)+1 种基金Dongguan Science and Technology Special Commissioner Project(Grant No.20221800500362)the National Natural Science Foundation of China(Grant Nos.62376261,61972090,and U21A20487).
文摘With more multi-modal data available for visual classification tasks,human action recognition has become an increasingly attractive topic.However,one of the main challenges is to effectively extract complementary features from different modalities for action recognition.In this work,a novel multimodal supervised learning framework based on convolution neural networks(Conv Nets)is proposed to facilitate extracting the compensation features from different modalities for human action recognition.Built on information aggregation mechanism and deep Conv Nets,our recognition framework represents spatial-temporal information from the base modalities by a designed frame difference aggregation spatial-temporal module(FDA-STM),that the networks bridges information from skeleton data through a multimodal supervised compensation block(SCB)to supervise the extraction of compensation features.We evaluate the proposed recognition framework on three human action datasets,including NTU RGB+D 60,NTU RGB+D 120,and PKU-MMD.The results demonstrate that our model with FDA-STM and SCB achieves the state-of-the-art recognition performance on three benchmark datasets.
基金supported by the National Natural Science Foundation of China(Grant No.61673327)the China Scholarship Council(Grant No.201606310153)the Aviation Science Foundation of China(Grant No.20160168001)
文摘This paper considers an affine maneuver tracking control problem for leader-follower type second-order multi-agent systems in the presence of time-varying delays, where the interaction topology is directed. Using the property of the affine transformation,this paper gives the sufficient and necessary conditions of achieving the affine localizability and extends it to the second-order condition. Under the(n + 1)-reachable condition of the given n-dimensional nominal formation with n + 1 leaders, a formation of agents can be reshaped in arbitrary dimension by only controlling these leaders. When the neighboring positions and velocities are available, a formation maneuver tracking control protocol with time-varying delays is constructed with the form of linear systems, where the tracking errors of the followers can be specified. Based on Lyapunov-Krasovskii stability theory, sufficient conditions to realize affine maneuvers are proposed and proved, and the unknown control gain matrix can be solved only by four linear matrix inequalities independent of the number of agents. Finally, corresponding simulations are carried out to verify the theoretical results, which show that these followers can track the time-varying references accurately and continuously.
基金supported by the National Natural Science Foundation of China(Grant Nos.61673327,51606161,11602209,91441128)the Natural Science Foundation of Fujian Province,China(Grant No.2016J06011)
文摘Autonomous aerial robotics has become a hot direction ofresearch inside the community of robotics and control. Theprimary problem addressed by formation control is to steermultiple aerial robots to form desired geometric patterns and,at the same time, realize desired collective swarming behaviorsin a decentralized or distributed manner. In contrast toground vehicles, aerial robots have the ability to work inthree-dimensional (3D) airspace. Equipped with electric orhydraulic motors, the vertical take-off and landing (VTOL)capability is a typical performance of aerial robots. Formationcontrol technology for such aerial robots is incessantlyspringing up to satisfy the requirements of highly intelligentautonomous systems, which affects both military and civilareas, including missile defense, battlefield surveillance,satellite network construction, fire suppression, power gridinspection, commercial show, etc. [1–5]. Such a problem ofmultiple aerial robots formation control is exceptionallychallenging to analyze if practical constraints such as complexdynamics, motion constraints, and imperfect measurementsare incorporated.
基金partially supported by the National Natural Science Foundation of China(No.61333004)partially by the Aeronautical Science Foundation of China(No.20115868009)partially by the open funding project of the State Key Laboratory of Virtual Reality Technology and Systems at Beihang University of China(No.BUAA-VR-13KF-01)
文摘The rendezvous and formation problem is a significant part for the unmanned aerial vehicle(UAV) autonomous aerial refueling(AAR) technique. It can be divided into two major phases: the long-range guidance phase and the formation phase. In this paper, an iterative computation guidance law(ICGL) is proposed to compute a series of state variables to get the solution of a control variable for a UAV conducting rendezvous with a tanker in AAR. The proposed method can make the control variable converge to zero when the tanker and the UAV receiver come to a formation flight eventually. For the long-range guidance phase, the ICGL divides it into two sub-phases: the correction sub-phase and the guidance sub-phase. The two sub-phases share the same iterative process. As for the formation phase, a velocity coordinate system is created by which control accelerations are designed to make the speed of the UAV consistent with that of the tanker.The simulation results demonstrate that the proposed ICGL is effective and robust against wind disturbance.
基金supported by the National Natural Science Foundation of China(Grant Nos.61673327,51606161,11602209&91441128)Aviation Science Foundation of China(Grant No.20185568005)the Natural Science Foundation of Fujian Province,China(Grant No.2016J06011)
文摘For the tracking control problems of affine formation maneuvers with discrete leader-following multi-agent systems, various distributed control schemes based on the directed graphs are designed in this paper. Consider the single and double-integrator models, different types of formation maneuvers can be achieved subject to the states of leaders with the novel characteristic of affine localizability. Meanwhile, the properties of affine transformation and signed Laplacian are introduced, which simplify the structures of controllers with distinct constraints to a great extent. Moreover, the convergence analysis of proposed protocols is proven. Static, constant and time-varying target formations can be tracked successfully. In the end, corresponding numerical simulations are carried out to certify the validity of theoretical results.
基金This work was supported by National Natural Science Foundation of China(Grant No.61673327)Industrial Development and Foster Project of Yangtze River Delta Research Institute of NPU,Taicang(Grant No.CY20210202).
文摘This paper presents a distributed planar leader-follower formation maneuver control strategy for multi-agent systems with different agent dynamic models.This method is based on the barycentric coordinate-based(BCB)control,which can be performed in the local coordinate frame of each agent with required local measurements.By exploring the properties of BCB Laplacians,a time-varying target formation can be BCB localizable by a sufficient number of leaders uniquely,and this formation is converted from a given nominal formation with geometrical similarity transformation.The proposed control laws can continuously maneuver collective single-and double-integrator agents to achieve a translation,scale,rotation,or even their compositions in various directions.For the formation shape control problem of multi-car systems with/without saturation constraints,the obtained control performance can preserve good robustness.Global stability is also proven by mathematical derivations and verified by numerical simulations.