This paper is concerned with the cooperative target stalking for a multi-unmanned surface vehicle(multi-USV)system.Based on the multi-agent deep deterministic policy gradient(MADDPG)algorithm,a multi-USV target stalki...This paper is concerned with the cooperative target stalking for a multi-unmanned surface vehicle(multi-USV)system.Based on the multi-agent deep deterministic policy gradient(MADDPG)algorithm,a multi-USV target stalking(MUTS)algorithm is proposed.Firstly,a V-type probabilistic data extraction method is proposed for the first time to overcome shortcomings of the MADDPG algorithm.The advantages of the proposed method are twofold:1)it can reduce the amount of data and shorten training time;2)it can filter out more important data in the experience buffer for training.Secondly,in order to avoid the collisions of USVs during the stalking process,an action constraint method called Safe DDPG is introduced.Finally,the MUTS algorithm and some existing algorithms are compared in cooperative target stalking scenarios.In order to demonstrate the effectiveness of the proposed MUTS algorithm in stalking tasks,mission operating scenarios and reward functions are well designed in this paper.The proposed MUTS algorithm can help the multi-USV system avoid internal collisions during the mission execution.Moreover,compared with some existing algorithms,the newly proposed one can provide a higher convergence speed and a narrower convergence domain.展开更多
This paper proposes a novel nondestructive diagnostic method for flip chips based on an improved semi-supervised deep extreme learning machine(ISDELM)and vibration signals.First,an ultrasonic transducer is used to gen...This paper proposes a novel nondestructive diagnostic method for flip chips based on an improved semi-supervised deep extreme learning machine(ISDELM)and vibration signals.First,an ultrasonic transducer is used to generate and focus ultrasounds on the surface of the flip chip to excite it,and a laser scanning vibrometer is applied to acquire the chip’s vibration signals.Then,an extreme learning machine-autoencoder(ELM-AE)structure is adopted to extract features from the original vibration signals layer by layer.Finally,the study proposes integrating the ELM with sparsity neighboring reconstruction to diagnose defects based on unlabeled and labeled data.The ISDELM algorithm is applied to experimental vibration data of flip chips and compared with several other algorithms,such as semi-supervised ELM(SS-ELM),deep ELM,stacked autoencoder,convolutional neural network,and ordinary SDELM.The results show that the proposed method is superior to the several currently available algorithms in terms of accuracy and stability.展开更多
基金supported in part by the National Natural Science Foundation of China(61873335,61833011,62173164)the Project of Science and Technology Commission of Shanghai Municipality,China(20ZR1420200,21SQBS01600,22JC1401400,19510750300,21190780300)the Natural Science Foundation of Jiangsu Province of China(BK20201451)。
文摘This paper is concerned with the cooperative target stalking for a multi-unmanned surface vehicle(multi-USV)system.Based on the multi-agent deep deterministic policy gradient(MADDPG)algorithm,a multi-USV target stalking(MUTS)algorithm is proposed.Firstly,a V-type probabilistic data extraction method is proposed for the first time to overcome shortcomings of the MADDPG algorithm.The advantages of the proposed method are twofold:1)it can reduce the amount of data and shorten training time;2)it can filter out more important data in the experience buffer for training.Secondly,in order to avoid the collisions of USVs during the stalking process,an action constraint method called Safe DDPG is introduced.Finally,the MUTS algorithm and some existing algorithms are compared in cooperative target stalking scenarios.In order to demonstrate the effectiveness of the proposed MUTS algorithm in stalking tasks,mission operating scenarios and reward functions are well designed in this paper.The proposed MUTS algorithm can help the multi-USV system avoid internal collisions during the mission execution.Moreover,compared with some existing algorithms,the newly proposed one can provide a higher convergence speed and a narrower convergence domain.
基金supported by the fellowship of China Postdoctoral Science Foundation(Grant No.2021T140279)the National Natural Science Foundation of China(Grant Nos.51705203,51775243 and 11902124)“111”Project(Grant No.B18027)。
文摘This paper proposes a novel nondestructive diagnostic method for flip chips based on an improved semi-supervised deep extreme learning machine(ISDELM)and vibration signals.First,an ultrasonic transducer is used to generate and focus ultrasounds on the surface of the flip chip to excite it,and a laser scanning vibrometer is applied to acquire the chip’s vibration signals.Then,an extreme learning machine-autoencoder(ELM-AE)structure is adopted to extract features from the original vibration signals layer by layer.Finally,the study proposes integrating the ELM with sparsity neighboring reconstruction to diagnose defects based on unlabeled and labeled data.The ISDELM algorithm is applied to experimental vibration data of flip chips and compared with several other algorithms,such as semi-supervised ELM(SS-ELM),deep ELM,stacked autoencoder,convolutional neural network,and ordinary SDELM.The results show that the proposed method is superior to the several currently available algorithms in terms of accuracy and stability.