Aiming at addressing the problem of manoeuvring decision-making in UAV air combat,this study establishes a one-to-one air combat model,defines missile attack areas,and uses the non-deterministic policy Soft-Actor-Crit...Aiming at addressing the problem of manoeuvring decision-making in UAV air combat,this study establishes a one-to-one air combat model,defines missile attack areas,and uses the non-deterministic policy Soft-Actor-Critic(SAC)algorithm in deep reinforcement learning to construct a decision model to realize the manoeuvring process.At the same time,the complexity of the proposed algorithm is calculated,and the stability of the closed-loop system of air combat decision-making controlled by neural network is analysed by the Lyapunov function.This study defines the UAV air combat process as a gaming process and proposes a Parallel Self-Play training SAC algorithm(PSP-SAC)to improve the generalisation performance of UAV control decisions.Simulation results have shown that the proposed algorithm can realize sample sharing and policy sharing in multiple combat environments and can significantly improve the generalisation ability of the model compared to independent training.展开更多
Optical fibers are typically used in telecommunications services for data transmission,where the use of fiber tags is essential to distinguish between the different transmission fibers or channels and thus ensure the ...Optical fibers are typically used in telecommunications services for data transmission,where the use of fiber tags is essential to distinguish between the different transmission fibers or channels and thus ensure the working functionality of the communication system.Traditional physical entity marking methods for fiber labeling are bulky,easily confused,and,most importantly,the label information can be accessed easily by all potential users.This work proposes an encrypted optical fiber tag based on an encoded fiber Bragg grating(FBG)array that is fabricated using a point-by-point femtosecond laser pulse chain inscription method.Gratings with different resonant wavelengths and reflectivities are realized by adjusting the grating period and the refractive index modulations.It is demonstrated that a binary data sequence carried by a fiber tag can be inscribed into the fiber core in the form of an FBG array,and the tag data can be encrypted through appropriate design of the spatial distributions of the FBGs with various reflection wavelengths and reflectivities.The proposed fiber tag technology can be used for applications in port identification,encrypted data storage,and transmission in fiber networks.展开更多
The demand for autonomous motion control of unmanned aerial vehicles in air combat is boosted as taking the initiative in combat appears more and more crucial.Unmanned aerial vehicles inability to manoeuvre autonomous...The demand for autonomous motion control of unmanned aerial vehicles in air combat is boosted as taking the initiative in combat appears more and more crucial.Unmanned aerial vehicles inability to manoeuvre autonomously during air combat that features highly dynamic and uncertain manoeuvres of the enemy;however,limits their combat capabilities,which proves to be very challenging.To meet the challenge,this article proposes an autonomous manoeuvre decision model using an expert actor-based soft actor critic algorithm that reconstructs empirical replay buffer with expert experience.Specifically,the algorithm uses a small amount of expert experience to increase the diversity of the samples,which can largely improve the exploration and utilisation efficiency of deep reinforcement learning.And to simulate the complex battlefield environment,a one-toone air combat model is established and the concept of missile's attack region is introduced.The model enables the one-to-one air combat to be simulated under different initial battlefield situations.Simulation results show that the expert actor-based soft actor critic algorithm can find the most favourable policy for unmanned aerial vehicles to defeat the opponent faster,and converge more quickly,compared with the soft actor critic algorithm.展开更多
Dear editor,In this letter,we use a distributed optimization approach to solve a class of multi-robot formation problem with virtual reference center.We investigate the design and analysis of the constrained consensus...Dear editor,In this letter,we use a distributed optimization approach to solve a class of multi-robot formation problem with virtual reference center.We investigate the design and analysis of the constrained consensus algorithm to solve the optimization problem with a sum of objective functions with some local constraints.In the multi-robot system with virtual reference center,each robot has messages on its own constraints and objective function,as well as the message about the formation that interacts with the virtual reference center.At the same time,all the robots collaborate to find the minimum value of the function defined by the formation.To find the optimal formation,we propose an algorithm with fixed step size with better performance.In addition,we use a combination of the Hungarian assignment algorithm and the proposed formation algorithm to get the optimal matching formation of the multi-robot system.展开更多
A novel environmentally friendly type of calcium carbonate, zinc (Ⅱ) and iron (Ⅲ) scale inhibitor Acrylic acidallylpolyethoxy carboxylate copolymer (AA- APEL) was synthesized. The anti-scale property of the AA...A novel environmentally friendly type of calcium carbonate, zinc (Ⅱ) and iron (Ⅲ) scale inhibitor Acrylic acidallylpolyethoxy carboxylate copolymer (AA- APEL) was synthesized. The anti-scale property of the AA-APEL toward CaCO3, zinc (Ⅱ) and iron (Ⅲ) in the artificial cooling water was studied through static scale inhibition tests. The observation shows that both calcium carbonate, zinc (Ⅱ) and iron (Ⅲ) inhibition increase with increasing the dosage of AA-APEL. The effect on formation of CaCO3 was investigated with combination of scanning electronic microscopy (SEM), transmission electron microscopy (TEM), X-ray powder diffraction (XRD) analysis and fourier transform infrared spectrometer, respectively. The results showed that the AA-APEL copolymer not only influenced calcium carbonate crystal morphology and crystal size but also the crystallinity. The crystallization of CaCO3 in the absence of inhibitor was rhombohedral calcite crystal, whereas a mixture of calcite with vaterite crystals was found in the presence of the AA- APEL copolymer. Inhibition mechanism is proposed that the interactions between calcium or iron ions and polyethylene glycol (PEG) are the fundamental impetus to restrain the formation of the scale in cooling water systems.展开更多
To the Editor:Epidemiological studies have confirmed that fine particulate matter(PM2.5)is related to skin hyperpigmentation,but experimental evidence is lacking.[1]Here,we used normal human epidermal keratinocytes(NH...To the Editor:Epidemiological studies have confirmed that fine particulate matter(PM2.5)is related to skin hyperpigmentation,but experimental evidence is lacking.[1]Here,we used normal human epidermal keratinocytes(NHEKs),melanocytes(NHEMs),and reconstructed human epidermis models(MelaKutis®)to investigate the impact of PM2.5 on skin melanogenesis.MelaKutis®is a 3D skin model with a stratified structure,which is composed of human keratinocytes and melanocytes.Its structure and metabolic features are highly similar to those of the natural human skin.Moreover,external factors can stimulate the melanocytes located in the basal layer to produce melanin,resulting in hyperpigmentation.In our study,to simulate the effect of PM2.5 on human skin,we utilized PM2.5 collected in Beijing,China.Zhang et al[2]previously analyzed the components of PM2.5(collected in Beijing)and revealed that benzo[a]pyrene(BAP)was one of the most abundant and toxic components of PM2.5.Thus,we chose BAP as positive control.展开更多
To the Editor:Epidemiological studies have shown that fine particulate matter 2.5(PM2.5)exposure increases the risk of skin hyperpigmentation.[1]recent'study proved that PM2.5 could induce melanogenesis by regulat...To the Editor:Epidemiological studies have shown that fine particulate matter 2.5(PM2.5)exposure increases the risk of skin hyperpigmentation.[1]recent'study proved that PM2.5 could induce melanogenesis by regulating tyrosinase(TYR),and tyrosinase-relatedproteini(TYRP1)and 2(TYRP2)expression via aryl hydrocarbon receptor(AhR)/mitogen-activated protein kinase signaling activation.展开更多
基金National Natural Science Foundation of China,Grant/Award Number:62003267Fundamental Research Funds for the Central Universities,Grant/Award Number:G2022KY0602+1 种基金Technology on Electromagnetic Space Operations and Applications Laboratory,Grant/Award Number:2022ZX0090Key Core Technology Research Plan of Xi'an,Grant/Award Number:21RGZN0016。
文摘Aiming at addressing the problem of manoeuvring decision-making in UAV air combat,this study establishes a one-to-one air combat model,defines missile attack areas,and uses the non-deterministic policy Soft-Actor-Critic(SAC)algorithm in deep reinforcement learning to construct a decision model to realize the manoeuvring process.At the same time,the complexity of the proposed algorithm is calculated,and the stability of the closed-loop system of air combat decision-making controlled by neural network is analysed by the Lyapunov function.This study defines the UAV air combat process as a gaming process and proposes a Parallel Self-Play training SAC algorithm(PSP-SAC)to improve the generalisation performance of UAV control decisions.Simulation results have shown that the proposed algorithm can realize sample sharing and policy sharing in multiple combat environments and can significantly improve the generalisation ability of the model compared to independent training.
基金supported by the National Natural Science Foundation of China(62122057,62075136,62105217,62205221,62205222)the Basic and Applied Basic Research Foundation of Guangdong Province(2022B1515120061)Shenzhen Science and Technology Program(Shenzhen Key Laboratory of Ultrafast Laser Micro/Nano Manufacturing ZDSYS20220606100405013,RCYX20200714114524139,JCYJ20200109114001806)。
文摘Optical fibers are typically used in telecommunications services for data transmission,where the use of fiber tags is essential to distinguish between the different transmission fibers or channels and thus ensure the working functionality of the communication system.Traditional physical entity marking methods for fiber labeling are bulky,easily confused,and,most importantly,the label information can be accessed easily by all potential users.This work proposes an encrypted optical fiber tag based on an encoded fiber Bragg grating(FBG)array that is fabricated using a point-by-point femtosecond laser pulse chain inscription method.Gratings with different resonant wavelengths and reflectivities are realized by adjusting the grating period and the refractive index modulations.It is demonstrated that a binary data sequence carried by a fiber tag can be inscribed into the fiber core in the form of an FBG array,and the tag data can be encrypted through appropriate design of the spatial distributions of the FBGs with various reflection wavelengths and reflectivities.The proposed fiber tag technology can be used for applications in port identification,encrypted data storage,and transmission in fiber networks.
基金acknowledge the National Nature Science Foundation of China(Grant No.62003267)Fundamental Research Funds for the Central Universities(Grant No.G2022KY0602)+1 种基金Technology on Electromagnetic Space Operations and Applications Laboratory(Grant No.2022ZX0090)key core technology research plan of Xi'an(Grant No.21RGZN0016)to provide fund for conducting experiments.
文摘The demand for autonomous motion control of unmanned aerial vehicles in air combat is boosted as taking the initiative in combat appears more and more crucial.Unmanned aerial vehicles inability to manoeuvre autonomously during air combat that features highly dynamic and uncertain manoeuvres of the enemy;however,limits their combat capabilities,which proves to be very challenging.To meet the challenge,this article proposes an autonomous manoeuvre decision model using an expert actor-based soft actor critic algorithm that reconstructs empirical replay buffer with expert experience.Specifically,the algorithm uses a small amount of expert experience to increase the diversity of the samples,which can largely improve the exploration and utilisation efficiency of deep reinforcement learning.And to simulate the complex battlefield environment,a one-toone air combat model is established and the concept of missile's attack region is introduced.The model enables the one-to-one air combat to be simulated under different initial battlefield situations.Simulation results show that the expert actor-based soft actor critic algorithm can find the most favourable policy for unmanned aerial vehicles to defeat the opponent faster,and converge more quickly,compared with the soft actor critic algorithm.
基金supported in part by the National Natural Science Foundation of China(61876036)the Jiangsu Provincial Key Laboratory of Networked Collective Intelligence(BM2017002)。
文摘Dear editor,In this letter,we use a distributed optimization approach to solve a class of multi-robot formation problem with virtual reference center.We investigate the design and analysis of the constrained consensus algorithm to solve the optimization problem with a sum of objective functions with some local constraints.In the multi-robot system with virtual reference center,each robot has messages on its own constraints and objective function,as well as the message about the formation that interacts with the virtual reference center.At the same time,all the robots collaborate to find the minimum value of the function defined by the formation.To find the optimal formation,we propose an algorithm with fixed step size with better performance.In addition,we use a combination of the Hungarian assignment algorithm and the proposed formation algorithm to get the optimal matching formation of the multi-robot system.
基金This work was supported by the Prospective Joint Research Project of Jiangsu Province (BY2012196) the National Natural Science Foundation of China (Grant No. 51077013)+3 种基金 Special funds for Jiangsu Province Scientific and Technological Achievements Projects of China (BA2011086) Program for Training of 333 High-Level Talent, Jiangsu Province of China (BRA2010033) Scientific Innovation Research Foundation of College Graduate in Jiangsu Province (CXLX-0134) and The Scientific Research Foundation of Graduate of South-east University (YBJJI110).
文摘A novel environmentally friendly type of calcium carbonate, zinc (Ⅱ) and iron (Ⅲ) scale inhibitor Acrylic acidallylpolyethoxy carboxylate copolymer (AA- APEL) was synthesized. The anti-scale property of the AA-APEL toward CaCO3, zinc (Ⅱ) and iron (Ⅲ) in the artificial cooling water was studied through static scale inhibition tests. The observation shows that both calcium carbonate, zinc (Ⅱ) and iron (Ⅲ) inhibition increase with increasing the dosage of AA-APEL. The effect on formation of CaCO3 was investigated with combination of scanning electronic microscopy (SEM), transmission electron microscopy (TEM), X-ray powder diffraction (XRD) analysis and fourier transform infrared spectrometer, respectively. The results showed that the AA-APEL copolymer not only influenced calcium carbonate crystal morphology and crystal size but also the crystallinity. The crystallization of CaCO3 in the absence of inhibitor was rhombohedral calcite crystal, whereas a mixture of calcite with vaterite crystals was found in the presence of the AA- APEL copolymer. Inhibition mechanism is proposed that the interactions between calcium or iron ions and polyethylene glycol (PEG) are the fundamental impetus to restrain the formation of the scale in cooling water systems.
基金This study was supported by the National Natural Science Foundation of China(No.2101000271)。
文摘To the Editor:Epidemiological studies have confirmed that fine particulate matter(PM2.5)is related to skin hyperpigmentation,but experimental evidence is lacking.[1]Here,we used normal human epidermal keratinocytes(NHEKs),melanocytes(NHEMs),and reconstructed human epidermis models(MelaKutis®)to investigate the impact of PM2.5 on skin melanogenesis.MelaKutis®is a 3D skin model with a stratified structure,which is composed of human keratinocytes and melanocytes.Its structure and metabolic features are highly similar to those of the natural human skin.Moreover,external factors can stimulate the melanocytes located in the basal layer to produce melanin,resulting in hyperpigmentation.In our study,to simulate the effect of PM2.5 on human skin,we utilized PM2.5 collected in Beijing,China.Zhang et al[2]previously analyzed the components of PM2.5(collected in Beijing)and revealed that benzo[a]pyrene(BAP)was one of the most abundant and toxic components of PM2.5.Thus,we chose BAP as positive control.
基金National Natural Science Foundation of China(No. 2101000271)。
文摘To the Editor:Epidemiological studies have shown that fine particulate matter 2.5(PM2.5)exposure increases the risk of skin hyperpigmentation.[1]recent'study proved that PM2.5 could induce melanogenesis by regulating tyrosinase(TYR),and tyrosinase-relatedproteini(TYRP1)and 2(TYRP2)expression via aryl hydrocarbon receptor(AhR)/mitogen-activated protein kinase signaling activation.