为实现高超声速飞行器姿态自抗扰控制的参数整定,提出一种模糊Q学习算法。首先,采用强化学习中的Q学习算法来实现姿态自抗扰控制参数的离线闭环快速自适应整定;然后,根据模糊控制的思路,将控制参数划分为不同区域,通过设定奖励,不断更新...为实现高超声速飞行器姿态自抗扰控制的参数整定,提出一种模糊Q学习算法。首先,采用强化学习中的Q学习算法来实现姿态自抗扰控制参数的离线闭环快速自适应整定;然后,根据模糊控制的思路,将控制参数划分为不同区域,通过设定奖励,不断更新Q表;最后,将训练好的Q表用于飞行器的控制。仿真结果表明,相对于传统的线性自抗扰控制(linear active disturbance rejection control,LADRC)和滑模控制,基于Q学习的LADRC省去了人工调试参数的繁琐过程,且仍具有良好的跟踪效果。蒙特卡罗仿真测试结果验证了基于Q学习的LADRC的鲁棒性。展开更多
With the explosive increasing number of connecting devices such as smart phones, vehicles,drones, and satellites in the wireless networks, how to manage and control such a huge number of networking nodes has become a ...With the explosive increasing number of connecting devices such as smart phones, vehicles,drones, and satellites in the wireless networks, how to manage and control such a huge number of networking nodes has become a great challenge. In this paper, we combine the advantages of centralized networks and distributed networks approaches for vehicular networks with the aid of Unmanned Aerial Vehicle(UAV), and propose a Center-controlled Multihop Wireless(CMW) networking scheme consisting of data transmission plane performed by vehicles and the network control plane implemented by the UAV.Besides, we jointly explore the advantages of Medium Access Control(MAC) protocols in the link layer and routing schemes in the network layer to facilitate the multi-hop data transmission for the ground vehicles.Particularly, the network control plane in the UAV can manage the whole network effectively via fully exploiting the acquired network topology information and traffic requests from each vehicle, and implements various kinds of control based on different traffic demands, which can enhance the networking flexibility and scalability significantly in vehicular networks.Simulation results validate the advantages of the proposed scheme compared with existing methods.展开更多
The anarchic urbanization of certain African cities favors the multiplication of the malaria parasite. Thus, the urgent mobilization of African cities is essential to combat this health risk. It is, therefore, with th...The anarchic urbanization of certain African cities favors the multiplication of the malaria parasite. Thus, the urgent mobilization of African cities is essential to combat this health risk. It is, therefore, with the objective of contributing to the investigation of problem areas that the present study evaluates malaria transmission and vector control strategies in the Cotonou V health zone in particular. This is a cross-sectional study taking into account four neighborhoods, including Wologuèdè, Sainte Rita, Gbèdjromèdé and the area around Etoile Rouge. Two nocturnal captures on voluntary humans and the method of spray were carried out in the dry season from December 2021 to February 2022. On the captured Anopheles, the ELISA Circum-Sporozoite Protein test was performed to determine the infectivity and calculate some transmission parameters. Finally, we conducted a survey using the second stage sampling method with one step to ask selected households about their knowledge of vector control methods, their use and the physical integrity of LLINs. We collected 2386 culicidae of which the majority was Culex quinquefasciatus. After the ELISA test, the 29 Anopheles tested, showed no infectivity, i.e. an EIR of 0 pi/h/n. In addition, 99% of the populations in the Cotonou V area use LLINs to protect themselves. However, coils, door and window screens, aerosol sprays, skin and household repellents, and periodic indoor spraying were used. Finally, the majority of nets observed had T1 tears, but there were also T2, T3 and T4 nets (P-value = 0.0). This study confirms that malaria transmission during the dry season in the Cotonou V health zone is almost negligible but not non-existent. Also, populations are exposed to the nuisance of Culex quinquefasciatus mosquitoes continuously throughout the year.展开更多
In this paper, the fundamental structure of charge and discharge device of V2G is analyzed. As for three phase voltage source PWM converter’s control, this paper presents that the control strategy of direct power con...In this paper, the fundamental structure of charge and discharge device of V2G is analyzed. As for three phase voltage source PWM converter’s control, this paper presents that the control strategy of direct power control PWM rectifier is adopted under charging operation and constant power control strategy is used under discharging operation. For bidirectional DC/DC converter control strategy, dual closed-loop control of external voltage loop and internal current loop is put into use. The whole system of charge and discharge device of V2G is modeled and simulated by using the toolbox of PSCAD/EMTDC. Two-way power energy and information interaction of electric vehicle and power grid has been realized, current harmonic on grid side is decreased, power factor and power quality are improved.展开更多
As more and more variable frequency drives (VFDs), electronic ballasts, battery chargers, and static Var compensators are installed in facilities, the problems related to harmonics are expected to get worse. As a resu...As more and more variable frequency drives (VFDs), electronic ballasts, battery chargers, and static Var compensators are installed in facilities, the problems related to harmonics are expected to get worse. As a result Active power filter (APF) gains much more attention due to excellent harmonic compensation. But still the performance of the active filter seems to be in contradictions with different control strategies. This paper presents detailed analysis to compare and elevate the performance of two control strategies for ex-tracting reference currents of shunt active filters under balanced, un-balanced and non-sinusoidal conditions by using Fuzzy controller. The well known methods, instantaneous real active and reactive power method (p-q) and active and reactive current method (id-iq) are two control methods which are extensively used in active filters. Extensive Simulations are carried out with fuzzy controller for both p-q and Id-Iq methods for different voltage conditions and adequate results were presented. Simulation results validate the superior per-formance of active and reactive current control strategy (id-iq) with fuzzy controller over active and reactive power control strategy (p-q) with fuzzy controller.展开更多
基于模块化多电平换流器的高压柔性直流输电系统(modular multilevel converter-based high voltage direct current,MMC-HVDC)常采用双极接线方式以提高系统功率输送能力和可靠性。然而目前对于风电场经柔直外送系统的稳定性研究集中...基于模块化多电平换流器的高压柔性直流输电系统(modular multilevel converter-based high voltage direct current,MMC-HVDC)常采用双极接线方式以提高系统功率输送能力和可靠性。然而目前对于风电场经柔直外送系统的稳定性研究集中于单极接线方式,孤岛直驱风电场与采用不同双极协调控制的双极MMC-HVDC互联系统小信号稳定性问题还有待进一步探究。该文首先考虑频率耦合特性、参考系初相位和直流侧耦合特性的影响,分别建立了采用双U/f下垂控制和定U/f-P/Q控制的双极MMC-HVDC系统交流侧等效SISO阻抗模型,并详细分析了金属回线阻抗和双极间功率均分度对交流阻抗特性的影响。接着对比研究了两种协调控制中共有控制环路和特有控制环路对交流侧负电阻特性及互联系统稳定性的影响规律。最后,孤岛直驱风电场经两种双极协调控制下双极MMC-HVDC外送系统Matlab/Simulink时域仿真结果和硬件在环半实物实时仿真实验结果验证了所提出的小信号阻抗模型的精确性和稳定性分析结论的有效性。展开更多
为了优化区域交通信号配时方案,提升区域通行效率,文章提出一种基于改进多智能体Nash Q Learning的区域交通信号协调控制方法。首先,采用离散化编码方法,通过划分单元格将连续状态信息转化为离散形式。其次,在算法中融入长短时记忆网络(...为了优化区域交通信号配时方案,提升区域通行效率,文章提出一种基于改进多智能体Nash Q Learning的区域交通信号协调控制方法。首先,采用离散化编码方法,通过划分单元格将连续状态信息转化为离散形式。其次,在算法中融入长短时记忆网络(Long Short Term Memory,LSTM)模块,用于从状态数据中挖掘更多的隐藏信息,丰富Q值表中的状态数据。最后,基于微观交通仿真软件SUMO(Simulation of Urban Mobility)的仿真测试结果表明,相较于原始Nash Q Learning交通信号控制方法,所提方法在低、中、高流量下车辆的平均等待时间分别减少了11.5%、16.2%和10.0%,平均排队长度分别减少了9.1%、8.2%和7.6%,平均停车次数分别减少了18.3%、16.1%和10.0%。结果证明了该算法具有更好的控制效果。展开更多
In Japan, common wheat is cultivated in upland fields converted from paddy fields, where poor drainage and high precipitation cause delay of sowing, lodging at the jointing stage, difficulty in topdressing at the ripe...In Japan, common wheat is cultivated in upland fields converted from paddy fields, where poor drainage and high precipitation cause delay of sowing, lodging at the jointing stage, difficulty in topdressing at the ripening stage, and low yield. No-till cultivation has been promoted to overcome these problems but the yield is still low due to the lack of proper fertilizer application protocols. In this study, we determined whether an additional application of two kinds of Sigmoid coated urea as controlled availability fertilizers (CAFs) to the standard fertilization protocol for tillage cultivation can increase the yield and lodging resistance in no-till cultivated common wheat. Also, additional fertilization was applied to the seeding furrow simultaneously with seeding using a V-furrow no-till direct sowing (VFDS) machine. No-till cultivated plants had more tillers than tillage cultivated ones and consequently higher number of panicles and yield, caused by increased fertilizer application. The point-injected CAFs to the seeding furrow, which eluted at the jointing and ripening stages greatly increased the grain yield and protein content, respectively, compared to broadcast topdressing of ammonium sulfate at each stage. The simultaneous sowing and fertilization of additional CAFs using VFDS method in multi-year tests in farmers’ fields significantly increased the yield of no-till cultivated common wheat, and can be adopted by Japanese local farmers.展开更多
A gait control method for a biped robot based on the deep Q-network (DQN) algorithm is proposed to enhance the stability of walking on uneven ground. This control strategy is an intelligent learning method of posture ...A gait control method for a biped robot based on the deep Q-network (DQN) algorithm is proposed to enhance the stability of walking on uneven ground. This control strategy is an intelligent learning method of posture adjustment. A robot is taken as an agent and trained to walk steadily on an uneven surface with obstacles, using a simple reward function based on forward progress. The reward-punishment (RP) mechanism of the DQN algorithm is established after obtaining the offline gait which was generated in advance foot trajectory planning. Instead of implementing a complex dynamic model, the proposed method enables the biped robot to learn to adjust its posture on the uneven ground and ensures walking stability. The performance and effectiveness of the proposed algorithm was validated in the V-REP simulation environment. The results demonstrate that the biped robot's lateral tile angle is less than 3° after implementing the proposed method and the walking stability is obviously improved.展开更多
文摘为实现高超声速飞行器姿态自抗扰控制的参数整定,提出一种模糊Q学习算法。首先,采用强化学习中的Q学习算法来实现姿态自抗扰控制参数的离线闭环快速自适应整定;然后,根据模糊控制的思路,将控制参数划分为不同区域,通过设定奖励,不断更新Q表;最后,将训练好的Q表用于飞行器的控制。仿真结果表明,相对于传统的线性自抗扰控制(linear active disturbance rejection control,LADRC)和滑模控制,基于Q学习的LADRC省去了人工调试参数的繁琐过程,且仍具有良好的跟踪效果。蒙特卡罗仿真测试结果验证了基于Q学习的LADRC的鲁棒性。
基金supported in part by the National Natural Science Foundation of China under Grant 62071283,Grant 61771296,Grant 61872228 and Grant 62271513in part by the Natural Science Basic Research Plan in Shaanxi Province of China under Grant 2018JQ6048 and Grant 2018JZ6006+3 种基金in part by Shaanxi Key Industrial Innovation Chain Project in Industrial Domain under Grant 2020ZDLGY15-09in part by Guang Dong Basic and Applied Basic Research Foundation under Grant 2021A1515012631in part by China Postdoctoral Science Foundation under Grant 2016M600761in part by the Fundamental Research Funds for the Central Universities under Grant GK202003075 and Grant GK202103016。
文摘With the explosive increasing number of connecting devices such as smart phones, vehicles,drones, and satellites in the wireless networks, how to manage and control such a huge number of networking nodes has become a great challenge. In this paper, we combine the advantages of centralized networks and distributed networks approaches for vehicular networks with the aid of Unmanned Aerial Vehicle(UAV), and propose a Center-controlled Multihop Wireless(CMW) networking scheme consisting of data transmission plane performed by vehicles and the network control plane implemented by the UAV.Besides, we jointly explore the advantages of Medium Access Control(MAC) protocols in the link layer and routing schemes in the network layer to facilitate the multi-hop data transmission for the ground vehicles.Particularly, the network control plane in the UAV can manage the whole network effectively via fully exploiting the acquired network topology information and traffic requests from each vehicle, and implements various kinds of control based on different traffic demands, which can enhance the networking flexibility and scalability significantly in vehicular networks.Simulation results validate the advantages of the proposed scheme compared with existing methods.
文摘The anarchic urbanization of certain African cities favors the multiplication of the malaria parasite. Thus, the urgent mobilization of African cities is essential to combat this health risk. It is, therefore, with the objective of contributing to the investigation of problem areas that the present study evaluates malaria transmission and vector control strategies in the Cotonou V health zone in particular. This is a cross-sectional study taking into account four neighborhoods, including Wologuèdè, Sainte Rita, Gbèdjromèdé and the area around Etoile Rouge. Two nocturnal captures on voluntary humans and the method of spray were carried out in the dry season from December 2021 to February 2022. On the captured Anopheles, the ELISA Circum-Sporozoite Protein test was performed to determine the infectivity and calculate some transmission parameters. Finally, we conducted a survey using the second stage sampling method with one step to ask selected households about their knowledge of vector control methods, their use and the physical integrity of LLINs. We collected 2386 culicidae of which the majority was Culex quinquefasciatus. After the ELISA test, the 29 Anopheles tested, showed no infectivity, i.e. an EIR of 0 pi/h/n. In addition, 99% of the populations in the Cotonou V area use LLINs to protect themselves. However, coils, door and window screens, aerosol sprays, skin and household repellents, and periodic indoor spraying were used. Finally, the majority of nets observed had T1 tears, but there were also T2, T3 and T4 nets (P-value = 0.0). This study confirms that malaria transmission during the dry season in the Cotonou V health zone is almost negligible but not non-existent. Also, populations are exposed to the nuisance of Culex quinquefasciatus mosquitoes continuously throughout the year.
文摘In this paper, the fundamental structure of charge and discharge device of V2G is analyzed. As for three phase voltage source PWM converter’s control, this paper presents that the control strategy of direct power control PWM rectifier is adopted under charging operation and constant power control strategy is used under discharging operation. For bidirectional DC/DC converter control strategy, dual closed-loop control of external voltage loop and internal current loop is put into use. The whole system of charge and discharge device of V2G is modeled and simulated by using the toolbox of PSCAD/EMTDC. Two-way power energy and information interaction of electric vehicle and power grid has been realized, current harmonic on grid side is decreased, power factor and power quality are improved.
文摘As more and more variable frequency drives (VFDs), electronic ballasts, battery chargers, and static Var compensators are installed in facilities, the problems related to harmonics are expected to get worse. As a result Active power filter (APF) gains much more attention due to excellent harmonic compensation. But still the performance of the active filter seems to be in contradictions with different control strategies. This paper presents detailed analysis to compare and elevate the performance of two control strategies for ex-tracting reference currents of shunt active filters under balanced, un-balanced and non-sinusoidal conditions by using Fuzzy controller. The well known methods, instantaneous real active and reactive power method (p-q) and active and reactive current method (id-iq) are two control methods which are extensively used in active filters. Extensive Simulations are carried out with fuzzy controller for both p-q and Id-Iq methods for different voltage conditions and adequate results were presented. Simulation results validate the superior per-formance of active and reactive current control strategy (id-iq) with fuzzy controller over active and reactive power control strategy (p-q) with fuzzy controller.
文摘基于模块化多电平换流器的高压柔性直流输电系统(modular multilevel converter-based high voltage direct current,MMC-HVDC)常采用双极接线方式以提高系统功率输送能力和可靠性。然而目前对于风电场经柔直外送系统的稳定性研究集中于单极接线方式,孤岛直驱风电场与采用不同双极协调控制的双极MMC-HVDC互联系统小信号稳定性问题还有待进一步探究。该文首先考虑频率耦合特性、参考系初相位和直流侧耦合特性的影响,分别建立了采用双U/f下垂控制和定U/f-P/Q控制的双极MMC-HVDC系统交流侧等效SISO阻抗模型,并详细分析了金属回线阻抗和双极间功率均分度对交流阻抗特性的影响。接着对比研究了两种协调控制中共有控制环路和特有控制环路对交流侧负电阻特性及互联系统稳定性的影响规律。最后,孤岛直驱风电场经两种双极协调控制下双极MMC-HVDC外送系统Matlab/Simulink时域仿真结果和硬件在环半实物实时仿真实验结果验证了所提出的小信号阻抗模型的精确性和稳定性分析结论的有效性。
文摘为了优化区域交通信号配时方案,提升区域通行效率,文章提出一种基于改进多智能体Nash Q Learning的区域交通信号协调控制方法。首先,采用离散化编码方法,通过划分单元格将连续状态信息转化为离散形式。其次,在算法中融入长短时记忆网络(Long Short Term Memory,LSTM)模块,用于从状态数据中挖掘更多的隐藏信息,丰富Q值表中的状态数据。最后,基于微观交通仿真软件SUMO(Simulation of Urban Mobility)的仿真测试结果表明,相较于原始Nash Q Learning交通信号控制方法,所提方法在低、中、高流量下车辆的平均等待时间分别减少了11.5%、16.2%和10.0%,平均排队长度分别减少了9.1%、8.2%和7.6%,平均停车次数分别减少了18.3%、16.1%和10.0%。结果证明了该算法具有更好的控制效果。
文摘In Japan, common wheat is cultivated in upland fields converted from paddy fields, where poor drainage and high precipitation cause delay of sowing, lodging at the jointing stage, difficulty in topdressing at the ripening stage, and low yield. No-till cultivation has been promoted to overcome these problems but the yield is still low due to the lack of proper fertilizer application protocols. In this study, we determined whether an additional application of two kinds of Sigmoid coated urea as controlled availability fertilizers (CAFs) to the standard fertilization protocol for tillage cultivation can increase the yield and lodging resistance in no-till cultivated common wheat. Also, additional fertilization was applied to the seeding furrow simultaneously with seeding using a V-furrow no-till direct sowing (VFDS) machine. No-till cultivated plants had more tillers than tillage cultivated ones and consequently higher number of panicles and yield, caused by increased fertilizer application. The point-injected CAFs to the seeding furrow, which eluted at the jointing and ripening stages greatly increased the grain yield and protein content, respectively, compared to broadcast topdressing of ammonium sulfate at each stage. The simultaneous sowing and fertilization of additional CAFs using VFDS method in multi-year tests in farmers’ fields significantly increased the yield of no-till cultivated common wheat, and can be adopted by Japanese local farmers.
基金Supported by the National Ministries and Research Funds(3020020221111)
文摘A gait control method for a biped robot based on the deep Q-network (DQN) algorithm is proposed to enhance the stability of walking on uneven ground. This control strategy is an intelligent learning method of posture adjustment. A robot is taken as an agent and trained to walk steadily on an uneven surface with obstacles, using a simple reward function based on forward progress. The reward-punishment (RP) mechanism of the DQN algorithm is established after obtaining the offline gait which was generated in advance foot trajectory planning. Instead of implementing a complex dynamic model, the proposed method enables the biped robot to learn to adjust its posture on the uneven ground and ensures walking stability. The performance and effectiveness of the proposed algorithm was validated in the V-REP simulation environment. The results demonstrate that the biped robot's lateral tile angle is less than 3° after implementing the proposed method and the walking stability is obviously improved.