基于softmax的加权Double Q-Learning算法

强化学习作为机器学习的一个分支,用于描述和解决智能体在与环境的交互过程中,通过学习策略以达成回报最大化的问题。Q-Learning作为无模型强化学习的经典方法,存在过估计引起的最大化偏差问题,并且在环境中奖励存在噪声时表现不佳。Double Q-Learning(DQL)的出现解决了过估计问题,但同时造成了低估问题。为解决以上算法的高低估问题,提出了基于softmax的加权Q-Learning算法,并将其与DQL相结合,提出了一种新的基于softmax的加权Double Q-Learning算法(WDQL-Softmax)。该算法基于加权双估计器的构造,对样本期望值进行softmax操作得到权重,使用权重估计动作价值,有效平衡对动作价值的高估和低估问题,使估计值更加接近理论值。实验结果表明,在离散动作空间中,相比于Q-Learning算法、DQL算法和WDQL算法,WDQL-Softmax算法的收敛速度更快且估计值与理论值的误差更小。

基于Dueling Double DQN的交通信号控制方法

为了提高交叉口通行效率缓解交通拥堵,深入挖掘交通状态信息中所包含的深层次隐含特征信息,提出了一种基于Dueling Double DQN(D3QN)的单交叉口交通信号控制方法;构建了一个基于深度强化学习Double DQN(DDQN)的交通信号控制模型,对动作-价值函数的估计值和目标值迭代运算过程进行了优化,克服基于深度强化学习DQN的交通信号控制模型存在收敛速度慢的问题;设计了一个新的Dueling Network解耦交通状态和相位动作的价值,增强Double DQN(DDQN)提取深层次特征信息的能力;基于微观仿真平台SUMO搭建了一个单交叉口模拟仿真框架和环境,开展仿真测试;仿真测试结果表明,与传统交通信号控制方法和基于深度强化学习DQN的交通信号控制方法相比,所提方法能够有效减少车辆平均等待时间、车辆平均排队长度和车辆平均停车次数,明显提升交叉口通行效率。

Influence of variable viscosity and double diffusion on the convective stability of a nanofluid flow in an inclined porous channel

The influence of variable viscosity and double diffusion on the convective stability of a nanofluid flow in an inclined porous channel is investigated.The DarcyBrinkman model is used to characterize the fluid flow dynamics in porous materials.The analytical solutions are obtained for the unidirectional and completely developed flow.Based on a normal mode analysis,the generalized eigenvalue problem under a perturbed state is solved.The eigenvalue problem is then solved by the spectral method.Finally,the critical Rayleigh number with the corresponding wavenumber is evaluated at the assigned values of the other flow-governing parameters.The results show that increasing the Darcy number,the Lewis number,the Dufour parameter,or the Soret parameter increases the stability of the system,whereas increasing the inclination angle of the channel destabilizes the flow.Besides,the flow is the most unstable when the channel is vertically oriented.

Double contrast-enhanced ultrasonography improves diagnostic accuracy of T staging compared with multi-detector computed tomography in gastric cancer patients

BACKGROUND Gastric cancer(GC)is the most common malignant tumor and ranks third for cancer-related deaths among the worldwide.The disease poses a serious public health problem in China,ranking fifth for incidence and third for mortality.Knowledge of the invasive depth of the tumor is vital to treatment decisions.AIM To evaluate the diagnostic performance of double contrast-enhanced ultrasonography(DCEUS)for preoperative T staging in patients with GC by comparing with multi-detector computed tomography(MDCT).METHODS This single prospective study enrolled patients with GC confirmed by preoperative gastroscopy from July 2021 to March 2023.Patients underwent DCEUS,including ultrasonography(US)and intravenous contrast-enhanced ultrasonography(CEUS),and MDCT examinations for the assessment of preoperative T staging.Features of GC were identified on DCEUS and criteria developed to evaluate T staging according to the 8th edition of AJCC cancer staging manual.The diagnostic performance of DCEUS was evaluated by comparing it with that of MDCT and surgical-pathological findings were considered as the gold standard.RESULTS A total of 229 patients with GC(80 T1,33 T2,59 T3 and 57 T4)were included.Overall accuracies were 86.9%for DCEUS and 61.1%for MDCT(P<0.001).DCEUS was superior to MDCT for T1(92.5%vs 70.0%,P<0.001),T2(72.7%vs 51.5%,P=0.041),T3(86.4%vs 45.8%,P<0.001)and T4(87.7%vs 70.2%,P=0.022)staging of GC.CONCLUSION DCEUS improved the diagnostic accuracy of preoperative T staging in patients with GC compared with MDCT,and constitutes a promising imaging modality for preoperative evaluation of GC to aid individualized treatment decision-making.

Urban Development Boundary Simulation Based on“Double Evaluation”and FLUS Model

The delimitation of urban development boundaries plays an important role in optimizing the nation land space.“Double evaluation”is one of the important means to study and predict the scale of new construction land in the future and to determine the spatial distribution of urban construction land.This study combines the“double evaluation”with the FLUS(Future Land-Use Simulation)model to study the delimitation of the urban development boundary of Yichang.The results show that:(1)the“double evaluation”method comprehensively considers the carrying capacity of the resource environmental bear and the suitability of urban development;(2)the FLUS model can better couple the“double evaluation”method for Land Use/Land Cover(LULC)suitability evaluation,Land Use/land Cover Change(LUCC)simulation and urban development boundary delineation,and the overall accuracy of the simulation reaches 96%;(3)according to the requirements of relevant national policies,this study divides the urban development boundary of the study area into concentrated construction areas,elastic development areas and special purpose areas.This function-based division can meet the requirements of urban flexible development,ecological protection and urban safety.This research combines the FLUS model,which is widely used in the simulation of LUCC,with the double evaluation method used in China’s new round of land and space planning to obtain the result of the urban development boundary.This result is consistent with the existing plan of the study area.

Enhancing the stability of Ni Fe-layered double hydroxide nanosheet array for alkaline seawater oxidation by Ce doping

Electrocatalytic hydrogen production from seawater holds enormous promise for clean energy generation.Nevertheless,the direct electrolysis of seawater encounters significant challenges due to poor anodic stability caused by detrimental chlorine chemistry.Herein,we present our recent discovery that the incorporation of Ce into Ni Fe layered double hydroxide nanosheet array on Ni foam(Ce-Ni Fe LDH/NF)emerges as a robust electrocatalyst for seawater oxidation.During the seawater oxidation process,CeO_(2)is generated,effectively repelling Cl^(-)and inhibiting the formation of Cl O-,resulting in a notable enhancement in the oxidation activity and stability of alkaline seawater.The prepared Ce-Ni Fe LDH/NF requires only overpotential of 390 m V to achieve the current density of 1 A cm^(-2),while maintaining long-term stability for 500 h,outperforming the performance of Ni Fe LDH/NF(430 m V,150 h)by a significant margin.This study highlights the effectiveness of a Ce-doping strategy in augmenting the activity and stability of materials based on Ni Fe LDH in seawater electrolysis for oxygen evolution.

Evaluation of Harvest Aid Chemicals for the Cotton-Winter Wheat Double Cropping System

Timing of harvest is critical for mechanical picking in cotton production, especially in those regions with double cropping system. Appropriate and safe harvest aids will improve timing and facilitate harvest of cotton in the double cropping system. Three defoliants （dimethipin, thidiazuron, and thidiazuron-diuron） and one boll opener （ethephon） were included in this research. They were evaluated for their effects on defoliation, boll opening, seedcotton yield, seed quality, and fiber quality of field grown cotton when used alone or as a mixture in 2009 and 2010. Defoliation and/or boll opening were increased by all three defoliants and ethephon, especially by mixtures of a defoliant and ethephon. First harvest of seedcotton was significantly increased with defoliant-ethephon mixtures. No significant adverse effects were observed on boll weight, lint percentage, seed quality, and fiber properties. It was estimated that tank mixes of ethephon and one of the three defoliants can improve the adjusted gross revenue. Boll opening can be used as an alternative indicator for the adjusted gross revenue, because, it was linearly and positively correlated with the relative adjusted gross revenue and convenient in measurements. Wheat seedling growth was not affected by thidiazuron, whereas its seedling emergence, root dry weight, relative water content, and electrolyte leakage were adversely affected by dimethipin and thidiazuron- diuron when concentration was above 340 and 100 g （a.i.） ha-1, respectively. 90% defoliation and 80% boll opening were observed with the high rate of thidiazuron-ethephon mixture, but no adverse effects on winter wheat. The results suggested that tank mixes of ethephon with thidiazuron can be used effectively and safely in the cotton-winter wheat double cropping system to improve yield without adverse effects on seed quality and fiber quality.

Development and Preliminary Evaluation of a Double-cell Ozonesonde

Ozonesondes are widely used to obtain ozone concentration profiles from the surface to the upper atmosphere.A kind of double-cell ozonesonde has been developed at the Institute of Atmospheric Physics （IAP）,Chinese Academy of Sciences （named the ＂IAP ozonesonde＂） based on previous experience over the past 20 years of developing the singlecell GPSO3 ozonesonde.The IAP ozonesonde is of the Electrochemical Concentration Cell （ECC） type.A detailed description of the IAP ozonesonde is firstly provided in the present paper,followed by a presentation of results from a series of launches carried out to evaluate its performance.The analysis involved comparing its observations with measurements from the GPSO3 and ECC ozonesondes （Model type ENSCI-Z） as well as a Brewer spectrophotometer.The results showed that the IAP ozonesonde is a vast improvement over the GPSO3 ozonesonde,able to capture vertical ozone structures very well and in good agreement with ECC ozonesonde measurements.The average difference in the ozone partial pressure between the IAP and ECC ozonesondes was 0.3 mPa from the surface to 2.5 km,close to zero from 2.5 to 9 km and generally less than 1 mPa for layers higher than 9 km.The apparent deviation is likely caused by a decreasing pump flow rate in the IAP ozonesonde which needs further improvement.The total ozone amounts measured by the IAP ozonesonde profiles were highly comparable with the Brewer data with a relative difference of 6％.The development of the IAP ozonesonde and its strong performance will surely accelerate the process of conventional observations of ozone profiles over China in the near future as well as provide more data for ozone research in general.

Differential Expression of Whitebacked Planthopper Resistance in the japonica/indica Doubled Haploid Rice Population under Field Evaluation and Seedbox Screening Test

Whitebacked planthopper (WBPH) -resistance in a japonica / indica doubled haploid (DH) rice population established from a cross between WBPH-resistant japonica Chun]iang 06 and susceptible indica TN1, was comparatively evaluated through a field experiment based on the WBPH immigrant density and standardized seedbox screening test (SSST). All the susceptible DH lines in the field experiment behaved accordingly in SSST. However, 35 of resistant 66 lines (53%) in the field, were categorized to susceptible groups in SSST. Likewise, there were no significant differences in WBPH immigrant densities among 70 DH lines that were highly resistant to susceptible in SSST. The results revealed that SSST could not evaluate properly WBPH resistance in the DH lines. Four QTLs for WBPH-resistance phenotyped by the immigrant density were detected on chromosomes 2, 3, 4, and 11. Of them, the QTL on chromosome 4 was the most effective (LOD 21.8, variance 78%). Five QTLs associated with seedling mortality were mapped on chromosomes 2, 3, 4, 5 and 6. In addition to the QTL (LOD 10.5, variance 68%) on chromosome 4, there was another major QTL (LOD 12.7, variance 71%) located on chromosome 5, which was SSST-specific but might be irrespective of the WBPH resistance traits.

Evaluation matrix with the speed feature based on double inspiriting control lines

Methods of the comprehensive evaluation have been studied for many years. However, the change speed of evaluated objects was rarely considered by the existing evaluation methods. An evaluation matrix is proposed to remedy this deficiency. Firstly, the change speed state （CSS） of the evaluated objects is analyzed based on double inspiriting control lines （DICLs）, and a matrix of the CSS is constructed. Then, 72 elements in the matrix are analyzed, and formulas describing each CSS are given. The efficiency of the proposed evaluation matrix is proved when the CSS merges with the change speed trend （CST） in the dynamic comprehensive evaluation. Finally, a computing example shows that the proposed evaluation matrix is feasible in the dynamic comprehensive evaluation with the speed feature.

Hybrid Micro-forming Processes and Quality Evaluation of Micro-double Gear

Micro-gear is an important actuating component used widely in the micro electro mechanical systems(MEMS) devices.The technologies of micro-forming and precision assembly are urgently developed to manufacture the micro-double gear with central shaft.In the paper,a novel hy-brid-forming process with two kinds of piercing method have been proposed to manufacture the micro-double gear using micro forming technology.The tests of hybrid forming process were carried out with two steps and the micro-double gear was successfully manufactured with good surface quality.The results also show that the hybrid micro-forming process with central piercing method can improve the defects of inclining shaft generated by double-ended piercing method.The quality evaluation of micro-double gear was conducted with surface roughness,micro-hardness and impact tests.The results show that the micro-double gear with good mechanical properties can meet the requirements of application for milli-machines.

Correction to:Theoretical analysis of the double-differential cross-sections of neutron,proton,deuteron,^(3)He,and α for the p+^(6)Li reaction

Correction to:Nuclear Science and Techniques(2024)35:61 https://doi.org/10.1007/s41365-024-01421-5 In this article,the figures were wrongly numbered.The Fig.7 and 8 should have been Fig.11 and 12.The Fig.9,10,11,and 12 should have been 7,8,9 and 10.The original article has been corrected.

Diagnosis of indirectly driven double shell targets with point-projection hard x-ray radiography

We present an application of short-pulse laser-generated hard x rays for the diagnosis of indirectly driven double shell targets. Coneinserted double shell targets were imploded through an indirect drive approach on the upgraded SG-II laser facility. Then, based on thepoint-projection hard x-ray radiography technique, time-resolved radiography of the double shell targets, including that of their near-peakcompression, were obtained. The backlighter source was created by the interactions of a high-intensity short pulsed laser with a metalmicrowire target. Images of the target near peak compression were obtained with an Au microwire. In addition, radiation hydrodynamicsimulations were performed, and the target evolution obtained agrees well with the experimental results. Using the radiographic images, arealdensities of the targets were evaluated.

Defective Nickel-Iron Layered Double Hydroxide for Enhanced Photocatalytic NO Oxidation with Significant Alleviation of NO2 Production

Photocatalysis offers a sustainable means for the oxidative removal of low concentrations of NOx(NO,NO2,N2O,N2O5,etc.)from the atmosphere.Layered double hydroxides(LDHs)are promising candidate photocatalysts owing to their unique layered and tunable chemical structures and abundant surface hydroxide(OH)moieties,which are hydroxyl radical(OH)precursors.However,the practical applications of LDHs are limited by their poor charge-separation ability and insufficient active sites.Herein,we developed a facile N_(2)H_(4)-driven etching approach to introduce dual Ni^(2+)and OHvacancies(Niv and OHv,respectively)into NiFe-LDH nanosheets(hereafter referred to as NiFe-LDH-et)to facilitate improved charge-carrier separation and active Lewis acidic site(Fe^(3+)and Ni^(2+)exposed at OHv)formation.In contrast to inert pristine LDH,NiFe-LDH-et actively removed NO under visible-light illumination.Specifically,Ni_(76)Fe_(24)-LDH-et etched with 1.50 mmol·L^(-1)N_(2)H_(4)solution removed 32.8%of the NO in continuously flowing air(NO feed concentration:500 parts per billion(ppb))under visible-light illumination,thereby outperforming most reported catalysts.Experimental and theoretical data revealed that the dual vacancies promoted the production of reactive oxygen species(O_(2)·^(-)andOH)and the adsorption of NO on the LDH.In situ spectroscopy demonstrated that NO was preferentially adsorbed at Lewis acidic sites,particularly exposed Fe^(3+)sites,converted into NO+,and subsequently oxidized to NO3without the notable formation of the more toxic intermediate NO2,thereby alleviating risks associated with its production and emission.

Young's double slit interference with vortex source

The fast and convenient demultiplex of optical vortex(OV) mode is crucial for its further application. We propose a novel approach that combines classic Young's doublet with an OV source to effectively identify the OV mode through the analysis of interference patterns. The interference patterns of the OV source incident on the double slits can be perfectly illustrated by using both the classical double-slit interference method and the Huygens–Fresnel principle. The interference fringes will twist along the negative or positive direction of x axis when topological charge(TC)l>0 or l<0, and the degree of the movement varies with the TC, allowing for a quantitative display of the OV characteristics through the interference patterns. Additionally, we deduce analytically that the zeroth-order interference fringe has a linear relationship with the TC and the vertical position. These findings highlight the ability to identify the OV mode by analyzing the interference patterns produced by Young's doublet.

Research on static characteristic of double redundance double nozzle flapper valve based on AMESim

The feedback spring rod of the armature assembly is cancelled in the double redundance double nozzle flapper valve(DRDNFV),and the difficulty of valve core displacement control is increased.Therefore,this paper intends to study the static characteristic of DRDNFV through the AMESet and AMESim simulation.It is explored under the circumstance of the fixed orifices being clogged and experimentally verified on the test bench.The results show that the pressure gain increases and the flow gain decreases with the increasing clogged degree of the fixed orifices on both sides.The zero bias increases synchronously with the increasing clogged degree of the unilateral fixed orifice.The experimental results are basically consistent with the theoretical curves and the theoretical correctness of the simulation model is effectively verified.The results can provide the theoretical reference for design,debugging,maintenance and fault diagnosis of DRDNFV.

Double quantum images encryption scheme based on chaotic system

This paper explores a double quantum images representation(DNEQR)model that allows for simultaneous storage of two digital images in a quantum superposition state.Additionally,a new type of two-dimensional hyperchaotic system based on sine and logistic maps is investigated,offering a wider parameter space and better chaotic behavior compared to the sine and logistic maps.Based on the DNEQR model and the hyperchaotic system,a double quantum images encryption algorithm is proposed.Firstly,two classical plaintext images are transformed into quantum states using the DNEQR model.Then,the proposed hyperchaotic system is employed to iteratively generate pseudo-random sequences.These chaotic sequences are utilized to perform pixel value and position operations on the quantum image,resulting in changes to both pixel values and positions.Finally,the ciphertext image can be obtained by qubit-level diffusion using two XOR operations between the position-permutated image and the pseudo-random sequences.The corresponding quantum circuits are also given.Experimental results demonstrate that the proposed scheme ensures the security of the images during transmission,improves the encryption efficiency,and enhances anti-interference and anti-attack capabilities.

Compression Properties and Energy Absorption of A Novel Double Curved Beam Negative Stiffness Honeycomb Structures

This paper presents the design of a novel honeycomb structure with a double curved beam.The purpose of this design is to achieve vibration isolation for the main engine of an offshore platform and reduce impact loads.An analytical formula for the force-displacement relationship of the honeycomb single-cell structure is presented based on the modal superposition method.This formula provides a theoretical basis for predicting the compression performance of honeycomb structures.The effects of structural geometric parameters,series and parallel connection methods on the mechanical and energy absorption properties are investigated through mathematical modeling and experimental methods.Furthermore,the study focuses on the vibration isolation and impact resistance performance of honeycomb panels.The results show that the designed honeycomb structure has good mechanical and energy absorption performance,and its energy absorption effect is related to the geometric parameters and series and parallel connection methods of the structure.The isolation efficiency of the honeycomb with 4 rows and 3 columns reaches 38%.The initial isolation frequency of the isolator is 11.7 Hz.

基于Double DQN的双模式多目标信号配时方法

近年来深度强化学习作为一种高效可靠的机器学习方法被广泛应用在交通信号控制领域。目前,现有交通信号配时方法通常忽略了特殊车辆(例如救护车、消防车等)的优先通行;此外,基于传统深度强化学习的信号配时方法优化目标较为单一,导致其在复杂交通场景中性能不佳。针对上述问题,基于Double DQN提出一种融合特殊车辆优先通行的双模式多目标信号配时方法(Dual-mode Multi-objective signal timing method based on Double DQN,DMDD),以提高不同交通场景下路口的通行效率。该方法首先基于路口的饱和状态选择信号控制模式,特殊车辆在紧急控制模式下被赋予更高的通行权重,有利于其更快通过路口;接着针对等待时长、队列长度和CO 2排放量3个指标分别设计神经网络进行奖励计算;最后利用Double DQN进行最优信号相位的选择,通过灵活切换信号相位以提升通行效率。基于SUMO的实验结果表明,DMDD与对比方法相比能有效缩短路口处特殊车辆的等待时长、队列长度和CO 2排放量,特殊车辆能够更快通过路口,有效地提高了通行效率。

On power series statistical convergence and new uniform integrability of double sequences

In the present paper,we mostly focus on P_(p)^(2)-statistical convergence.We will look into the uniform integrability via the power series method and its characterizations for double sequences.Also,the notions of P_(p)^(2)-statistically Cauchy sequence,P_(p)^(2)-statistical boundedness and core for double sequences will be described in addition to these findings.