基于softmax的加权Double Q-Learning算法

强化学习作为机器学习的一个分支,用于描述和解决智能体在与环境的交互过程中,通过学习策略以达成回报最大化的问题。Q-Learning作为无模型强化学习的经典方法,存在过估计引起的最大化偏差问题,并且在环境中奖励存在噪声时表现不佳。Double Q-Learning(DQL)的出现解决了过估计问题,但同时造成了低估问题。为解决以上算法的高低估问题,提出了基于softmax的加权Q-Learning算法,并将其与DQL相结合,提出了一种新的基于softmax的加权Double Q-Learning算法(WDQL-Softmax)。该算法基于加权双估计器的构造,对样本期望值进行softmax操作得到权重,使用权重估计动作价值,有效平衡对动作价值的高估和低估问题,使估计值更加接近理论值。实验结果表明,在离散动作空间中,相比于Q-Learning算法、DQL算法和WDQL算法,WDQL-Softmax算法的收敛速度更快且估计值与理论值的误差更小。

Diagnosis of indirectly driven double shell targets with point-projection hard x-ray radiography

We present an application of short-pulse laser-generated hard x rays for the diagnosis of indirectly driven double shell targets. Coneinserted double shell targets were imploded through an indirect drive approach on the upgraded SG-II laser facility. Then, based on thepoint-projection hard x-ray radiography technique, time-resolved radiography of the double shell targets, including that of their near-peakcompression, were obtained. The backlighter source was created by the interactions of a high-intensity short pulsed laser with a metalmicrowire target. Images of the target near peak compression were obtained with an Au microwire. In addition, radiation hydrodynamicsimulations were performed, and the target evolution obtained agrees well with the experimental results. Using the radiographic images, arealdensities of the targets were evaluated.

Young's double slit interference with vortex source

The fast and convenient demultiplex of optical vortex(OV) mode is crucial for its further application. We propose a novel approach that combines classic Young's doublet with an OV source to effectively identify the OV mode through the analysis of interference patterns. The interference patterns of the OV source incident on the double slits can be perfectly illustrated by using both the classical double-slit interference method and the Huygens–Fresnel principle. The interference fringes will twist along the negative or positive direction of x axis when topological charge(TC)l>0 or l<0, and the degree of the movement varies with the TC, allowing for a quantitative display of the OV characteristics through the interference patterns. Additionally, we deduce analytically that the zeroth-order interference fringe has a linear relationship with the TC and the vertical position. These findings highlight the ability to identify the OV mode by analyzing the interference patterns produced by Young's doublet.

Research on static characteristic of double redundance double nozzle flapper valve based on AMESim

The feedback spring rod of the armature assembly is cancelled in the double redundance double nozzle flapper valve(DRDNFV),and the difficulty of valve core displacement control is increased.Therefore,this paper intends to study the static characteristic of DRDNFV through the AMESet and AMESim simulation.It is explored under the circumstance of the fixed orifices being clogged and experimentally verified on the test bench.The results show that the pressure gain increases and the flow gain decreases with the increasing clogged degree of the fixed orifices on both sides.The zero bias increases synchronously with the increasing clogged degree of the unilateral fixed orifice.The experimental results are basically consistent with the theoretical curves and the theoretical correctness of the simulation model is effectively verified.The results can provide the theoretical reference for design,debugging,maintenance and fault diagnosis of DRDNFV.

Double quantum images encryption scheme based on chaotic system

This paper explores a double quantum images representation(DNEQR)model that allows for simultaneous storage of two digital images in a quantum superposition state.Additionally,a new type of two-dimensional hyperchaotic system based on sine and logistic maps is investigated,offering a wider parameter space and better chaotic behavior compared to the sine and logistic maps.Based on the DNEQR model and the hyperchaotic system,a double quantum images encryption algorithm is proposed.Firstly,two classical plaintext images are transformed into quantum states using the DNEQR model.Then,the proposed hyperchaotic system is employed to iteratively generate pseudo-random sequences.These chaotic sequences are utilized to perform pixel value and position operations on the quantum image,resulting in changes to both pixel values and positions.Finally,the ciphertext image can be obtained by qubit-level diffusion using two XOR operations between the position-permutated image and the pseudo-random sequences.The corresponding quantum circuits are also given.Experimental results demonstrate that the proposed scheme ensures the security of the images during transmission,improves the encryption efficiency,and enhances anti-interference and anti-attack capabilities.

Influence of variable viscosity and double diffusion on the convective stability of a nanofluid flow in an inclined porous channel

The influence of variable viscosity and double diffusion on the convective stability of a nanofluid flow in an inclined porous channel is investigated.The DarcyBrinkman model is used to characterize the fluid flow dynamics in porous materials.The analytical solutions are obtained for the unidirectional and completely developed flow.Based on a normal mode analysis,the generalized eigenvalue problem under a perturbed state is solved.The eigenvalue problem is then solved by the spectral method.Finally,the critical Rayleigh number with the corresponding wavenumber is evaluated at the assigned values of the other flow-governing parameters.The results show that increasing the Darcy number,the Lewis number,the Dufour parameter,or the Soret parameter increases the stability of the system,whereas increasing the inclination angle of the channel destabilizes the flow.Besides,the flow is the most unstable when the channel is vertically oriented.

Internal collision double ionization of molecules driven by co-rotating two-color circularly polarized laser pulses

The double ionization process of molecules driven by co-rotating two-color circularly polarized fields is investigated with a three-dimensional classical ensemble model. Numerical results indicate that a considerable part of the sequential double ionization(DI) events of molecules occur through internal collision double ionization(ICD), and the ICD recollision mechanism is significantly different from that in non-sequential double ionization(NSDI). By analyzing the results of internuclear distances R = 5 a.u. and 2 a.u., these two recollision mechanisms are studied in depth. It is found that the dynamic behaviors of the recollision mechanisms of NSDI and ICD are similar. For NSDI, the motion range of electrons after the ionization is relatively large, and the electrons will return to the core after a period of time. In the ICD process,electrons will rotate around the parent ion before ionization, and the distance of the electron motion is relatively small. After a period of time, the electrons will come back to the core and collide with another electron. Furthermore, the molecular internuclear distance has a significant effect on the electron dynamic behavior of the two ionization mechanisms. This study will help to understand the multi-electron ionization process of complex systems.

Transcriptome and morphological analyses of double flower formation in Dianthus chinensis

The double flower developmental process is regulated via a complex transcriptional regulatory network.To understand this highly dynamic and complex developmental process of Dianthus spp.,we performed a comparative analysis of floral morphology and transcriptome dynamics in simple flowers and double flowers.We found that the primordium of double flowers of‘X’was larger in size compared to that of simple flowers of‘L’in Dianthus chinensis.RNA-seq and Weighted Gene Co-expression Network Analysis(WGCNA)during flower development,identified stage-specific gene network modules.Expression analysis by RNA-seq indicated that a group of genes related to floral meristem identity,primordia position and polarity were highly expressed in double flowers genotypes compared to simple flowers genotypes,suggesting their roles in double-petal formation.A total of 21 DEGs related to petal number were identified between simple and double flowers.The experiments of in situ hybridization revealed that DcaAP2L,DcaLFY and DcaUFO genes were expressed in the intra-sepal boundary and petal boundary.We proposed a potential transcriptional regulatory network for simple and double flower development.This study provides novel insights into the molecular mechanism underlying double flower formation in Dianthus spp.

Fluorescent Double Network Hydrogels with Ionic Responsiveness and High Mechanical Properties for Visual Detection

We developed a fluorescent double network hydrogel with ionic responsiveness and high mechanical properties for visual detection.The nanocomposite hydrogel of laponite and polyacrylamide serves as the first network,while the ionic cross-linked hydrogel of terbium ions and sodium alginate serves as the second network.The double-network structure,the introduction of nanoparticles and the reversible ionic crosslinked interactions confer high mechanical properties to the hydrogel.Terbium ions are not only used as the ionic cross-linked points,but also used as green emitters to endow hydrogels with fluorescent properties.On the basis of the “antenna effect” of terbium ions and the ion exchange interaction,the fluorescence of the hydrogels can make selective responses to various ions(such as organic acid radical ions,transition metal ions) in aqueous solutions,which enables a convenient strategy for visual detection toward ions.Consequently,the fluorescent double network hydrogel fabricated in this study is promising for use in the field of visual sensor detection.

Effect of Single- versus Double-Layer Uterine Closure during Caesarean Section on Niche Formation and Menstrual Irregularity

Background: The myometrium at the location of the CS (caesarean section) scars, also known as residual myometrium thickness (RMT), is larger after a double-layer uterine closure procedure than following a single-layer one. It may lessen the formation of a niche that is the myometrium’s disruption at the location of the scar of the uterus. Gynecological manifestations, obstetric problems in a future pregnancy and birth, and maybe subfertility are linked to thin RMT and a niche. Objective: To ascertain if double-layer unlocked closure of the uterus is better than single-layer one in terms of post-menstrual spotting and niche development following a first CS. Patients and Methods: In this randomized clinical study, 287 patients were evaluated for qualifying. Of all eligible individuals, 57 patients were excluded from the study based on the inclusion criteria. Results: The variation in ages, gestational age, body mass index (BMI), and cesarean section indications between the two assigned groups is statistically insignificant. However, postmenstrual spotting was statistically significantly more common in single-layer group compared to in double-group. The current study revealed ultrasound findings suggestive of niche formation was statistically significantly more common in single-layer group compared to in double-layer group. Conclusion: As evident from the current study, it demonstrates the advantages of double-layer unlocked closure of the uterus over single-layer one in terms of post-menstrual spotting and niche development following first-time cs. Thus, we deduced that fewer niches are formed, and fewer menstrual spotting occurs in the presence of double unlocked layers closure. To ascertain the impact of uterus closure method on post-operative niche development and the risk of obstetrics and gynaecological problems, further prospective trials with extended follow-up periods are required.

Transformer-Aided Deep Double Dueling Spatial-Temporal Q-Network for Spatial Crowdsourcing Analysis

With the rapid development ofmobile Internet,spatial crowdsourcing has becomemore andmore popular.Spatial crowdsourcing consists of many different types of applications,such as spatial crowd-sensing services.In terms of spatial crowd-sensing,it collects and analyzes traffic sensing data from clients like vehicles and traffic lights to construct intelligent traffic prediction models.Besides collecting sensing data,spatial crowdsourcing also includes spatial delivery services like DiDi and Uber.Appropriate task assignment and worker selection dominate the service quality for spatial crowdsourcing applications.Previous research conducted task assignments via traditional matching approaches or using simple network models.However,advanced mining methods are lacking to explore the relationship between workers,task publishers,and the spatio-temporal attributes in tasks.Therefore,in this paper,we propose a Deep Double Dueling Spatial-temporal Q Network(D3SQN)to adaptively learn the spatialtemporal relationship between task,task publishers,and workers in a dynamic environment to achieve optimal allocation.Specifically,D3SQNis revised through reinforcement learning by adding a spatial-temporal transformer that can estimate the expected state values and action advantages so as to improve the accuracy of task assignments.Extensive experiments are conducted over real data collected fromDiDi and ELM,and the simulation results verify the effectiveness of our proposed models.

Double contrast-enhanced ultrasonography improves diagnostic accuracy of T staging compared with multi-detector computed tomography in gastric cancer patients

BACKGROUND Gastric cancer(GC)is the most common malignant tumor and ranks third for cancer-related deaths among the worldwide.The disease poses a serious public health problem in China,ranking fifth for incidence and third for mortality.Knowledge of the invasive depth of the tumor is vital to treatment decisions.AIM To evaluate the diagnostic performance of double contrast-enhanced ultrasonography(DCEUS)for preoperative T staging in patients with GC by comparing with multi-detector computed tomography(MDCT).METHODS This single prospective study enrolled patients with GC confirmed by preoperative gastroscopy from July 2021 to March 2023.Patients underwent DCEUS,including ultrasonography(US)and intravenous contrast-enhanced ultrasonography(CEUS),and MDCT examinations for the assessment of preoperative T staging.Features of GC were identified on DCEUS and criteria developed to evaluate T staging according to the 8th edition of AJCC cancer staging manual.The diagnostic performance of DCEUS was evaluated by comparing it with that of MDCT and surgical-pathological findings were considered as the gold standard.RESULTS A total of 229 patients with GC(80 T1,33 T2,59 T3 and 57 T4)were included.Overall accuracies were 86.9%for DCEUS and 61.1%for MDCT(P<0.001).DCEUS was superior to MDCT for T1(92.5%vs 70.0%,P<0.001),T2(72.7%vs 51.5%,P=0.041),T3(86.4%vs 45.8%,P<0.001)and T4(87.7%vs 70.2%,P=0.022)staging of GC.CONCLUSION DCEUS improved the diagnostic accuracy of preoperative T staging in patients with GC compared with MDCT,and constitutes a promising imaging modality for preoperative evaluation of GC to aid individualized treatment decision-making.

Double casing warhead with sandwiched charge:The axial distribution of fragments velocities

The double casing warhead with sandwiched charge is a novel fragmentation warhead that can produce two groups of fragments with different velocity,and the previous work has presented a calculation formula to determine the maximum fragment velocity.The current work builds on the published formula to further develop a formula for calculating the axial distribution characteristics of the fragment velocity.For this type of warhead,the simulation of the dispersion characteristics of the detonation products at different positions shows that the detonation products at the ends have a much larger axial velocity than those in the middle,and the detonation products have a greater axial dispersion velocity when they are closer to the central axis.The loading process and the fragment velocity vary with the axial position for both casing layers,and the total velocity of the fragments is the vector sum of the radial velocity and the axial velocity.At the same axial position,the acceleration time of the inner casing is greater than that of the outer casing.For the same casing,the fragments generated at the ends have a longer acceleration time than the fragments from the middle.The proposed formula is validated with the X-ray radiography results of the four warheads previously tested experimentally and the 3D smoothedparticle hydrodynamics numerical simulation results of several series of new warheads with different configurations.The formula can accurately and reliably calculate the fragment velocity when the lengthto-diameter ratio of the charge is greater than 1.5 and the thickness of the casing is less than 20%its inner radius.This work thus provides a key reference for the theoretical analysis and the design of warheads with multiple casings.

Manipulating the electron dynamics in the non-sequential double ionization process of Ar atoms by an orthogonal two-color laser field

Electron dynamics during non-sequential double ionization(NSDI) is one of the most attractive areas of research in the field of laser–atom or laser–molecule interaction. Based on the classic two-dimensional model, we study the process of NSDI of argon atoms driven by a few-cycle orthogonal two-color laser field composed of 800 nm and 400 nm laser pulses. By changing the relative phase of the two laser pulses, a localized enhancement of NSDI yield is observed at 0.5πand 1.5π, which could be attributed to a rapid and substantial increase in the number of electrons returning to the parent ion within extremely short time intervals at these specific phases. Through the analysis of the electron–electron momentum correlations within different time windows of NSDI events and the angular distributions of emitted electrons in different channels, we observe a more pronounced electron–electron correlation phenomenon in the recollision-induced ionization(RII) channel. This is attributed to the shorter delay time in the RII channel.

A Calculation Method of Double Strength Reduction for Layered Slope Based on the Reduction of Water Content Intensity

The calculation of the factor of safety(FOS)is an important means of slope evaluation.This paper proposed an improved double strength reductionmethod(DRM)to analyze the safety of layered slopes.The physical properties of different soil layers of the slopes are different,so the single coefficient strength reduction method(SRM)is not enough to reflect the actual critical state of the slopes.Considering that the water content of the soil in the natural state is the main factor for the strength of the soil,the attenuation law of shear strength of clayey soil changing with water content is fitted.This paper also establishes the functional relationship between different reduction coefficients.Then,a USDFLD subroutine is programmed using the secondary development function of finite element software.Controlling the relationship between field variables and calculation time realizes double strength reduction applicable to the layered slope.Finally,by comparing the calculation results of different examples,it is proved that the stress and displacement distribution of the critical slope state obtained by the improved method is more realistic,and the calculated safety factor is more reliable.The newly proposedmethod considers the difference of intensity attenuation between different soil layers under natural conditions and avoids the disadvantage of the strength reduction method with uniform parameters,which provides a new idea and method for stability analysis of layered and complex slopes.

Probing the electric double layer structure at nitrogen-doped graphite electrodes by constant-potential molecular dynamics simulations

Electric double layer(EDL)is a critical topic in electrochemistry and largely determines the working performance of lithium batteries.However,atomic insights into the EDL structures on heteroatom-modified graphite anodes and EDL evolution with electrode potential are very lacking.Herein,a constant-potential molecular dynamics(CPMD)method is proposed to probe the EDL structure under working conditions,taking N-doped graphite electrodes and carbonate electrolytes as an example.An interface model was developed,incorporating the electrode potential and atom electronegativities.As a result,an insightful atomic scenario for the EDL structure under varied electrode potentials has been established,which unveils the important role of doping sites in regulating both the EDL structures and the following electrochemical reactions at the atomic level.Specifically,the negatively charged N atoms repel the anions and adsorb Li~+at high and low potentials,respectively.Such preferential adsorption suggests that Ndoped graphite can promote Li~+desolvation and regulate the location of Li~+deposition.This CPMD method not only unveils the mysterious function of N-doping from the viewpoint of EDL at the atomic level but also applies to probe the interfacial structure on other complicated electrodes.

Enhancing the stability of Ni Fe-layered double hydroxide nanosheet array for alkaline seawater oxidation by Ce doping

Electrocatalytic hydrogen production from seawater holds enormous promise for clean energy generation.Nevertheless,the direct electrolysis of seawater encounters significant challenges due to poor anodic stability caused by detrimental chlorine chemistry.Herein,we present our recent discovery that the incorporation of Ce into Ni Fe layered double hydroxide nanosheet array on Ni foam(Ce-Ni Fe LDH/NF)emerges as a robust electrocatalyst for seawater oxidation.During the seawater oxidation process,CeO_(2)is generated,effectively repelling Cl^(-)and inhibiting the formation of Cl O-,resulting in a notable enhancement in the oxidation activity and stability of alkaline seawater.The prepared Ce-Ni Fe LDH/NF requires only overpotential of 390 m V to achieve the current density of 1 A cm^(-2),while maintaining long-term stability for 500 h,outperforming the performance of Ni Fe LDH/NF(430 m V,150 h)by a significant margin.This study highlights the effectiveness of a Ce-doping strategy in augmenting the activity and stability of materials based on Ni Fe LDH in seawater electrolysis for oxygen evolution.

Distribution and Formation Causes of PM_(2.5) and O_(3) Double High Pollution Events in China during 2013–20

Fine particulate matter(PM_(2.5))and ozone(O_(3))double high pollution(DHP)events have occurred frequently over China in recent years,but their causes are not completely clear.In this study,the spatiotemporal distribution of DHP events in China during 2013–20 is analyzed.The synoptic types affecting DHP events are identified with the Lamb–Jenkinson circulation classification method.The meteorological and chemical causes of DHP events controlled by the main synoptic types are further investigated.Results show that DHP events(1655 in total for China during 2013–20)mainly occur over the North China Plain,Yangtze River Delta,Pearl River Delta,Sichuan Basin,and Central China.The occurrence frequency increases by 5.1%during 2013–15,and then decreases by 56.1%during 2015–20.The main circulation types of DHP events are“cyclone”and“anticyclone”,accounting for over 40%of all DHP events over five main polluted regions in China,followed by southerly or easterly flat airflow types,like“southeast”,“southwest”,and“east”.Compared with non-DHP events,DHP events are characterized by static or weak wind,high temperature(20.9℃ versus 23.1℃)and low humidity(70.0%versus 64.9%).The diurnal cycles of meteorological conditions cause PM_(2.5)(0300–1200 LST,Local Standard Time=UTC+8 hours)and O_(3)(1500–2100 LST)to exceed the national standards at different periods of the DHP day.Three pollutant conversion indices further indicate the rapid secondary conversions during DHP events,and thus the concentrations of NO_(2),SO_(2) and volatile organic compounds decrease by 13.1%,4.7%and 4.4%,respectively.The results of this study can be informative for future decisions on the management of DHP events.

Twin fetuses associated with double amniotic sacs diagnosed using transvaginal ultrasonography:A case report

BACKGROUND Conjoined twins are a rare twin malformation commonly presenting as single amniotic sac twinning,with double amniotic sac twinning being extremely rare and poorly reported.Most conjoined twins are females.CASE SUMMARY A woman of childbearing age conceived naturally,and at 8 wk of gestation,transvaginal ultrasonography showed an embryo and cardiac tube pulsation in both amniotic sacs.On dynamic observation,the two embryos were connected in the lower abdomen,with restricted movement.A repeat transvaginal ultrasound at 11 wk showed that the intestinal tubes of both fetuses were connected in the lower abdomen.The pregnancy was terminated and labor was induced.CONCLUSION Transvaginal ultrasound may detect conjoined twin malformations in an early stage.Our case provides diagnostic insights for ultrasonographers and can help develop early therapeutic interventions.

An Evidence-Based CoCoSo Framework with Double Hierarchy Linguistic Data for Viable Selection of Hydrogen Storage Methods

Hydrogen is the new age alternative energy source to combat energy demand and climate change.Storage of hydrogen is vital for a nation’s growth.Works of literature provide different methods for storing the produced hydrogen,and the rational selection of a viable method is crucial for promoting sustainability and green practices.Typically,hydrogen storage is associated with diverse sustainable and circular economy(SCE)criteria.As a result,the authors consider the situation a multi-criteria decision-making(MCDM)problem.Studies infer that previous models for hydrogen storage method(HSM)selection(i)do not consider preferences in the natural language form;(ii)weights of experts are not methodically determined;(iii)hesitation of experts during criteria weight assessment is not effectively explored;and(iv)three-stage solution of a suitable selection of HSM is unexplored.Driven by these gaps,in this paper,authors put forward a new integrated framework,which considers double hierarchy linguistic information for rating,criteria importance through inter-criteria correlation(CRITIC)for expert weight calculation,evidence-based Bayesian method for criteria weight estimation,and combined compromise solution(CoCoSo)for ranking HSMs.The applicability of the developed framework is testified by using a case example of HSM selection in India.Sensitivity and comparative analysis reveal the merits and limitations of the developed framework.