Stochastic Gradient Compression for Federated Learning over Wireless Network

As a mature distributed machine learning paradigm,federated learning enables wireless edge devices to collaboratively train a shared AI-model by stochastic gradient descent(SGD).However,devices need to upload high-dimensional stochastic gradients to edge server in training,which cause severe communication bottleneck.To address this problem,we compress the communication by sparsifying and quantizing the stochastic gradients of edge devices.We first derive a closed form of the communication compression in terms of sparsification and quantization factors.Then,the convergence rate of this communicationcompressed system is analyzed and several insights are obtained.Finally,we formulate and deal with the quantization resource allocation problem for the goal of minimizing the convergence upper bound,under the constraint of multiple-access channel capacity.Simulations show that the proposed scheme outperforms the benchmarks.

Bioinspired Multifunctional Self-Sensing Actuated Gradient Hydrogel for Soft-Hard Robot Remote Interaction

The development of bioinspired gradient hydrogels with self-sensing actuated capabilities for remote interaction with soft-hard robots remains a challenging endeavor. Here, we propose a novel multifunctional self-sensing actuated gradient hydrogel that combines ultrafast actuation and high sensitivity for remote interaction with robotic hand. The gradient network structure, achieved through a wettability difference method involving the rapid precipitation of MoO_(2) nanosheets, introduces hydrophilic disparities between two sides within hydrogel. This distinctive approach bestows the hydrogel with ultrafast thermo-responsive actuation(21° s^(-1)) and enhanced photothermal efficiency(increase by 3.7 ℃ s^(-1) under 808 nm near-infrared). Moreover, the local cross-linking of sodium alginate with Ca^(2+) endows the hydrogel with programmable deformability and information display capabilities. Additionally, the hydrogel exhibits high sensitivity(gauge factor 3.94 within a wide strain range of 600%), fast response times(140 ms) and good cycling stability. Leveraging these exceptional properties, we incorporate the hydrogel into various soft actuators, including soft gripper, artificial iris, and bioinspired jellyfish, as well as wearable electronics capable of precise human motion and physiological signal detection. Furthermore, through the synergistic combination of remarkable actuation and sensitivity, we realize a self-sensing touch bioinspired tongue. Notably, by employing quantitative analysis of actuation-sensing, we realize remote interaction between soft-hard robot via the Internet of Things. The multifunctional self-sensing actuated gradient hydrogel presented in this study provides a new insight for advanced somatosensory materials, self-feedback intelligent soft robots and human–machine interactions.

Climate-growth relationships of Pinus tabuliformis along an altitudinal gradient on Baiyunshan Mountain,Central China

A set of standard chronologies for tree-ring width(TRW),earlywood width(EWW)and latewood width(LWW)in Pinus tabuliformis Carr.along an altitudi-nal gradient(1450,1400,and 1350 m a.s.l.)on Baiyunshan Mountain,Central China to analyze the effect of varying temperature and precipitation on growth along the gradi-ent.Correlation analyses showed that at all three altitudes and the TRW and EWW chronologies generally had signifi-cant negative correlations with mean and maximum tem-peratures in the current April and May and with minimum temperatures in the prior July and August,but significant positive correlations with precipitation in the current May.Correlations were generally significantly negative between LWW chronologies and all temperatures in the prior July and August,indicating that the prior summer temperature had a strong lag effect on the growth of P.tabuliformis that increased with altitude.The correlation with the standard-ized precipitation evapotranspiration index(SPEI)confirmed that wet conditions in the current May promoted growth of TR and EW at all altitudes.Significant altitudinal differences were also found;at 1400 m,there were significant positive correlations between EWW chronologies and SPEI in the current April and significant negative correlations between LWW chronologies and SPEI in the current September,but these correlations were not significant at 1450 m.At 1350 m,there were also significant negative correlations between the TRW and the EWW chronologies and SPEI in the prior October and the current July and between LWW chronology and SPEI in the current August,but these cor-relations were not significant at 1400 m.Moving correlation results showed a stable response of EWW in relation to the SPEI in the current May at all three altitudes and of LWW to maximum temperature in the prior July-August at 1400 m from 2002 to 2018.The EWW chronology at 1400 m and the LWW chronology at 1450 m were identified as more suitable for climate reconstruction.These results provide a strong scientific basis for forest management decisions and climate reconstructions in Central China.

Policy Gradient Adaptive Dynamic Programming for Model-Free Multi-Objective Optimal Control

Dear Editor,In this letter,the multi-objective optimal control problem of nonlinear discrete-time systems is investigated.A data-driven policy gradient algorithm is proposed in which the action-state value function is used to evaluate the policy.In the policy improvement process,the policy gradient based method is employed.

Seedling potential of trees species along the elevational gradient in temperate hill forest of central Nepal

Regeneration status of tree species along elevation gradient in temperate hill forest was not understood greatly.Present research examined the tree diversity and its regeneration patterns along an elevation gradient in temperate hill forest,central Nepal.Data were collected from 300 sample plots within vertical elevation bands of 10,ranging from 1365 to 2450 m asl.A random sampling method was used for data collection in three seasons,winter,pre-monsoon and post monsoon seasons.Diameter at breast height(DBH)was used to broadly categorize the plant individual into trees,saplings and seedlings.The tree species richness ranged from 12 to 25 with density of 350 to 1200 individuals per hectare.Species richness of tree and sapling showed statistically significant unimodal pattern,which peaked at mid-elevation.Elevation showed a strong and positive linear correlation with the seedling density(Deviance=0.99,p<0.001)and a significant hump-shaped relationship with sapling density(Deviance=0.95,p<0.001).Similarly,elevations showed a statistically significant negative hump-shaped relationship with all trees,saplings and seedling stages(Deviances=0.89,0.87 and 0.57).The highest values of the Shannon-Wiener index and the lowest value of the Simpson index were found at mid-elevation for all growth forms.Nearly 92%of tree species were found at regenerating stage;49%in a good renewal regeneration status,32%in fair renewal regeneration,and 11%at a poor regenerating condition.Nevertheless,4%of tree species were reported as non-regenerating stages and 4%were newly introduced species.Hence,the regeneration status of the study area was considered fairly well since sapling(78.5%)>seedling(10.6%)≤mature(10.9%).Among tested environmental variables,elevation and annual mean rainfall were the most influential factors in the regeneration of tree species.

Fast compressed sensing spectral measurement with adaptive gradient multiscale resolution

We propose a fast,adaptive multiscale resolution spectral measurement method based on compressed sensing.The method can apply variable measurement resolution over the entire spectral range to reduce the measurement time by over 75%compared to a global high-resolution measurement.Mimicking the characteristics of the human retina system,the resolution distribution follows the principle of gradually decreasing.The system allows the spectral peaks of interest to be captured dynamically or to be specified a priori by a user.The system was tested by measuring single and dual spectral peaks,and the results of spectral peaks are consistent with those of global high-resolution measurements.

Local Adaptive Gradient Variance Attack for Deep Fake Fingerprint Detection

In recent years,deep learning has been the mainstream technology for fingerprint liveness detection(FLD)tasks because of its remarkable performance.However,recent studies have shown that these deep fake fingerprint detection(DFFD)models are not resistant to attacks by adversarial examples,which are generated by the introduction of subtle perturbations in the fingerprint image,allowing the model to make fake judgments.Most of the existing adversarial example generation methods are based on gradient optimization,which is easy to fall into local optimal,resulting in poor transferability of adversarial attacks.In addition,the perturbation added to the blank area of the fingerprint image is easily perceived by the human eye,leading to poor visual quality.In response to the above challenges,this paper proposes a novel adversarial attack method based on local adaptive gradient variance for DFFD.The ridge texture area within the fingerprint image has been identified and designated as the region for perturbation generation.Subsequently,the images are fed into the targeted white-box model,and the gradient direction is optimized to compute gradient variance.Additionally,an adaptive parameter search method is proposed using stochastic gradient ascent to explore the parameter values during adversarial example generation,aiming to maximize adversarial attack performance.Experimental results on two publicly available fingerprint datasets show that ourmethod achieves higher attack transferability and robustness than existing methods,and the perturbation is harder to perceive.

Slip distribution inversion of seismic sub-fault dip iteration using gradient based optimizer algorithm

This paper considers setting different dips for different sub-faults to fit the actual rupture situation based on the fault rupture of the 2013 Lushan M_(S)7.0 earthquake.Meanwhile,combined with the coseismic GNSS data of the Lushan earthquake,the source parameters and sliding distribution of the Lushan earthquake fault are inversed.Firstly,we use the gradient based optimizer(GBO)in nonlinear inversion to obtain the source parameters of this seismic fault.The inversion results indicate that the strike of the fault is 206.52°,the dip is 44.10°,the length is 21.92 km,and the depth is 12.79 km.To refine the sliding distribution of the seismic fault,the seismic fault is divided into 3×3 sub-faults.Then,we fix the central sub-fault dip of 44.10°;the dip of other sub-faults is obtained by iteration.After that,the model is further divided into a fault layer model composed of 23×19 sub fault slices,and using the Matlab fitting function is used to fit the dip of the 23×19 sub faults.Finally,the Lushan seismic fault plane is established as a shovel structure with steep upper and gentle lower,steep south and gentle north.The slip distribution inversion results indicate that the depth of the slip peak is 13 km,the corresponding maximum slip momentum is 0.67 m,the seismic moment is 1.10×10^(19)N·m and the corresponding moment magnitude is MW6.66.The results above are consistent with the research results of seismology.

Mechanical property of cylindrical sandwich shell with gradient core of entangled wire mesh

To explore the wide-frequency damping and vibration-attenuation performances in the application of aerospace components,the cylindrical sandwich shell structure with a gradient core of entangled wire mesh was proposed in this paper.Firstly,the gradient cores of entangled wire mesh in the axial and radial directions were prepared by using an in-house Numerical Control weaving machine,and the metallurgical connection between skin sheets and the gradient core was performed using vacuum brazing.Secondly,to investigate the mechanical properties of cylindrical sandwich shells with axial or radial gradient cores,quasi-static and dynamic mechanical experiments were carried out.The primary evaluations of mechanical properties include secant stiffness,natural frequency,Specific Energy Absorption(SEA),vibration acceleration level,and so on.The results suggest that the vibration-attenuation performance of the sandwich shell is remarkable when the high-density core layer is at the end of the shell or abuts the inner skin.The axial gradient material has almost no influence on the vibration frequencies of the shell,whereas the vibration frequencies increase dramatically when the high-density core layer approaches the skin.Moreover,compared to the conventional sandwich shells,the proposed functional grading cylindrical sandwich shell exhibits more potential in mass reduction,stiffness designing,and energy dissipation.

Gradient Optimizer Algorithm with Hybrid Deep Learning Based Failure Detection and Classification in the Industrial Environment

Failure detection is an essential task in industrial systems for preventing costly downtime and ensuring the seamlessoperation of the system. Current industrial processes are getting smarter with the emergence of Industry 4.0.Specifically, various modernized industrial processes have been equipped with quite a few sensors to collectprocess-based data to find faults arising or prevailing in processes along with monitoring the status of processes.Fault diagnosis of rotating machines serves a main role in the engineering field and industrial production. Dueto the disadvantages of existing fault, diagnosis approaches, which greatly depend on professional experienceand human knowledge, intellectual fault diagnosis based on deep learning (DL) has attracted the researcher’sinterest. DL reaches the desired fault classification and automatic feature learning. Therefore, this article designs a Gradient Optimizer Algorithm with Hybrid Deep Learning-based Failure Detection and Classification (GOAHDLFDC)in the industrial environment. The presented GOAHDL-FDC technique initially applies continuous wavelettransform (CWT) for preprocessing the actual vibrational signals of the rotating machinery. Next, the residualnetwork (ResNet18) model was exploited for the extraction of features from the vibration signals which are thenfed into theHDLmodel for automated fault detection. Finally, theGOA-based hyperparameter tuning is performedtoadjust the parameter valuesof theHDLmodel accurately.The experimental result analysis of the GOAHDL-FD Calgorithm takes place using a series of simulations and the experimentation outcomes highlight the better resultsof the GOAHDL-FDC technique under different aspects.

Gyro-Landau-fluid simulations of impurity effects on ion temperature gradient driven turbulence transport

The effects of impurities on ion temperature gradient(ITG)driven turbulence transport in tokamak core plasmas are investigated numerically via global simulations of microturbulence with carbon impurities and adiabatic electrons.The simulations use an extended fluid code(ExFC)based on a four-field gyro-Landau-fluid(GLF)model.The multispecies form of the normalized GLF equations is presented,which guarantees the self-consistent evolution of both bulk ions and impurities.With parametric profiles of the cyclone base case,well-benchmarked ExFC is employed to perform simulations focusing on different impurity density profiles.For a fixed temperature profile,it is found that the turbulent heat diffusivity of bulk ions in a quasi-steady state is usually lower than that without impurities,which is contrary to the linear and quasilinear predictions.The evolutions of the temperature gradient and heat diffusivity exhibit a fast relaxation process,indicating that the destabilization of the outwardly peaked impurity profile is a transient state response.Furthermore,the impurity effects from different profiles can obviously influence the nonlinear critical temperature gradient,which is likely to be dominated by linear effects.These results suggest that the improvement in plasma confinement could be attributed to the impurities,most likely through adjusting both heat diffusivity and the critical temperature gradient.

Gradient coil design with enhanced shielding constraint for a cryogen-free superconducting MRI system

The relatively fragile low-temperature stability of cryogen-free superconducting magnetic resonance imaging(MRI)magnets requires the careful management of exogenous heat sources.A strongly shielded gradient magnetic field is important for the optimal operation of cryogen-free MRI systems.In this study,we present an enhanced shielding method incorporating a regionalized stray field constraining strategy.By optimizing the constraint parameters,we could develop engineering-feasible gradient coil schemes without increasing system complexity but with the stray field intensity reduced by half.In real measurement in an integrated MRI system,the developed gradient assembly demonstrated good performance and supported to output images of excellent quality.Our findings suggested that the proposed method could potentially form a useful design paradigm for cryogen-free MRI magnets.

L_(1)-Smooth SVM with Distributed Adaptive Proximal Stochastic Gradient Descent with Momentum for Fast Brain Tumor Detection

Brain tumors come in various types,each with distinct characteristics and treatment approaches,making manual detection a time-consuming and potentially ambiguous process.Brain tumor detection is a valuable tool for gaining a deeper understanding of tumors and improving treatment outcomes.Machine learning models have become key players in automating brain tumor detection.Gradient descent methods are the mainstream algorithms for solving machine learning models.In this paper,we propose a novel distributed proximal stochastic gradient descent approach to solve the L_(1)-Smooth Support Vector Machine(SVM)classifier for brain tumor detection.Firstly,the smooth hinge loss is introduced to be used as the loss function of SVM.It avoids the issue of nondifferentiability at the zero point encountered by the traditional hinge loss function during gradient descent optimization.Secondly,the L_(1) regularization method is employed to sparsify features and enhance the robustness of the model.Finally,adaptive proximal stochastic gradient descent(PGD)with momentum,and distributed adaptive PGDwithmomentum(DPGD)are proposed and applied to the L_(1)-Smooth SVM.Distributed computing is crucial in large-scale data analysis,with its value manifested in extending algorithms to distributed clusters,thus enabling more efficient processing ofmassive amounts of data.The DPGD algorithm leverages Spark,enabling full utilization of the computer’s multi-core resources.Due to its sparsity induced by L_(1) regularization on parameters,it exhibits significantly accelerated convergence speed.From the perspective of loss reduction,DPGD converges faster than PGD.The experimental results show that adaptive PGD withmomentumand its variants have achieved cutting-edge accuracy and efficiency in brain tumor detection.Frompre-trained models,both the PGD andDPGD outperform other models,boasting an accuracy of 95.21%.

Analysis of piezoelectric semiconductor fibers under gradient temperature changes

Piezoelectric semiconductors(PSs)possess both semiconducting properties and piezoelectric coupling effects,making them optimal building blocks for semiconductor devices.PS fiber-like structures have wide applications in multi-functional semiconductor devices.In this paper,a one-dimensional(1D)theoretical model is established to describe the piezotronic responses of a PS fiber under gradient temperature changes.The theoretical model aims to explain the mechanism behind the resistance change caused by such gradient temperature changes.Numerical results demonstrate that a gradient temperature change significantly affects the physical fields within the PS fiber,and can induce changes in its surface resistance.It provides important theoretical guidance on the development of piezotronic devices that are sensitive to temperature effects.

Fractional Gradient Descent RBFNN for Active Fault-Tolerant Control of Plant Protection UAVs

With the increasing prevalence of high-order systems in engineering applications, these systems often exhibitsignificant disturbances and can be challenging to model accurately. As a result, the active disturbance rejectioncontroller (ADRC) has been widely applied in various fields. However, in controlling plant protection unmannedaerial vehicles (UAVs), which are typically large and subject to significant disturbances, load disturbances andthe possibility of multiple actuator faults during pesticide spraying pose significant challenges. To address theseissues, this paper proposes a novel fault-tolerant control method that combines a radial basis function neuralnetwork (RBFNN) with a second-order ADRC and leverages a fractional gradient descent (FGD) algorithm.We integrate the plant protection UAV model’s uncertain parameters, load disturbance parameters, and actuatorfault parameters and utilize the RBFNN for system parameter identification. The resulting ADRC exhibits loaddisturbance suppression and fault tolerance capabilities, and our proposed active fault-tolerant control law hasLyapunov stability implications. Experimental results obtained using a multi-rotor fault-tolerant test platformdemonstrate that the proposed method outperforms other control strategies regarding load disturbance suppressionand fault-tolerant performance.

Almost Sure Convergence of Proximal Stochastic Accelerated Gradient Methods

Proximal gradient descent and its accelerated version are resultful methods for solving the sum of smooth and non-smooth problems. When the smooth function can be represented as a sum of multiple functions, the stochastic proximal gradient method performs well. However, research on its accelerated version remains unclear. This paper proposes a proximal stochastic accelerated gradient (PSAG) method to address problems involving a combination of smooth and non-smooth components, where the smooth part corresponds to the average of multiple block sums. Simultaneously, most of convergence analyses hold in expectation. To this end, under some mind conditions, we present an almost sure convergence of unbiased gradient estimation in the non-smooth setting. Moreover, we establish that the minimum of the squared gradient mapping norm arbitrarily converges to zero with probability one.

Enhanced rainfall in North China in July 2021:Role of the North Pacific SST gradient

2021年7月,华北地区的降水量突破1980年以来的极值,这与太平洋海温异常的经向梯度相吻合.研究表明,西北太平洋正海温异常与热带中太平洋负海温异常之间的梯度是2021年7月华北地区降水异常偏多的主要原因,该梯度使得西北太平洋反气旋及其南部的气旋北移,汇合的偏东风将大量水汽从海洋输送到华北地区,使得华北地区降水偏多.同时,太平洋海温异常的经向梯度可能在对流层低层触发异常的反向哈德利环流,伴随着南风异常,使得季风环流增强,雨带偏北.

Tuning energy output of PTFE/Al composite materials through gradient structure

As a typical energetic composite,polytetrafluoroethylene(PTFE)/aluminum(Al)has been widely applied in explosives,pyrotechnics,and propellants due to its ultra-high energy density and intense exothermic reaction.In this work,the radial gradient(RG)structure of PTFE/Al cylinders with three different PTFE morphologies(200 nm and 5μm particles and 5μm fiber)and content changes are prepared by 3D printing technology.The effect of radial gradient structure on the pressure output of PTFE/Al has been studied.Compared with the morphology change of PTFE,the change of component content in the gradient structure has an obvious effect on the pressure output of the PTFE/Al cylinder.Furthermore,the relationships of the morphology,content of PTFE and the combustion reaction of the PTFE/Al cylinder reveal that the cylinder shows a more complex flame propagation process than others.These results could provide a strategy to improve the combustion and pressure output of PTFE/Al.

Hepatic venous pressure gradient: Inaccurately estimates portal venous pressure gradient in alcoholic cirrhosis and portal hypertension

BACKGROUND Portal hypertension(PHT)in patients with alcoholic cirrhosis causes a range of clinical symptoms,including gastroesophageal varices and ascites.The hepatic venous pressure gradient(HVPG),which is easier to measure,has replaced the portal venous pressure gradient(PPG)as the gold standard for diagnosing PHT in clinical practice.Therefore,attention should be paid to the correlation between HVPG and PPG.METHODS Between January 2017 and June 2020,134 patients with alcoholic cirrhosis and PHT who met the inclusion criteria underwent various pressure measurements during transjugular intrahepatic portosystemic shunt procedures.Correlations were assessed using Pearson’s correlation coefficient to estimate the correlation coefficient(r)and determination coefficient(R^(2)).Bland-Altman plots were constructed to further analyze the agreement between the measurements.Disagreements were analyzed using paired t tests,and P values<0.05 were considered statistically significant.RESULTS In this study,the correlation coefficient(r)and determination coefficient(R2)between HVPG and PPG were 0.201 and 0.040,respectively(P=0.020).In the 108 patients with no collateral branch,the average wedged hepatic venous pressure was lower than the average portal venous pressure(30.65±8.17 vs.33.25±6.60 mmHg,P=0.002).Hepatic collaterals were identified in 26 cases with balloon occlusion hepatic venography(19.4%),while the average PPG was significantly higher than the average HVPG(25.94±7.42 mmHg vs 9.86±7.44 mmHg;P<0.001).The differences between HVPG and PPG<5 mmHg in the collateral vs no collateral branch groups were three cases(11.54%)and 44 cases(40.74%),respectively.CONCLUSION In most patients,HVPG cannot accurately represent PPG.The formation of hepatic collaterals is a vital reason for the strong underestimation of HVPG.

In situ generation of Li_(3)N concentration gradient in 3D carbon-based lithium anodes towards highly-stable lithium metal batteries

The uncontrolled dendrite growth of lithium metal anodes(LMAs)caused by unstable anode/electrolyte interface and uneven lithium deposition have impeded the practical applications of lithium metal batteries(LMBs).Constructing a robust artificial solid electrolyte interphase(SEI)and regulating the lithium deposition behavior is an effective strategy to address these issues.Herein,a three-dimensional(3D)lithium anode with gradient Li_(3)N has been in-situ fabricated on carbon-based framework by thermal diffusion method(denoted as CC/Li/Li_(3)N).Density functional theory(DFT)calculations reveal that Li_(3)N can effectively promote the transport of Li^(+)due to the low energy barrier of Li^(+)diffusion.As expected,the Li_(3)N-rich conformal artificial SEI film can not only effectively stabilize the interface and avoid parasitic reactions,but also facilitate fast Li^(+)transport across the SEI layer.The anode matrix with uniformly distributed Li3N can enable homogenous deposition of Li,thus preventing Li dendrite propagation.Benefiting from these merits,the CC/Li/Li_(3)N anode achieves ultralong-term cycling for>1000 h at a current density of 2 m A cm^(-2)and dendrite-free Li deposition at an ultrahigh rate of 20 m A cm^(-2).Moreover,the full cells coupled with LiFePO4cathodes show extraordinary cycling stability for>300 cycles in liquidelectrolyte-based batteries and display a high-capacity retention of 96.7%after 100 cycles in solid-state cells,demonstrating the promising prospects for the practical applications of LMBs.