An Incentive Mechanism for Federated Learning:A Continuous Zero-Determinant Strategy Approach

As a representative emerging machine learning technique, federated learning(FL) has gained considerable popularity for its special feature of “making data available but not visible”. However, potential problems remain, including privacy breaches, imbalances in payment, and inequitable distribution.These shortcomings let devices reluctantly contribute relevant data to, or even refuse to participate in FL. Therefore, in the application of FL, an important but also challenging issue is to motivate as many participants as possible to provide high-quality data to FL. In this paper, we propose an incentive mechanism for FL based on the continuous zero-determinant(CZD) strategies from the perspective of game theory. We first model the interaction between the server and the devices during the FL process as a continuous iterative game. We then apply the CZD strategies for two players and then multiple players to optimize the social welfare of FL, for which we prove that the server can keep social welfare at a high and stable level. Subsequently, we design an incentive mechanism based on the CZD strategies to attract devices to contribute all of their high-accuracy data to FL.Finally, we perform simulations to demonstrate that our proposed CZD-based incentive mechanism can indeed generate high and stable social welfare in FL.

Prediction of lime utilization ratio of dephosphorization in BOF steelmaking based on online sequential extreme learning machine with forgetting mechanism

The machine learning models of multiple linear regression(MLR),support vector regression(SVR),and extreme learning ma-chine(ELM)and the proposed ELM models of online sequential ELM(OS-ELM)and OS-ELM with forgetting mechanism(FOS-ELM)are applied in the prediction of the lime utilization ratio of dephosphorization in the basic oxygen furnace steelmaking process.The ELM model exhibites the best performance compared with the models of MLR and SVR.OS-ELM and FOS-ELM are applied for sequential learning and model updating.The optimal number of samples in validity term of the FOS-ELM model is determined to be 1500,with the smallest population mean absolute relative error(MARE)value of 0.058226 for the population.The variable importance analysis reveals lime weight,initial P content,and hot metal weight as the most important variables for the lime utilization ratio.The lime utilization ratio increases with the decrease in lime weight and the increases in the initial P content and hot metal weight.A prediction system based on FOS-ELM is applied in actual industrial production for one month.The hit ratios of the predicted lime utilization ratio in the error ranges of±1%,±3%,and±5%are 61.16%,90.63%,and 94.11%,respectively.The coefficient of determination,MARE,and root mean square error are 0.8670,0.06823,and 1.4265,respectively.The system exhibits desirable performance for applications in actual industrial pro-duction.

Understanding the creep behaviors and mechanisms of Mg-Gd-Zn alloys via machine learning

Mg-Gd-Zn based alloys have better creep resistance than other Mg alloys and attract more attention at elevated temperatures.However,the multiple alloying elements and various heat treatment conditions,combined with complex microstructural evolution during creep tests,bring great challenges in understanding and predicting creep behaviors.In this study,we proposed to predict the creep properties and reveal the creep mechanisms of Mg-Gd-Zn based alloys by machine learning.On the one hand,the minimum creep rates were effectively predicted by using a support vector regression model.The complex and nonmonotonic effects of test temperature,test stress,alloying elements,and heat treatment conditions on the creep properties were revealed.On the other hand,the creep stress exponents and creep activation energies were calculated by machine learning to analyze the variation of creep mechanisms,based on which the constitutive equations of Mg-Gd-Zn based alloys were obtained.This study introduces an efficient method to comprehend creep behaviors through machine learning,offering valuable insights for the future design and selection of Mg alloys.

Decoding topological XYZ^(2) codes with reinforcement learning based on attention mechanisms

Quantum error correction, a technique that relies on the principle of redundancy to encode logical information into additional qubits to better protect the system from noise, is necessary to design a viable quantum computer. For this new topological stabilizer code-XYZ^(2) code defined on the cellular lattice, it is implemented on a hexagonal lattice of qubits and it encodes the logical qubits with the help of stabilizer measurements of weight six and weight two. However topological stabilizer codes in cellular lattice quantum systems suffer from the detrimental effects of noise due to interaction with the environment. Several decoding approaches have been proposed to address this problem. Here, we propose the use of a state-attention based reinforcement learning decoder to decode XYZ^(2) codes, which enables the decoder to more accurately focus on the information related to the current decoding position, and the error correction accuracy of our reinforcement learning decoder model under the optimisation conditions can reach 83.27% under the depolarizing noise model, and we have measured thresholds of 0.18856 and 0.19043 for XYZ^(2) codes at code spacing of 3–7 and 7–11, respectively. our study provides directions and ideas for applications of decoding schemes combining reinforcement learning attention mechanisms to other topological quantum error-correcting codes.

Enhancing Image Description Generation through Deep Reinforcement Learning:Fusing Multiple Visual Features and Reward Mechanisms

Image description task is the intersection of computer vision and natural language processing,and it has important prospects,including helping computers understand images and obtaining information for the visually impaired.This study presents an innovative approach employing deep reinforcement learning to enhance the accuracy of natural language descriptions of images.Our method focuses on refining the reward function in deep reinforcement learning,facilitating the generation of precise descriptions by aligning visual and textual features more closely.Our approach comprises three key architectures.Firstly,it utilizes Residual Network 101(ResNet-101)and Faster Region-based Convolutional Neural Network(Faster R-CNN)to extract average and local image features,respectively,followed by the implementation of a dual attention mechanism for intricate feature fusion.Secondly,the Transformer model is engaged to derive contextual semantic features from textual data.Finally,the generation of descriptive text is executed through a two-layer long short-term memory network(LSTM),directed by the value and reward functions.Compared with the image description method that relies on deep learning,the score of Bilingual Evaluation Understudy(BLEU-1)is 0.762,which is 1.6%higher,and the score of BLEU-4 is 0.299.Consensus-based Image Description Evaluation(CIDEr)scored 0.998,Recall-Oriented Understudy for Gisting Evaluation(ROUGE)scored 0.552,the latter improved by 0.36%.These results not only attest to the viability of our approach but also highlight its superiority in the realm of image description.Future research can explore the integration of our method with other artificial intelligence(AI)domains,such as emotional AI,to create more nuanced and context-aware systems.

Dynamic Economic Scheduling with Self-Adaptive Uncertainty in Distribution Network Based on Deep Reinforcement Learning

Traditional optimal scheduling methods are limited to accurate physical models and parameter settings, which aredifficult to adapt to the uncertainty of source and load, and there are problems such as the inability to make dynamicdecisions continuously. This paper proposed a dynamic economic scheduling method for distribution networksbased on deep reinforcement learning. Firstly, the economic scheduling model of the new energy distributionnetwork is established considering the action characteristics of micro-gas turbines, and the dynamic schedulingmodel based on deep reinforcement learning is constructed for the new energy distribution network system with ahigh proportion of new energy, and the Markov decision process of the model is defined. Secondly, Second, for thechanging characteristics of source-load uncertainty, agents are trained interactively with the distributed networkin a data-driven manner. Then, through the proximal policy optimization algorithm, agents adaptively learn thescheduling strategy and realize the dynamic scheduling decision of the new energy distribution network system.Finally, the feasibility and superiority of the proposed method are verified by an improved IEEE 33-node simulationsystem.

Machine learning applications on lunar meteorite minerals:From classification to mechanical properties prediction

Amid the scarcity of lunar meteorites and the imperative to preserve their scientific value,nondestructive testing methods are essential.This translates into the application of microscale rock mechanics experiments and scanning electron microscopy for surface composition analysis.This study explores the application of Machine Learning algorithms in predicting the mineralogical and mechanical properties of DHOFAR 1084,JAH 838,and NWA 11444 lunar meteorites based solely on their atomic percentage compositions.Leveraging a prior-data fitted network model,we achieved near-perfect classification scores for meteorites,mineral groups,and individual minerals.The regressor models,notably the KNeighbor model,provided an outstanding estimate of the mechanical properties—previously measured by nanoindentation tests—such as hardness,reduced Young’s modulus,and elastic recovery.Further considerations on the nature and physical properties of the minerals forming these meteorites,including porosity,crystal orientation,or shock degree,are essential for refining predictions.Our findings underscore the potential of Machine Learning in enhancing mineral identification and mechanical property estimation in lunar exploration,which pave the way for new advancements and quick assessments in extraterrestrial mineral mining,processing,and research.

Bidirectional rotating direct-current triboelectric nanogenerator with self-adaptive mechanical switching for harvesting reciprocating motion

Amid the growing interest in triboelectric nanogenerators(TENGs)as novel energy-harvesting devices,several studies have focused on direct current(DC)TENGs to generate a stable DC output for operating electronic devices.However,owing to the working mechanisms of conventional DC TENGs,generating a stable DC output from reciprocating motion remains a challenge.Accordingly,we propose a bidirectional rotating DC TENG(BiR-TENG),which can generate DC outputs,regardless of the direction of rotation,from reciprocating motions.The distinct design of the BiR-TENG enables the mechanical rectification of the alternating current output into a rotational-direction-dependent DC output.Furthermore,it allows the conversion of the rotational-direction-dependent DC output into a unidirectional DC output by adapting the configurations depending on the rotational direction.Owing to these tailored design strategies and subsequent optimizations,the BiR-TENG could generate an effective unidirectional DC output.Applications of the BiR-TENG for the reciprocating motions of swinging doors and waves were demonstrated by harnessing this output.This study demonstrates the potential of the BiR-TENG design strategy as an effective and versatile solution for energy harvesting from reciprocating motions,highlighting the suitability of DC outputs as an energy source for electronic devices.

Mechanism and Construction of the Learning Organization

Learning is a basic skill to survive;building a learning organization is a complicated and systemic project.Focusing on "how to build a learning organization",this paper systematically introduces a set of practical skills and approaches considering five main factors,i.e.orientation,system,environment,methods and media,to strengthen the scientific,standardized and efficient construction of a learning organization.

Reinforcement learning based adaptive control for uncertain mechanical systems with asymptotic tracking

This paper mainly focuses on the development of a learning-based controller for a class of uncertain mechanical systems modeled by the Euler-Lagrange formulation.The considered system can depict the behavior of a large class of engineering systems,such as vehicular systems,robot manipulators and satellites.All these systems are often characterized by highly nonlinear characteristics,heavy modeling uncertainties and unknown perturbations,therefore,accurate-model-based nonlinear control approaches become unavailable.Motivated by the challenge,a reinforcement learning(RL)adaptive control methodology based on the actor-critic framework is investigated to compensate the uncertain mechanical dynamics.The approximation inaccuracies caused by RL and the exogenous unknown disturbances are circumvented via a continuous robust integral of the sign of the error(RISE)control approach.Different from a classical RISE control law,a tanh(·)function is utilized instead of a sign(·)function to acquire a more smooth control signal.The developed controller requires very little prior knowledge of the dynamic model,is robust to unknown dynamics and exogenous disturbances,and can achieve asymptotic output tracking.Eventually,co-simulations through ADAMS and MATLAB/Simulink on a three degrees-of-freedom(3-DOF)manipulator and experiments on a real-time electromechanical servo system are performed to verify the performance of the proposed approach.

Prediction of single cell mechanical properties in microchannels based on deep learning

Traditional methods for measuring single-cell mechanical characteristics face several challenges,including lengthy measurement times,low throughput,and a requirement for advanced technical skills.To overcome these challenges,a novel machine learning(ML)approach is implemented based on the convolutional neural networks(CNNs),aiming at predicting cells'elastic modulus and constitutive equations from their deformations while passing through micro-constriction channels.In the present study,the computational fluid dynamics technology is used to generate a dataset within the range of the cell elastic modulus,incorporating three widely-used constitutive models that characterize the cellular mechanical behavior,i.e.,the Mooney-Rivlin(M-R),Neo-Hookean(N-H),and Kelvin-Voigt(K-V)models.Utilizing this dataset,a multi-input convolutional neural network(MI-CNN)algorithm is developed by incorporating cellular deformation data as well as the time and positional information.This approach accurately predicts the cell elastic modulus,with a coefficient of determination R^(2)of 0.999,a root mean square error of 0.218,and a mean absolute percentage error of 1.089%.The model consistently achieves high-precision predictions of the cellular elastic modulus with a maximum R^(2)of 0.99,even when the stochastic noise is added to the simulated data.One significant feature of the present model is that it has the ability to effectively classify the three types of constitutive equations we applied.The model accurately and reliably predicts single-cell mechanical properties,showcasing a robust ability to generalize.We demonstrate that incorporating deformation features at multiple time points can enhance the algorithm's accuracy and generalization.This algorithm presents a possibility for high-throughput,highly automated,real-time,and precise characterization of single-cell mechanical properties.

An Improved Attention Parameter Setting Algorithm Based on Award Learning Mechanism

The setting of attention parameters plays a role in the performance of synergetic neural network based on PFAP model. This paper first analyzes the attention parameter setting algorithm based on award-penalty learning mechanism. Then, it presents an improved algorithm to overcome its drawbacks. The experimental results demonstrate that the novel algorithm is better than the original one under the same circumstances.

The control of welding wire feed self-adaptive mechanism based on fuzzy PID

The welding wire feed mechanism is an important component of welding equipment, both reliability and stabilization are the premise that the welding quality can be ensured. The PID is currently adapted to control the welding wire feed mechanism, although the fuzzy PID has advantage of fast response and adaptation, the precision of fuzzy PID is lower. Accordingly, the fuzzy self-adaptive PID controller was proposed through changing fuzzy input variables and output variables based on variable universe, simple furwtion is adopted as scaling factor, the fuzzy PID controller parameters are adjusted to improve the precision and adjustment range. Simulation results show that control effects of fuzzy self-adaptive PID adopted by the welding wire feed mechanism have good adaptive ability and robustness based on variable universe, the welding experiments indicate that the welding quality met the requirements actually.

Gas liquid cylindrical cyclone flow regime identification using machine learning combined with experimental mechanism explanation

The flow regimes of GLCC with horizon inlet and a vertical pipe are investigated in experiments,and the velocities and pressure drops data labeled by the corresponding flow regimes are collected.Combined with the flow regimes data of other GLCC positions from other literatures in existence,the gas and liquid superficial velocities and pressure drops are used as the input of the machine learning algorithms respectively which are applied to identify the flow regimes.The choosing of input data types takes the availability of data for practical industry fields into consideration,and the twelve machine learning algorithms are chosen from the classical and popular algorithms in the area of classification,including the typical ensemble models,SVM,KNN,Bayesian Model and MLP.The results of flow regimes identification show that gas and liquid superficial velocities are the ideal type of input data for the flow regimes identification by machine learning.Most of the ensemble models can identify the flow regimes of GLCC by gas and liquid velocities with the accuracy of 0.99 and more.For the pressure drops as the input of each algorithm,it is not the suitable as gas and liquid velocities,and only XGBoost and Bagging Tree can identify the GLCC flow regimes accurately.The success and confusion of each algorithm are analyzed and explained based on the experimental phenomena of flow regimes evolution processes,the flow regimes map,and the principles of algorithms.The applicability and feasibility of each algorithm according to different types of data for GLCC flow regimes identification are proposed.

A dynamic incentive and reputation mechanism for energy-efficient federated learning in 6G

As 5G becomes commercial,researchers have turned attention toward the Sixth-Generation(6G)network with the vision of connecting intelligence in a green energy-efficient manner.Federated learning triggers an upsurge of green intelligent services such as resources orchestration of communication infrastructures while preserving privacy and increasing communication efficiency.However,designing effective incentives in federated learning is challenging due to the dynamic available clients and the correlation between clients'contributions during the learning process.In this paper,we propose a dynamic incentive and reputation mechanism to improve energy efficiency and training performance of federated learning.The proposed incentive based on the Stackelberg game can timely adjust optimal energy consumption with changes in available clients during federated learning.Meanwhile,clients’contributions in reputation management are formulated based on the cooperative game to capture the correlation between tasks,which satisfies availability,fairness,and additivity.The simulation results show that the proposed scheme can significantly motivate high-performance clients to participate in federated learning and improve the accuracy and energy efficiency of the federated learning model.

A Hand Prosthesis with an Under-Actuated and Self-Adaptive Finger Mechanism

One of the major problems faced by hand amputees is the unavailability of a lightweight and powered multi-functional hand prosthesis. Under-actuated finger designs play a key role to make the hand prosthesis lightweight. In this paper, a hand prosthesis with an under-actuated and self-adaptive finger mechanism is proposed. The proposed finger is capable to generate passively different flexion/extension angles for a proximal interphalangeal (PIP) joint and a distal interphalangeal (DIP) joint for each flexion angle of metacarpophalangeal (MCP) joint. In addition, DIP joint is capable to generate different angles for the same angle of PIP joint. Hand prosthesis is built on the proposed finger mechanism. The hand prosthesis enables user to grasp objects with various geometries by performing five grasping patterns. Thumb of the hand prosthesis includes opposition/apposition in addition to flexion/extension of MCP and interphalangeal (IP) joint. Kinematic analysis of the proposed finger has been carried out to verify the movable range of the joints. Simulations and experiments are carried out to verify the effectiveness of the proposed finger mechanism and the hand prosthesis.

Exploration on the mechanism of therapeutic and toxic bidirectional effects of Haizao Yuhu decoction based on machine learning and data mining

Objective:To explore the bidirectional mechanism of Haizao Yuhu decoction(HYD)on goiter and drug-induced liver injury(DILI)based on machine learning and data mining.Methods:Firstly,compounds of HYD were selected from the TCMSP,TCMIP,and BATMAN databases,then the TCMSP was used to acquire the targets of compounds.Targets of goiter and DILI were obtained from the GeneCards database.Secondly,common targets of“HYD-goiter”and“HYD-DILI”as well as related compounds were used to construct the networks and perform Random Walk with Restart(RWR)algorithm and network stability test.Finally,core targets in the“HYD-goiter”and“HYD-DILI”networks were used for molecular docking with core compounds and searched for validation on PubChem,and the relevant experimental data of our group were quoted to verify the analysis results.Results:There were 22 intersection targets of HYD and DILI,326 of HYD and goiter.RWR analysis showed that MAPK1,MAPK3,AKT1,etc.may be the core targets of HYD treating goiter,RELA,TNF,IL4,etc.may be the core targets of the bidirectional effect,and eckol may be the core compound in bidirectional effect.Network stability test indicated that the HYD had a high stability on treating goiter and playing a bidirectional effect.The core targets and core compounds docked well,and 37.3%of targets had been confirmed by experiments and 29.8%core targets had been confirmed.Our previous experimental result confirmed that the HYD could treat goiter usefully by reducing the expression levels of PI3K and AKT mRNA,and down-regulating the expression of Cyclin D1 and Bcl-2 mRNA.Conclusion:HYD containing“sargassum-liquorice”combination may have a bidirectional effect on treating goiter and causing DILI.We offered a new way for more explorations on the therapeutic and toxic bidirectional mechanisms based on machine learning and data mining.

Effect of chemokine CCL2 to learning memory in rats and mechanism of hippocampal neuronal apoptosis

OBJECTIVE To investigate the role of chemokine CCL2 in leaning memory in rats and the mechanism of hippocampal neuronal apoptosis.METHODS Stereotaxic technique was used in this study to infuse CCL2(0.5,5 and50 ng) into bilateral hippocampus,sham group was received the equal volume of sterile saline.Morris water maze(MWM) was employed to assess the learning and memory ability of rats.Quantitative real-time PCR(RT-PCR) was used to detect the relative expression of caspase 3,Bax and Bcl-2 in hippocampus.RESULTS The results of the place navigation task showed that compared to the sham group(18.66±0.82) s,the latency in each model groups [24.18±1.08,25.99±1.96,(28.67±1.47) s] were significantly extended(P<0.05) while the swimming speed have no difference.In probe trial,the crossing times of each model groups [2.86±0.59,2.89 ±0.39,(2.50±0.37) s] were shorter than sham group(4.50±0.76) s(P<0.05).The result of RT-PCR showed that the relative expression of caspase 3 in CCL2 5 ng group(1.275±0.078)and CCL2 50 ng groups(1.283±0.043) in higher than sham group(1.000±0.000),as the same as Bax(1.107±0.028,1.096±0.015).Yet the relative expression of Bcl-2 has no significant difference among groups.CONCLUSION CCL2 may impaired learning and memory in rats in dose-dependent manner.The effect to induce hippocampal neuronal apoptosis may mediated by caspase 3 activation and Bax regulation.

Analysis on the Education Mechanism of the"Learning Power"Platform from the Perspective of Media Convergence

As a media learning platform,the"Learning Power55 platform integrates the advantages of the internet,big data,and new media.Through the supply of massive explicit and implicit learning resources as well as the construction of the interactive space of"Learning Power/5 it fully embodies the education mechanism of moral education.Specifically,it is reflected in the distinctive political position and the education goal mechanism of"moral education,55 the education operation mechanism of"explicit and implicit unity,"the learning mechanism of'"autonomy and cooperation integTation,"and the feedback incentive mechanism of"gamification."The organic combination and interactive operation of these four mechanisms form a collaborative education mechanism system of goal orientation,education operation,learning process,and feedback incentive.

Enhancing Deep Learning Soil Moisture Forecasting Models by Integrating Physics-based Models

Accurate soil moisture(SM)prediction is critical for understanding hydrological processes.Physics-based(PB)models exhibit large uncertainties in SM predictions arising from uncertain parameterizations and insufficient representation of land-surface processes.In addition to PB models,deep learning(DL)models have been widely used in SM predictions recently.However,few pure DL models have notably high success rates due to lacking physical information.Thus,we developed hybrid models to effectively integrate the outputs of PB models into DL models to improve SM predictions.To this end,we first developed a hybrid model based on the attention mechanism to take advantage of PB models at each forecast time scale(attention model).We further built an ensemble model that combined the advantages of different hybrid schemes(ensemble model).We utilized SM forecasts from the Global Forecast System to enhance the convolutional long short-term memory(ConvLSTM)model for 1–16 days of SM predictions.The performances of the proposed hybrid models were investigated and compared with two existing hybrid models.The results showed that the attention model could leverage benefits of PB models and achieved the best predictability of drought events among the different hybrid models.Moreover,the ensemble model performed best among all hybrid models at all forecast time scales and different soil conditions.It is highlighted that the ensemble model outperformed the pure DL model over 79.5%of in situ stations for 16-day predictions.These findings suggest that our proposed hybrid models can adequately exploit the benefits of PB model outputs to aid DL models in making SM predictions.