An Incentive Mechanism for Federated Learning:A Continuous Zero-Determinant Strategy Approach

As a representative emerging machine learning technique, federated learning(FL) has gained considerable popularity for its special feature of “making data available but not visible”. However, potential problems remain, including privacy breaches, imbalances in payment, and inequitable distribution.These shortcomings let devices reluctantly contribute relevant data to, or even refuse to participate in FL. Therefore, in the application of FL, an important but also challenging issue is to motivate as many participants as possible to provide high-quality data to FL. In this paper, we propose an incentive mechanism for FL based on the continuous zero-determinant(CZD) strategies from the perspective of game theory. We first model the interaction between the server and the devices during the FL process as a continuous iterative game. We then apply the CZD strategies for two players and then multiple players to optimize the social welfare of FL, for which we prove that the server can keep social welfare at a high and stable level. Subsequently, we design an incentive mechanism based on the CZD strategies to attract devices to contribute all of their high-accuracy data to FL.Finally, we perform simulations to demonstrate that our proposed CZD-based incentive mechanism can indeed generate high and stable social welfare in FL.

Reinforcement Learning Based Quantization Strategy Optimal Assignment Algorithm for Mixed Precision

The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to databit width. Reducing the data bit width will result in a loss of accuracy. Therefore, it is difficult to determinethe optimal bit width for different parts of the network with guaranteed accuracy. Mixed precision quantizationcan effectively reduce the amount of computation while keeping the model accuracy basically unchanged. In thispaper, a hardware-aware mixed precision quantization strategy optimal assignment algorithm adapted to low bitwidth is proposed, and reinforcement learning is used to automatically predict the mixed precision that meets theconstraints of hardware resources. In the state-space design, the standard deviation of weights is used to measurethe distribution difference of data, the execution speed feedback of simulated neural network accelerator inferenceis used as the environment to limit the action space of the agent, and the accuracy of the quantization model afterretraining is used as the reward function to guide the agent to carry out deep reinforcement learning training. Theexperimental results show that the proposed method obtains a suitable model layer-by-layer quantization strategyunder the condition that the computational resources are satisfied, and themodel accuracy is effectively improved.The proposed method has strong intelligence and certain universality and has strong application potential in thefield of mixed precision quantization and embedded neural network model deployment.

Dynamic plugging regulating strategy of pipeline robot based on reinforcement learning

Pipeline isolation plugging robot (PIPR) is an important tool in pipeline maintenance operation. During the plugging process, the violent vibration will occur by the flow field, which can cause serious damage to the pipeline and PIPR. In this paper, we propose a dynamic regulating strategy to reduce the plugging-induced vibration by regulating the spoiler angle and plugging velocity. Firstly, the dynamic plugging simulation and experiment are performed to study the flow field changes during dynamic plugging. And the pressure difference is proposed to evaluate the degree of flow field vibration. Secondly, the mathematical models of pressure difference with plugging states and spoiler angles are established based on the extreme learning machine (ELM) optimized by improved sparrow search algorithm (ISSA). Finally, a modified Q-learning algorithm based on simulated annealing is applied to determine the optimal strategy for the spoiler angle and plugging velocity in real time. The results show that the proposed method can reduce the plugging-induced vibration by 19.9% and 32.7% on average, compared with single-regulating methods. This study can effectively ensure the stability of the plugging process.

Enhanced Deep Reinforcement Learning Strategy for Energy Management in Plug-in Hybrid Electric Vehicles with Entropy Regularization and Prioritized Experience Replay

Plug-in Hybrid Electric Vehicles(PHEVs)represent an innovative breed of transportation,harnessing diverse power sources for enhanced performance.Energy management strategies(EMSs)that coordinate and control different energy sources is a critical component of PHEV control technology,directly impacting overall vehicle performance.This study proposes an improved deep reinforcement learning(DRL)-based EMSthat optimizes realtime energy allocation and coordinates the operation of multiple power sources.Conventional DRL algorithms struggle to effectively explore all possible state-action combinations within high-dimensional state and action spaces.They often fail to strike an optimal balance between exploration and exploitation,and their assumption of a static environment limits their ability to adapt to changing conditions.Moreover,these algorithms suffer from low sample efficiency.Collectively,these factors contribute to convergence difficulties,low learning efficiency,and instability.To address these challenges,the Deep Deterministic Policy Gradient(DDPG)algorithm is enhanced using entropy regularization and a summation tree-based Prioritized Experience Replay(PER)method,aiming to improve exploration performance and learning efficiency from experience samples.Additionally,the correspondingMarkovDecision Process(MDP)is established.Finally,an EMSbased on the improvedDRLmodel is presented.Comparative simulation experiments are conducted against rule-based,optimization-based,andDRL-based EMSs.The proposed strategy exhibitsminimal deviation fromthe optimal solution obtained by the dynamic programming(DP)strategy that requires global information.In the typical driving scenarios based onWorld Light Vehicle Test Cycle(WLTC)and New European Driving Cycle(NEDC),the proposed method achieved a fuel consumption of 2698.65 g and an Equivalent Fuel Consumption(EFC)of 2696.77 g.Compared to the DP strategy baseline,the proposed method improved the fuel efficiency variances(FEV)by 18.13%,15.1%,and 8.37%over the Deep QNetwork(DQN),Double DRL(DDRL),and original DDPG methods,respectively.The observational outcomes demonstrate that the proposed EMS based on improved DRL framework possesses good real-time performance,stability,and reliability,effectively optimizing vehicle economy and fuel consumption.

Significant risk factors for intensive care unit-acquired weakness:A processing strategy based on repeated machine learning

BACKGROUND Intensive care unit-acquired weakness(ICU-AW)is a common complication that significantly impacts the patient's recovery process,even leading to adverse outcomes.Currently,there is a lack of effective preventive measures.AIM To identify significant risk factors for ICU-AW through iterative machine learning techniques and offer recommendations for its prevention and treatment.METHODS Patients were categorized into ICU-AW and non-ICU-AW groups on the 14th day post-ICU admission.Relevant data from the initial 14 d of ICU stay,such as age,comorbidities,sedative dosage,vasopressor dosage,duration of mechanical ventilation,length of ICU stay,and rehabilitation therapy,were gathered.The relationships between these variables and ICU-AW were examined.Utilizing iterative machine learning techniques,a multilayer perceptron neural network model was developed,and its predictive performance for ICU-AW was assessed using the receiver operating characteristic curve.RESULTS Within the ICU-AW group,age,duration of mechanical ventilation,lorazepam dosage,adrenaline dosage,and length of ICU stay were significantly higher than in the non-ICU-AW group.Additionally,sepsis,multiple organ dysfunction syndrome,hypoalbuminemia,acute heart failure,respiratory failure,acute kidney injury,anemia,stress-related gastrointestinal bleeding,shock,hypertension,coronary artery disease,malignant tumors,and rehabilitation therapy ratios were significantly higher in the ICU-AW group,demonstrating statistical significance.The most influential factors contributing to ICU-AW were identified as the length of ICU stay(100.0%)and the duration of mechanical ventilation(54.9%).The neural network model predicted ICU-AW with an area under the curve of 0.941,sensitivity of 92.2%,and specificity of 82.7%.CONCLUSION The main factors influencing ICU-AW are the length of ICU stay and the duration of mechanical ventilation.A primary preventive strategy,when feasible,involves minimizing both ICU stay and mechanical ventilation duration.

Research of Spoken Language Learning Strategy in the Second Language Communication Process

Spoken language learning strategy study is everlasting and often fresh topic, which can come to different conclusions from different point of views. This paper focuses on the second language communication process, trying to find out the possible spoken language phenomenon and the corresponding spoken language learning strategies. At the same time, the factors influencing the learners＇ adoption of spoken language learning strategy as well as the hints for teaching spoken language in class are hopefully to be summarized.

Using Cooperative Learning Strategy to Teach Speaking among Chinese College EFL Students

Chinese English speaking class faces lots of problems,such as lack of motivation,the big class size,the gap between stu⁃dents from urban and rural areas,etc.In order to solve these problems,the cooperative learning strategy is introduced and analyzed in this article.This article defines the cooperative learning strategy and then introduces the benefits of it and at last suggests how to using it in English teaching,especially in speaking.

A Review of Language Learning Strategy

This paper presents definitions of language learning strategies,discusses four classifications of language learning strategies,focuseson research on language learning strategies,and it aimsto provide areview oflanguage learning strategy.

Investigation of English learning strategy employed by senior middle school students in Zhanjiang City： A comparison of students from urban and rural areas

After a review of learning strategy research in China and abroad, this paper made an investigation on the differences in use of learning strategies reported by urban and rural students from four middle schools in Zhanjiang city. The investigation revealed the following findings： urban students employ cognitive and social strategies more frequently than rural students; urban students reported a wider range of strategies compared with their rural peers; urban students of intermediate achievements employ more social strategies than their rural peers, while rural students use affective strategy significantly more often; urban and rural students reported different patterns of gender difference.

Learning Strategy Training in English Teaching

This paper mainly deals with the comprehensive knowledge system of learning strategy.Then it tries to probe the steps of strategy training and it's significance to English teaching.

Language learning strategy in helping Chinese EFL university students with CET4 Written Test as a goal

This article discusses the application of theories in the field of learning strategies to ELT classroom in Chinese universities.By reviewing the literature of learning strategies,this article examines the possible connection between theories and the Chinese ELT classroom in specific,in which it focuses on the requirements of CET 4 examination.By doing so,this article tries to offer some suggestions that could be used in the classroom.

Learning Strategy Training in Foreign Language Teaching

A great many recent studies have shown that making good use of learning strategies can contribute much to students' foreign language learning. This paper deals with some important issues about strategy training based on O'Malley and Chamot's theory, including the concept, value and goals of strategy training and approaches to such training.

A Novel Bat Algorithm based on Cross Boundary Learning and Uniform Explosion Strategy

Population-based algorithms have been used in many real-world problems.Bat algorithm(BA)is one of the states of the art of these approaches.Because of the super bat,on the one hand,BA can converge quickly;on the other hand,it is easy to fall into local optimum.Therefore,for typical BA algorithms,the ability of exploration and exploitation is not strong enough and it is hard to find a precise result.In this paper,we propose a novel bat algorithm based on cross boundary learning(CBL)and uniform explosion strategy(UES),namely BABLUE in short,to avoid the above contradiction and achieve both fast convergence and high quality.Different from previous opposition-based learning,the proposed CBL can expand the search area of population and then maintain the ability of global exploration in the process of fast convergence.In order to enhance the ability of local exploitation of the proposed algorithm,we propose UES,which can achieve almost the same search precise as that of firework explosion algorithm but consume less computation resource.BABLUE is tested with numerous experiments on unimodal,multimodal,one-dimensional,high-dimensional and discrete problems,and then compared with other typical intelligent optimization algorithms.The results show that the proposed algorithm outperforms other algorithms.

How to improve machine learning models for lithofacies identification by practical and novel ensemble strategy and principles

Typically, relationship between well logs and lithofacies is complex, which leads to low accuracy of lithofacies identification. Machine learning (ML) methods are often applied to identify lithofacies using logs labelled by rock cores. However, these methods have accuracy limits to some extent. To further improve their accuracies, practical and novel ensemble learning strategy and principles are proposed in this work, which allows geologists not familiar with ML to establish a good ML lithofacies identification model and help geologists familiar with ML further improve accuracy of lithofacies identification. The ensemble learning strategy combines ML methods as sub-classifiers to generate a comprehensive lithofacies identification model, which aims to reduce the variance errors in prediction. Each sub-classifier is trained by randomly sampled labelled data with random features. The novelty of this work lies in the ensemble principles making sub-classifiers just overfitting by algorithm parameter setting and sub-dataset sampling. The principles can help reduce the bias errors in the prediction. Two issues are discussed, videlicet (1) whether only a relatively simple single-classifier method can be as sub-classifiers and how to select proper ML methods as sub-classifiers;(2) whether different kinds of ML methods can be combined as sub-classifiers. If yes, how to determine a proper combination. In order to test the effectiveness of the ensemble strategy and principles for lithofacies identification, different kinds of machine learning algorithms are selected as sub-classifiers, including regular classifiers (LDA, NB, KNN, ID3 tree and CART), kernel method (SVM), and ensemble learning algorithms (RF, AdaBoost, XGBoost and LightGBM). In this work, the experiments used a published dataset of lithofacies from Daniudi gas field (DGF) in Ordes Basin, China. Based on a series of comparisons between ML algorithms and their corresponding ensemble models using the ensemble strategy and principles, conclusions are drawn: (1) not only decision tree but also other single-classifiers and ensemble-learning-classifiers can be used as sub-classifiers of homogeneous ensemble learning and the ensemble can improve the accuracy of the original classifiers;(2) the ensemble principles for the introduced homogeneous and heterogeneous ensemble strategy are effective in promoting ML in lithofacies identification;(3) in practice, heterogeneous ensemble is more suitable for building a more powerful lithofacies identification model, though it is complex.

Anderson's Cognitive Theory and Learning Strategy Studies in Second Language Acquisition

Second language acquisition can not be understood without addressing the interaction between language and cognition. Cognitive theory can extend to describe learning strategies as complex cognitive skills. Theoretical developments in Anderson’s production systems cover a broader range of behavior than other theories, including comprehension and production of oral and written texts as well as comprehension, problem solving, and verbal learning.Thus Anderson’s cognitive theory can be served as a rationale for learning strategy studies in second language acquisition.

Meta-cognitive Strategy Training and the Development of Learners＇ Autonomy in Language Learning

As the ultimate goal of education, autonomy in language learning has aroused a lot of attention from scholars at home and abroad. While in universities of China, students do not have strong autonomy in English language learning. The author tries to adopt specific meta-cognitive strategies to facilitate students＇ autonomy in learning by improving learners＇ capacities in study planning or management, monitoring and evaluating in learning to raise their consciousness and ability in autonomy, and lay a foundation for life-long learning.

Study on the relationship between the reading anxiety and the reading strategy in foreign language learning

This study is concerned with the possible relationship between language anxiety and language learning strategies in reading process among the students of English as a foreign language （EFL）. Participants consist of a volunteer pool of 120 sophomore non-English majors. Versions of previously published measurement scales, the Foreign Language Reading Anxiety Scales （FLRAS） and the Survey of the Reading Strategies （SOR）, were administered to the subjects as measures of foreign language anxiety and foreign language learning strategy preferences. Based on the collected data, the statistics descriptions were performed to investigate the students＇ anxiety state and strategy use level. The analyses suggest that most of students have the anxiety level above the mean, and the anxiety regarding the reading confidence is mainly responsible for the students＇ reading anxiety, and meanwhile, students use more cognitive strategies in their reading and the level of their language learning strategies are relatively low. Results indicate no significant differences between males and females on their anxiety level, as well as their strategy use. Furthermore, a Pearson correlation analysis reveals that, for the most learners, the anxiety state do hinder them from choosing effective strategies in their reading. The study explores the relationship between the reading anxiety and the reading strategy, demonstrates the effects of the anxiety reduction training on the strategy use, provides the implications for foreign language teachers that in reading comprehension teaching they should focus more on students＇ anxiety, especially their reading confidence anxiety, and encourage them more.

Grade Difference in Metacognitive Strategy Use of Rural Junior Middle School Students in English Learning

Among so many learning strategies,metacognitive strategy is considered as the most crucial one and higher than other strategies.This thesis attempts to know the current situations of metacognitive strategy use of rural junior middle school students in different grades and the existing problems.This study conducted the quantitative method by sending questionnaires.The subjects were 120 rural junior middle school students of a town-level middle school in the mountainous area.The result of the study shows that,students in different grades have much difference on the metacognitive strategy use.

Applying the Teaching Strategy of Co-operative Learning to ELT

This article focuses on a brief introduction of the teaching strategies of Co-operative Learning(CL). Some of the strategies are chosen to make certain changes in ELT field. It is proved that the Teaching Strategy of CL can be applied in ELT, which makes the classroom teaching more efficient and arose learners’ interests. The Teaching Strategy of CL can help students improve their ability of learning and problem solving. It is a new breakthrough to the traditional teaching model.

Meta-Learning of Evolutionary Strategy for Stock Trading

Meta-learning algorithms learn about the learning process itself so it can speed up subsequent similar learning tasks with fewer data and iterations. If achieved, these benefits expand the flexibility of traditional machine learning to areas where there are small windows of time or data available. One such area is stock trading, where the relevance of data decreases as time passes, requiring fast results on fewer data points to respond to fast-changing market trends. We, to the best of our knowledge, are the first to apply meta-learning algorithms to an evolutionary strategy for stock trading to decrease learning time by using fewer iterations and to achieve higher trading profits with fewer data points. We found that our meta-learning approach to stock trading earns profits similar to a purely evolutionary algorithm. However, it only requires 50 iterations during test, versus thousands that are typically required without meta-learning, or 50% of the training data during test.