Reinforcement Learning-Based Energy Management for Hybrid Power Systems:State-of-the-Art Survey,Review,and Perspectives

The new energy vehicle plays a crucial role in green transportation,and the energy management strategy of hybrid power systems is essential for ensuring energy-efficient driving.This paper presents a state-of-the-art survey and review of reinforcement learning-based energy management strategies for hybrid power systems.Additionally,it envisions the outlook for autonomous intelligent hybrid electric vehicles,with reinforcement learning as the foundational technology.First of all,to provide a macro view of historical development,the brief history of deep learning,reinforcement learning,and deep reinforcement learning is presented in the form of a timeline.Then,the comprehensive survey and review are conducted by collecting papers from mainstream academic databases.Enumerating most of the contributions based on three main directions—algorithm innovation,powertrain innovation,and environment innovation—provides an objective review of the research status.Finally,to advance the application of reinforcement learning in autonomous intelligent hybrid electric vehicles,future research plans positioned as“Alpha HEV”are envisioned,integrating Autopilot and energy-saving control.

Analysis of the Exploration of Hematology Integration Education Model Guided by“Social Learning Theory”

Diseases of the blood system are highly complicated and involve many aspects.This article aimed to put forward the necessity of integrating quality and professional education,the necessity of learning logic,and the importance of establishing an integrated medical education model when teaching about blood system diseases.According to the requirements of the new medical science,this article puts forward the integration of an“online+offline+clinical”medical education mode based on the social learning theory and a learning evaluation mode based on medical literacy.The fundamental task of cultivating human beings into clinical medical talents with professional ethics,independent learning abilities,interpersonal communication abilities,complex problem-solving abilities,innovative consciousness,and critical thinking was implemented.This article aims to propose an improved construction plan to create a new and improved teaching system in medicine.

Monitoring and Early Warning of New Cyber-Telecom Crime Platform Based on BERT Migration Learning

The network is a major platform for implementing new cyber-telecom crimes.Therefore,it is important to carry out monitoring and early warning research on new cyber-telecom crime platforms,which will lay the foundation for the establishment of prevention and control systems to protect citizens’property.However,the deep-learning methods applied in the monitoring and early warning of new cyber-telecom crime platforms have some apparent drawbacks.For instance,the methods suffer from data-distribution differences and tremendous manual efforts spent on data labeling.Therefore,a monitoring and early warning method for new cyber-telecom crime platforms based on the BERT migration learning model is proposed.This method first identifies the text data and their tags,and then performs migration training based on a pre-training model.Finally,the method uses the fine-tuned model to predict and classify new cyber-telecom crimes.Experimental analysis on the crime data collected by public security organizations shows that higher classification accuracy can be achieved using the proposed method,compared with the deep-learning method.

Research on the Optimization Path of College Counselor Team Construction in the New Era

In the new era,the team of college counselors,as an indispensable and important component of the higher education system,bears multiple responsibilities such as ideological and political education,daily student management,mental health counseling,and employment and entrepreneurship guidance.With the rapid development of society and the diversified transformation of student groups,the construction of the counselor team is facing new challenges and opportunities.In-depth research on the optimization path of the construction of the college counselor team is not only significant for improving the overall quality and work efficiency of the counselor team but also directly related to the completion effect of the fundamental task of cultivating morality and talents in colleges and universities,as well as the achievement of the goal of cultivating more high-quality talents for the country.Based on this and the author’s work experience,this paper first elaborates on the necessity of the construction of the college counselor team,and then conducts a deep analysis of its optimization path and strategy,aiming to provide a useful reference for the professionalization and professional development of the college counselor team,thereby promoting the sustainable development of higher education and the comprehensive growth of students.

Comparison of Higher Education between China and New Zealand in Learning

At present,many students finish high school and enroll the university education.University learning is very important education part in students'life,they are thinking about themselves,improve their identity and values,change their aims,produce knowledge and take skills into the future life and working.University offer different courses to learn,they interest in Arts,Commence and Science and satisfy all students'needs.There is an increasing number of Chinese students choose to study in New Zealand because they believe it is a safe place,it is cheaper than the other countries,and because New Zealand is an English speaking country.Most of the New Zealand universities offer foundation courses which give international students the opportunity to bring their English language skills and academic performance up to university entrance standard.This study is to find out Chinese and New Zealand higher education with some different aspects from curriculum,learning environment and evaluation.

A new strategy of integrating American culture with English teaching ＆ learning by using VOA Special English feature programs

The paper mainly studies a new way of combining American culture with English language teaching and learning by means of the VOA Special English feature programs. It is based on a 5-year period of teaching practice, experience and reflection. This interactive, innovative, productive and student-centered approach is a far cry from the rigid, old, unproductive and teacher-centered approach of teaching British and American culture without combining language learning and practice as is commonly used here in Chinese colleges. The author also throws some light on how to use on-line teaching resources and how to cultivate independent learning on the part of the students he has worked with.

The Impact of Online Courses towards Students in Autonomous Learning Based on New Media Technologies

In the 21st century,the rapid development of online technology has dramatically transformed people’s way of lives.The emergence of high-tech products has also boosted modern education to embrace informationization and virtualization.With the promotion and development of online courses,autonomous learning is now emerging among students in colleges and universities.If they want to learn relevant professional knowledge,they could use networking and information technology with relevant devices.This learning method could not only impact traditional education but also facilitate students to explore new ways to learn autonomously.This paper is to discuss the impact of online courses towards students in autonomous learning by analyzing its current learning situation,the feature of this new form and its effects towards students.

Learning Bayesian network parameters under new monotonic constraints

When the training data are insufficient, especially when only a small sample size of data is available, domain knowledge will be taken into the process of learning parameters to improve the performance of the Bayesian networks. In this paper, a new monotonic constraint model is proposed to represent a type of common domain knowledge. And then, the monotonic constraint estimation algorithm is proposed to learn the parameters with the monotonic constraint model. In order to demonstrate the superiority of the proposed algorithm, series of experiments are carried out. The experiment results show that the proposed algorithm is able to obtain more accurate parameters compared to some existing algorithms while the complexity is not the highest.

Advances in machine learning-and artificial intelligence-assisted material design of steels

With the rapid development of artificial intelligence technology and increasing material data,machine learning-and artificial intelligence-assisted design of high-performance steel materials is becoming a mainstream paradigm in materials science.Machine learning methods,based on an interdisciplinary discipline between computer science,statistics and material science,are good at discovering correlations between numerous data points.Compared with the traditional physical modeling method in material science,the main advantage of machine learning is that it overcomes the complex physical mechanisms of the material itself and provides a new perspective for the research and development of novel materials.This review starts with data preprocessing and the introduction of different machine learning models,including algorithm selection and model evaluation.Then,some successful cases of applying machine learning methods in the field of steel research are reviewed based on the main theme of optimizing composition,structure,processing,and performance.The application of machine learning methods to the performance-oriented inverse design of material composition and detection of steel defects is also reviewed.Finally,the applicability and limitations of machine learning in the material field are summarized,and future directions and prospects are discussed.

文本分类中Prompt Learning方法研究综述

文本分类是自然语言处理中的一项基础任务,在情感分析、新闻分类等领域具有重要应用。相较于传统的机器学习和深度学习模型,提示学习可以在数据不足的情况下通过构建提示来进行文本分类。近年来,GPT-3的出现推动了提示学习方法的发展,并且在文本分类领域取得了显著的进展。对以往的文本分类方法进行简要梳理,分析其存在的问题与不足;阐述了提示学习的发展进程,以及构建提示模板的方法,并对用于文本分类的提示学习方法研究及成果进行了介绍和总结。最后,对提示学习在文本分类领域的发展趋势和有待进一步研究的难点进行了总结和展望。

Knowledge transfer in multi-agent reinforcement learning with incremental number of agents

In this paper, the reinforcement learning method for cooperative multi-agent systems(MAS) with incremental number of agents is studied. The existing multi-agent reinforcement learning approaches deal with the MAS with a specific number of agents, and can learn well-performed policies. However, if there is an increasing number of agents, the previously learned in may not perform well in the current scenario. The new agents need to learn from scratch to find optimal policies with others,which may slow down the learning speed of the whole team. To solve that problem, in this paper, we propose a new algorithm to take full advantage of the historical knowledge which was learned before, and transfer it from the previous agents to the new agents. Since the previous agents have been trained well in the source environment, they are treated as teacher agents in the target environment. Correspondingly, the new agents are called student agents. To enable the student agents to learn from the teacher agents, we first modify the input nodes of the networks for teacher agents to adapt to the current environment. Then, the teacher agents take the observations of the student agents as input, and output the advised actions and values as supervising information. Finally, the student agents combine the reward from the environment and the supervising information from the teacher agents, and learn the optimal policies with modified loss functions. By taking full advantage of the knowledge of teacher agents, the search space for the student agents will be reduced significantly, which can accelerate the learning speed of the holistic system. The proposed algorithm is verified in some multi-agent simulation environments, and its efficiency has been demonstrated by the experiment results.

Pathways to Enhance New Quality Productivity in New Liberal Arts Education Through Artificial Intelligence

This paper explores the pathways through which artificial intelligence(AI)enhances new quality productivity in new liberal arts education.By analyzing the role of AI in personalized learning,interdisciplinary integration,and the application of virtual reality/augmented reality technologies,it reveals how AI technology promotes the development of students’innovative capabilities and productivity in the context of new liberal arts education.The study shows that AI is not only a technical tool but also a driving force for transforming educational models and fostering knowledge innovation.Further exploration of the deep integration of AI and new liberal arts education is necessary to promote comprehensive social progress.

护理英语口语教学中AI和改良版Mini-CEX应用SWOT分析及优化策略

在新文科和新医科建设背景下,以护理英语口语课程为例,探究跨学科属性课程的教学改革与评价模式。通过实证研究,以人工智能口语应用和创新的改良版迷你临床演练评估(Mini-CEX)量表作为测评方式,融入形成性考核和终结性考核,对比师评、机评、生评、自评视角,践行多元读写能力培养模式,引导学生完成设计学习流程,并根据成绩统计结果,对AI和改良版Mini-CEX应用开展SWOT分析,剖析创新应用的优势、劣势、机会和威胁,最终提出增长型策略、扭转型策略、多元化策略和防御型策略。策略将AI口语应用和改良版Mini-CEX优势凸显,并改善和优化不足之处,以期开拓新文科和新医科建设新思路和AI赋能ESP课程新范式,助力培养研究型、创新型、复合型及应用型高素质人才。

An Empirical Study of the Effect of Inquiry Teaching on the Development of High School Students'Critical Thinking Under the New Curriculum Standards

The Ministry of Education of the People’s Republic of China has issued three guideline documents to encourage inquiry teaching to help students develop their ability to question,which is a defining feature of critical thinking.Two of the documents have clearly stated that English subject teaching should focus on building students’thinking capacity.Critical thinking is an essential feature of building thinking capacity and a key element of the core competencies the English subject seeks to cultivate.This research measures the performance of students of two high school classes in the exams conducted at the beginning,in the middle,and at the end of the experiment period during which inquiry teaching was applied to enhance students’critical thinking ability.The experiment results show that inquiry teaching can improve students’academic performance in English study and help them better develop their language skills.The implementation of the inquiry design in teaching listening,reading,and writing conforms to the law that governs the development of critical thinking,and the adoption of inquiry teaching can promote the development of critical thinking.

Preparing EFL Learners for Native English-Speaking Context Through Vocabulary Learning： Two Chinese Cases in New Zealand

While numerous studies in English as a second/foreign language （EFL） have examined vocabulary learning and teaching in the perspective of theories and practical tips, there is a paucity of research on the impact of high-frequency words learning on preparing new EFL residents for the life in English-speaking countries. In order to fill this gap, this study draws on the experience of two EFL learners in New Zealand （NZ）, so as to explore the effectiveness of a 16-week daily-English-focused vocabulary learning program, which might generate useful implications about the effective adaption of new EFL residents to their target countries.

Deep learning based Doppler frequency offset estimation for 5G-NR downlink in HSR scenario

In the fifth-generation new radio(5G-NR) high-speed railway(HSR) downlink,a deep learning(DL) based Doppler frequency offset(DFO) estimation scheme is proposed by using the back propagation neural network(BPNN).The proposed method mainly includes pre-training,training,and estimation phases,where the pre-training and training belong to the off-line stage,and the estimation is the online stage.To reduce the performance loss caused by the random initialization,the pre-training method is employed to acquire a desirable initialization,which is used as the initial parameters of the training phase.Moreover,the initial DFO estimation is used as input along with the received pilots to further improve the estimation accuracy.Different from the training phase,the initial DFO estimation in pre-training phase is obtained by the data and pilot symbols.Simulation results show that the mean squared error(MSE) performance of the proposed method is better than those of the available algorithms,and it has acceptable computational complexity.

The Significance of Emphasizing Culture Awareness in the New Standards for English in China -- An Educational Psychological Perspective

The New Standards for English issued in 2001 defined English learning as to develop ＂comprehensive competence in language using＂, which consists of language competence, language knowledge, affective aspects, learning strategy and cultural awareness. Meanwhile, as educational psychologists, De Corte et al advocate four theories in teaching and learning process, which include a theory of expertise, namely, （1） A well-organized and flexibly accessible domain specific knowledge base; （2） Heuristic methods; （3） Meta-knowledge; （4） Self-regulatory skills; （5） Beliefs. Not coincidently, the New Standards is in line with the theory of educational psychology. This gives the way to the author to argue, from the view of educational psychology, by analyzing culture awareness as being functional in meta-cognition and self-regulation aspects in expertise development, the importance of emphasizing culture awareness in English language teaching and learning.

Research on the Optimization of Teaching and Learning Path in the Context of Educational Data

With the repeated in-depth development of the technological revolution,the combination of education and technology constantly shows a new form.Modern education and Internet education have become the new direction of the current education development efforts.The development of technology has brought great Gospel for the national education.Based on this,from the traditional and modern perspectives,this paper discusses the form and significance of teaching and learning paths,to show the new value of education brought by the change of teaching and learning paths under the background of educational data.