Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications

Reinforcement learning(RL) has roots in dynamic programming and it is called adaptive/approximate dynamic programming(ADP) within the control community. This paper reviews recent developments in ADP along with RL and its applications to various advanced control fields. First, the background of the development of ADP is described, emphasizing the significance of regulation and tracking control problems. Some effective offline and online algorithms for ADP/adaptive critic control are displayed, where the main results towards discrete-time systems and continuous-time systems are surveyed, respectively.Then, the research progress on adaptive critic control based on the event-triggered framework and under uncertain environment is discussed, respectively, where event-based design, robust stabilization, and game design are reviewed. Moreover, the extensions of ADP for addressing control problems under complex environment attract enormous attention. The ADP architecture is revisited under the perspective of data-driven and RL frameworks,showing how they promote ADP formulation significantly.Finally, several typical control applications with respect to RL and ADP are summarized, particularly in the fields of wastewater treatment processes and power systems, followed by some general prospects for future research. Overall, the comprehensive survey on ADP and RL for advanced control applications has d emonstrated its remarkable potential within the artificial intelligence era. In addition, it also plays a vital role in promoting environmental protection and industrial intelligence.

3D image system improves the learning curve and contributes to medical education of rhinoplasty

Background: Rhinoplasty is a complex surgical procedure that requires critical analysis and precise design before surgery, making it a challenging operation for both the surgical team and medical educators. This study aimed to evaluate the impact of 3D design involvement on learning curves and to establish a more effective method for rhinoplasty education.Methods: Surgeons who participated in an educational program were divided into two groups. The experimental group was involved in the 3D design before the operation, and the control group was asked to review the rhinoplasty atlas. A self-assessment questionnaire was used to evaluate the learning curve of the eight rhinoplasty procedures for each surgeon, and the overall satisfaction rate data were also collected.Results: The self-assessment scores in both groups showed an increasing trend from the first to the eighth operation. The mean scores of the experimental group were significantly higher than those of the control group at the fifth operation(P=0.01). The satisfaction rate of the experimental group(91.7%) was higher than that of the control group(54.5%).Conclusion: The 3D imaging system can improve the learning curve and satisfaction rate of rhinoplasty education,proving that it is an easy and effective tool for medical education.

Exploration of University English Teachers’Acceptance and Willingness to Use Learning Management System Data Analysis Tools

This study investigates university English teachers’acceptance and willingness to use learning management system(LMS)data analysis tools in their teaching practices.The research employs a mixed-method approach,combining quantitative surveys and qualitative interviews to understand teachers’perceptions and attitudes,and the factors influencing their adoption of LMS data analysis tools.The findings reveal that perceived usefulness,perceived ease of use,technical literacy,organizational support,and data privacy concerns significantly impact teachers’willingness to use these tools.Based on these insights,the study offers practical recommendations for educational institutions to enhance the effective adoption of LMS data analysis tools in English language teaching.

Impact of Levels of Education on Perceived Academic Stress and Mental Wellbeing: An Investigation into Online Mode of Learning during Pandemic

A sudden outbreak of the current pandemic COVID-19 has switches the learning to online mode which leads to an increase in perceived academic stress and a serious threat to the mental well-being of the students across the globe.The aim of the current study was therefore,to examine the impact of online learning on perceived academic stress and mental well being of the students with moderating effects of levels of education,during the current pandemic.Measures of the constructs were obtained by the online Google form which consists of the Perceptions of Academic Stress Scale(PASS)by Dalia Bedewy and Adel Gabriel(2015)and War­wick-Edinburg Mental Well-being Scale(2008),from a sample of 150 undergraduate students aged 19-25 years studying in different colleges of Bengaluru,India.Mental well-being constituted the criterion variable whilst academic stress and levels of education were treated as predictor variables.Two-way ANOVA were employed.Results show that academic stress is a significant negative predictor of mental wellbeing(r=-.083;p<0.05),there is a significant difference in the perceived academic stress(df=2;F=2.72;p<0.05)which increase in hierarchy(Third year&first year MD=-3.7;Third year&second year MD=-3.2)and mental well being(df=2,F=5.314 p<0.05)which decreases in hierarchy(Third year&first year MD=-5.8;Third year&second year MD=-5.860)of the students at different educational levels and a combination perceived aca­demic stress and educational levels predicts variance in mental well being of the students(R2=0.052;p>0.05).It was concluded that combined aca­demic stress and educational levels have an impact on mental wellbeing of students in online mode of learning during the current pandemic,but this impact is low(only 5.2%).

Personal Education Philosophy Matters:from Social Constructivism,Andragogy to Active Learning

Education philosophy,which plays a major role in teacher beliefs,is crucial for teacher educators. Ever since the end of last century, there has been a trend in North America to promote, or restore active learning in college/university classrooms. This paper, based on some explorations of the social constructivism, the six assumptions in Andragogy, the ARCS model, the active learning theory and some practical activities, proposes an integrated education philosophy about adult learning. It is assumed this will be able to provide some insight and guidance for college practitioners.

Applications of advanced signal processing and machine learning in the neonatal hypoxic-ischemic electroencephalography

Perinatal hypoxic-ischemic-encephalopathy significantly contributes to neonatal death and life-long disability such as cerebral palsy. Advances in signal processing and machine learning have provided the research community with an opportunity to develop automated real-time identification techniques to detect the signs of hypoxic-ischemic-encephalopathy in larger electroencephalography/amplitude-integrated electroencephalography data sets more easily. This review details the recent achievements, performed by a number of prominent research groups across the world, in the automatic identification and classification of hypoxic-ischemic epileptiform neonatal seizures using advanced signal processing and machine learning techniques. This review also addresses the clinical challenges that current automated techniques face in order to be fully utilized by clinicians, and highlights the importance of upgrading the current clinical bedside sampling frequencies to higher sampling rates in order to provide better hypoxic-ischemic biomarker detection frameworks. Additionally, the article highlights that current clinical automated epileptiform detection strategies for human neonates have been only concerned with seizure detection after the therapeutic latent phase of injury. Whereas recent animal studies have demonstrated that the latent phase of opportunity is critically important for early diagnosis of hypoxic-ischemic-encephalopathy electroencephalography biomarkers and although difficult, detection strategies could utilize biomarkers in the latent phase to also predict the onset of future seizures.

Radix Achyranthis Bidentatae improves learning and memory capabilities in ovariectomized rats

Kidney-tonifying recipe can reduce the accumulation of advanced glycation end products, prevent neuronal degeneration and improve cognitive functions in ovariectomized rats. Radix Achyranthis Bidentatae alcohol extracts may dose-dependently inhibit non-enzymatic saccharification in vitro. This study aimed to examine the effect of Radix Achyranthis Bidentatae on advanced glycation end products and on learning and memory capabilities in ovariectomized rats. Ovariectomized rats were treated with Radix Achyranthis Bidentatae alcohol extracts （containing 1.5 g/kg crude drug） or 0.1% aminoguanidine for 12 weeks and behavioral testing was performed with the Y-electrical maze. This test revealed that Radix Achyranthis Bidentatae and aminoguanidine could improve the learning and memory capabilities of ovariectomized rats. Results of competitive enzyme-linked immunosorbent assay showed that treatment with Radix Achyranthis Bidentatae or aminoguanidine reduced the accumulation of advanced glycation end products in the frontal cortex of ovariectomized rats, while increasing content in the blood and urine. Biochemical tests showed that treatment with Radix Achyranthis Bidentatae or aminoguanidine decreased superoxide dismutase activity in the serum and frontal cortex, and increased serum levels of glutathione peroxidase in ovariectomized rats. In addition there was no apparent effect on malondialdehyde levels. These experimental findings indicate that Radix Achyranthis Bidentatae inhibits production of advanced glycation end products and its accumulation in brain tissue, and improves learning and memory capabilities in ovariectomized rats. These effects may be associated with an anti-oxidative action of the extract.

A Deep-Learning and Transfer-Learning Hybrid Aerosol Retrieval Algorithm for FY4-AGRI:Development and Verification over Asia

The Advanced Geosynchronous Radiation Imager(AGRI)is a mission-critical instrument for the Fengyun series of satellites.AGRI acquires full-disk images every 15 min and views East Asia every 5 min through 14 spectral bands,enabling the detection of highly variable aerosol optical depth(AOD).Quantitative retrieval of AOD has hitherto been challenging,especially over land.In this study,an AOD retrieval algorithm is proposed that combines deep learning and transfer learning.The algorithm uses core concepts from both the Dark Target(DT)and Deep Blue(DB)algorithms to select features for the machinelearning(ML)algorithm,allowing for AOD retrieval at 550 nm over both dark and bright surfaces.The algorithm consists of two steps:①A baseline deep neural network(DNN)with skip connections is developed using 10 min Advanced Himawari Imager(AHI)AODs as the target variable,and②sunphotometer AODs from 89 ground-based stations are used to fine-tune the DNN parameters.Out-of-station validation shows that the retrieved AOD attains high accuracy,characterized by a coefficient of determination(R2)of 0.70,a mean bias error(MBE)of 0.03,and a percentage of data within the expected error(EE)of 70.7%.A sensitivity study reveals that the top-of-atmosphere reflectance at 650 and 470 nm,as well as the surface reflectance at 650 nm,are the two largest sources of uncertainty impacting the retrieval.In a case study of monitoring an extreme aerosol event,the AGRI AOD is found to be able to capture the detailed temporal evolution of the event.This work demonstrates the superiority of the transfer-learning technique in satellite AOD retrievals and the applicability of the retrieved AGRI AOD in monitoring extreme pollution events.

Myocardial infarction patients' learning needs: Perceptions of patients, family members and nurses

Purpose: This descriptive study aimed to identify and compare patient with myocardial infarction,their family member,and cardiac nurse perceptions on the learning needs of patients with myocardial infarction in the acute,sub-acute,and post-acute phases.Methods: A total of 288 patients with myocardial infarction,145 family members,and 40 cardiac unit nurses were enrolled in this study.Data were collected by survey method using the Cardiac Patient Learning Need Inventory (CPLNI).Data analysis was done using descriptive statistical analysis and analysis of variance.Results: The results showed that the learning needs of patients with myocardial infarction were high according to the perceptions of patients,patients' family members,and nurses.There were differences in the priority of learning that the patient need in relation to the disease and healing process.Conclusion: Patients,family members,and nurses have different perceptions regarding the learning needs of patients with myocardial infarction.To create adequate intervention to meet patient's learning needs,there should be an accurate assessment.The results of this study support the importance of patient-centered,individualized education and attention to learning priorities.

Influence of tonifying kidney recipe on advanced glycation endproducts and lipid peroxidation in ovariectomized rats

BACKGROUND： Previous studies have demonstrated that reduced estrogen levels may accelerate the formation of advanced glycation endproducts （AGE） in brain tissue, raise the concentration of lipid peroxidation products in vivo, and speed up deterioration of learning and memory. A tonifying kidney recipe is hypothesized to improve the ability of learning and memory in ovariectomized rats by downregulating AGE and lipid peroxidation products. OBJECTIVE： To simulate a postmenopausal state, bilateral ovariectomy （OVX） was performed in rats, and the effects of tonifying kidney recipe （TKR） on AGE and lipid peroxidation in the rat cerebral cortex, hippocampus, and blood serum levels was measured. In addition, the effects on learning and memory were evaluated, and the effect of AGE -specific inhibitor aminoguanidine （AG） was compared with TKR. DESIGN, TIME AND SETTING： A randomized, in vivo, control experiment was performed at the scientific research center （Provincial Key Laboratory） in the Fourth Hospital of Hebei Medical University （Shijiazhuang, Hebei Province, China） from May 2005 to January 2007. MATERIALS： Forty healthy, adult, female, Sprague Dawley rats were used for this study. TKR was composed of prepared rehmannia rhizome, epimedium herb, desert-living cistanche, and Szechwan lovage rhizome, which were provided by Shijiazhuang Medical Materials Company （China）. A TKR extraction was prepared for further use. AG was provided by Sigma （USA）. Forty rats were randomly divided into four groups： sham, OVX, AG, and TKR, with 10 rats in each group. METHODS： The rat ovaries were resected in the OVX, AG, and TKR groups, whereas the same volume of fat was resected in the sham group. At four weeks after OVX, the AG group received 1% AG water solution by lavage; the TKR group was administrated by lavage once per day at a dose of 6.3 g （crude drug）/kg; OVX and sham groups received equal volumes of tap water. MAIN OUTCOME MEASURES： Learning and memory behavior of rats was tested in a Y-electric maze 16 weeks after the OVX procedure. The contents of advanced glycation endproducts in the rat cerebral cortex, hippocampus, serum, and urine were detected by competitive ELISA and spectrofluorophotometer. The contents of lipid peroxidation in rat serum, cerebral cortex, and hippocampus were assayed using a biochemical method. RESULTS： Compared with the sham group, serum content of advanced glycation endproducts in the OVX group was significantly increased, and lipid peroxidation content increased in cerebral cortex, hippocampus, and serum （t = 3.04-4.22, P 〈 0.05 0.01）. Both AG and TKR decreased the amount of AGE in cerebral cortex and serum （t = 2.53, 3.64, P 〈 0.05, 0.01）, increased AGE urine content （t = 3.25 4.87, P 〈 0.01）, and decreased lipid peroxidation content in cerebral cortex, hippocampus, and serum （t = 2.80 3.70, P 〈 0.05 0.01）. In comparison to the OVX and sham groups, the correct escape rate in the Y-electric maze was significantly increased （t = 3.46, 3.28, P 〈 0.01）, and escape latency was significantly decreased （t=3.12, 2.48 P 〈 0.05） in the AG and TKR groups, which indicated that both AG and TKR improved learning and memory The OVX group had a significantly lower correct escape compared with the sham group （t = 4.21, P 〈 0.01 ）.CONCLUSION： The tonifying kidney recipe decreased deposition of advanced glycation endproducts and lipid peroxidation in ovariectomized rats, and concomitantly improved learning and memory. The effect of TKR was equal to that of AG.

Integrating a flipped classroom and problem-based learning into ophthalmology education

Background: Ophthalmology is an important medical science subject, but it is given with insufficient attention in undergraduate medical education. Flipped classroom(FC) and problem-based learning(PBL) are well-known education methods that can be integrated into ophthalmology education to improve students' competence level and promote active learning. Methods: We used a mixed teaching methodology that integrated a FC and PBL into a 1-week ophthalmology clerkship for 72 fourth-year medical students. The course includes two major sessions: FC session and PBL session, relying on clinical and real-patient cases. Written examinations were set up to assess students' academic performance and questionnaires were designed to evaluate their perceptions. Results: The post-course examination results were higher than the pre-course results, and many students gained ophthalmic knowledge and learning skills to varying levels. Comparison of pre-and post-course questionnaires indicated that interests in ophthalmology increased and more students expressed desires to be eye doctors. Most students were satisfied with the new method, while some suggested the process should be slower and the communication with their teacher needed to strengthen.Conclusions: FC and PBL are complementary methodologies. Utilizing the mixed teaching meth of FC and PBL was successful in enhancing academic performance, student satisfactions and promoting active learning.

Evaluation of students' receptiveness and response to an interprofessional learning activity across health care disciplines:An approach toward team development in healthcare

Objective:This investigation evaluated if exposure to interdisciplinary education improves student readiness for interprofessional learning,fundamental to healthcare team development.Methods:A pre-test post-test design was used to evaluate 308 students from dental medicine,dietetics,medicine,nursing,pharmacy and physical therapy.The Readiness for Interprofessional Learning Scale(RIPLS)was used to evaluate student responsiveness to interprofessional education.Results:Nursing RIPLS mean post-test score was higher compared to the pre-test score(p=0.020).Pharmacy students had higher RIPLS mean pre-test score compared to medical(p=0.010)and nursing students(p=0.018).RIPLS mean pre-test score was higher for dietetics than medical students(p=0.022).Conclusions/Implications:Interdisciplinary learning enhances readiness for interprofessional learning with nursing students.Pharmacy and dietetics students demonstrated a higher level of readiness for interdisciplinary learning compared to other disciplines.Identification of factors influencing readiness for interprofessional learning are key to developing learning strategies targeted to improve teamwork,quality of care and patient outcomes.

AI-Driven Learning Management Systems:Modern Developments, Challenges and Future Trends during theAge of ChatGPT

COVID-19 pandemic restrictions limited all social activities to curtail the spread of the virus.The foremost and most prime sector among those affected were schools,colleges,and universities.The education system of entire nations had shifted to online education during this time.Many shortcomings of Learning Management Systems(LMSs)were detected to support education in an online mode that spawned the research in Artificial Intelligence(AI)based tools that are being developed by the research community to improve the effectiveness of LMSs.This paper presents a detailed survey of the different enhancements to LMSs,which are led by key advances in the area of AI to enhance the real-time and non-real-time user experience.The AI-based enhancements proposed to the LMSs start from the Application layer and Presentation layer in the form of flipped classroom models for the efficient learning environment and appropriately designed UI/UX for efficient utilization of LMS utilities and resources,including AI-based chatbots.Session layer enhancements are also required,such as AI-based online proctoring and user authentication using Biometrics.These extend to the Transport layer to support real-time and rate adaptive encrypted video transmission for user security/privacy and satisfactory working of AI-algorithms.It also needs the support of the Networking layer for IP-based geolocation features,the Virtual Private Network(VPN)feature,and the support of Software-Defined Networks(SDN)for optimum Quality of Service(QoS).Finally,in addition to these,non-real-time user experience is enhanced by other AI-based enhancements such as Plagiarism detection algorithms and Data Analytics.

Effects of Health Education with Problem-Based Learning Approaches on the Knowledge, Attitude, Practice and Coping Skills of Women with High-Risk Pregnancies in Plateau Areas

Objective: Given the unique cultural background, way of life, and physical environment of the Tibetan Plateau, this study aims to investigate the effects of health education using problem-based learning (PBL) approaches on the knowledge, attitude, practice, and coping skills of women with high-risk pregnancies in this region. Methods: 76 high-risk pregnancy cases were enrolled at Tibet’s Linzhi People’s Hospital between September 2023 and April 2024. 30 patients admitted between September 2023 and December 2023 were selected as the control group and were performed with regular patient education. 46 patients admitted between January 2024 and April 2024 were selected as the observation group and were performed regular patient education with problem-based learning approaches. Two groups’ performance on their health knowledge, attitude, practice and coping skills before and after interventions were evaluated, and patient satisfaction were measured at the end of the study. Results: There was no statistical significance (P P P Conclusions: Health education with problem-based learning approaches is worth promoting as it can help high-risk pregnant women in plateau areas develop better health knowledge, attitude and practice and healthier coping skills. Also, it can improve patient sanctification.

The Impact of Classroom Evaluation on Chinese Learning Motivation:A Comparative Study of Oral Feedback and Written Comments

Classroom evaluation plays a critical role in shaping students’learning experiences,influencing not only their academic performance but also their motivation and engagement.In the context of primary Chinese language learning,oral feedback and written comments are two prevalent evaluation methods.This paper explores how these different types of feedback impact students’motivation,learning outcomes,and participation.By comparing the immediacy of oral feedback with the systematic nature of written comments,this study seeks to provide insights into how educators can utilize classroom evaluations more effectively to foster motivation in Chinese language learners.The findings indicate that both feedback methods have unique strengths,and a balanced approach may optimize learning outcomes.

The Role of Music in Multicultural Education:A Tool for Promoting Cultural Understanding and Inclusion

In this essay,it will be examined how music can be a powerful tool in multicultural education in promoting humanity and cultural sensitivity.As classroom diversity increases,the challenge lies with educators to ensure that an equal and appropriate learning environment for all students with cultural sensitivity is maintained.To address this problem,therefore,the study explores how music may be effectively incorporated into intercultural education approaches.This paper has evidence that music is a language that has transcended cultures and promotes tolerance,appreciation,and acceptance of diversity through a synthesis of literature and examples.Several implications posit that music can make people feel they belong,enhance the relations of people from diverse cultures,and provide a practical way of learning about other cultures.The potential of music as a tool to engage social justice issues and liberate oppressed groups is also discussed in this research.It exists,but with caution to cultural appropriation and stereotyping of students,thus requiring educators to be sensitive and socially-apperceived on the best practice ways on how to integrate music into classrooms.The end explains how music helps in nurturing a generation of embracing the world,more sensitive and more inclined to the happenings in society to create a society that will be more sensitive and tolerant with the growing society which is diversifying.Therefore,the current article recommends further exploration and development of music-facilitated/inclined pedagogy of ME in hopefully enhancing cultural consciousness/sensitivity and fostering more social integration.

Towards Automated Assessment of Learning Management Systems in Higher Education Institutions in Zambia

Zambia like any other country in most African regions is still grappling with the dynamics of harnessing technology for the betterment of Higher Education. The onset of the Covid 19 pandemic brought a test for the preparedness of the Zambian Higher Education Institutions (HEIs) in harnessing technology for pedagogical activities. As countries worldwide switched to electronic learning during the pandemic, the same could not be said for Zambian HEIs. Zambian HEIs struggled to conduct pedagogical activities on learning management platforms. This study investigated the factors affecting the implementation and assessment of learning Management systems in Zambia’s HEIs. With its focus on assessing: 1) system features, 2) compliance with regulatory standards, 3) quality of service and 4) technology acceptance as the four key assessment areas of an LMS, this article proposed a model for assessing learning management systems in Zambian HEIs. To test the proposed model, a software tool was also developed.

A Deep Learning-Based Teaching Design for High School Geography Units:Taking the Example of Landforms of the Humanistic Education Edition

The traditional teaching methods of one-way cultivation of students can no longer meet the requirements of talent cultivation at this stage.The issue of how to promote students from passive acceptance to the independent cognitive understanding stage(i.e.deep learning)has become the focus of geography teaching.Therefore,under the guidance of deep learning theory,this paper takes the“landforms”knowledge unit of the Humanistic Education Edition as an example,improves the classroom teaching means through the unit teaching mode,reconstructs the“landforms”teaching unit,and explores the specific teaching of high school geography unit based on deep learning.This study provides a good example and guidelines for high school geography teaching and learning.

Cultivation of Business Students Under the Background of Ideological and Political Education:Optimization Strategies for Project-based Learning

The paper explores the strategy of optimizing the cultivation of new business-applied talents through project-based teaching innovation under the background of curriculum ideological and political education.The paper emphasizes that the core socialist values should be integrated into business education.Improving students’moral literacy and social responsibility is an important goal of cultivating new business talents.The study pointed out that in the process of project-based learning,innovative methods such as virtual reality technology,cross-cultural cooperation and diversified evaluation systems can effectively cultivate applied talents that meet the development needs of the new era.The paper also proposed specific strategies in the project implementation and reflection links to promote students’self-reflection and internalization of values.

Navigating a Change:An In-depth Analysis of the National Education Policy’s Impact on Learning and Development

The patterns and trends in formal higher education are changing.As world economy is moving towards a knowledge based economy,the needs and requirements of formal higher education are also changing.Countries are currently reevaluating their options of formalizing their growing education sector by drafting new education policy that aims to meet the demands of this futuristic knowledge based and technology driven economy with involvement of Artificial Intelligence and Machine Learning(AIML).Factors addressing core competence of employability,holistic development and attainment of skills are the new mantras of evolving modern day’s economy.To be in sync with such demand,requirement,and challenges,the Indian government took a significant step in drafting a New Education Policy popularly known as‘NEP 2020’.This paper makes an attempt to analyze the significant characteristics and dimensions of this NEP 2020 by undertaking a survey among stakeholders mostly students to arrive at certain key findings such as inducing centric,employable,skillful,and holistic development of students attaining such higher education.It also points out some of the implementation issues which require lead time to be adjusted with the system.