UAV maneuvering decision-making algorithm based on deep reinforcement learning under the guidance of expert experience

Autonomous umanned aerial vehicle(UAV) manipulation is necessary for the defense department to execute tactical missions given by commanders in the future unmanned battlefield. A large amount of research has been devoted to improving the autonomous decision-making ability of UAV in an interactive environment, where finding the optimal maneuvering decisionmaking policy became one of the key issues for enabling the intelligence of UAV. In this paper, we propose a maneuvering decision-making algorithm for autonomous air-delivery based on deep reinforcement learning under the guidance of expert experience. Specifically, we refine the guidance towards area and guidance towards specific point tasks for the air-delivery process based on the traditional air-to-surface fire control methods.Moreover, we construct the UAV maneuvering decision-making model based on Markov decision processes(MDPs). Specifically, we present a reward shaping method for the guidance towards area and guidance towards specific point tasks using potential-based function and expert-guided advice. The proposed algorithm could accelerate the convergence of the maneuvering decision-making policy and increase the stability of the policy in terms of the output during the later stage of training process. The effectiveness of the proposed maneuvering decision-making policy is illustrated by the curves of training parameters and extensive experimental results for testing the trained policy.

Effects of Perceived Teacher Support on Student Behavioral Engagement in the Blended Learning Environment:Learning Experience as a Mediator

Blended learning(BL)has been widely adopted to improve students’academic achievements in higher education.However,its success relies mainly on student engagement,which plays an essential role in active learning and provides a rich understanding of students’experiences.The study utilized three self-designed scales-the Teacher Support Scale,Student Engagement Scale,and Student Learning Experience Scale-to gauge and examine the impact and relationship between perceived teacher support,student behavioral engagement,and the intermediary role of learning experiences.A cohort of 899 college students undertaking the obligatory College English course through BL modes across five Chinese universities actively participated by completing a comprehensive questionnaire.The results showed significant correlations between perceived teacher support,learning experience,and behavioral engagement.Perceived teacher support significantly predicted students’behavioral engagement,with socio-affective support exerting the most substantial predictive effects.All predictive effects were partially mediated by learning experience(learning mode,online resources,overall LMS-based learning,interaction with their instructor and peers,and learning outcome).The influence of perceived teacher support on behavioral engagement differed between students who reported the most positive(vs.negative)learning experiences.Suggestions for further research are offered for consideration.

Interface Design and Functional Optimization of Chinese Learning Apps Based on User Experience

This research paper investigates the interface design and functional optimization of Chinese learning apps through the lens of user experience.With the increasing popularity of Chinese language learning apps in the era of rapid mobile internet development,users'demands for enhanced interface design and interaction experience have grown significantly.The study aims to explore the influence of user feedback on the design and functionality of Chinese learning apps,proposing optimization strategies to improve user experience and learning outcomes.By conducting a comprehensive literature review,utilizing methods such as surveys and user interviews for data collection,and analyzing user feedback,this research identifies existing issues in the interface design and interaction experience of Chinese learning apps.The results present user opinions,feedback analysis,identified problems,improvement directions,and specific optimization strategies.The study discusses the potential impact of these optimization strategies on enhancing user experience and learning outcomes,compares findings with previous research,addresses limitations,and suggests future research directions.In conclusion,this research contributes to enriching the design theory of Chinese learning apps,offering practical optimization recommendations for developers,and supporting the continuous advancement of Chinese language learning apps.

Exploration of the Integration of Positive Emotions and Flow Experience in STEAM Education

STEAM(science,technology,engineering,arts,and mathematics)education aims to cultivate innovative talents with multidimensional literacy through interdisciplinary integration and innovative practice.However,lack of student motivation has emerged as a key factor hindering its effectiveness.This study explores the integrated application of positive emotions and flow experience in STEAM education from the perspective of positive psychology.It systematically explains how these factors enhance learning motivation and promote knowledge internalization,proposing feasible pathways for instructional design,resource provision,environment creation,and team building.The study provides theoretical insights and practical guidance for transforming STEAM education in the new era.

Sampled-data control through model-free reinforcement learning with effective experience replay

Reinforcement Learning(RL)based control algorithms can learn the control strategies for nonlinear and uncertain environment during interacting with it.Guided by the rewards generated by environment,a RL agent can learn the control strategy directly in a model-free way instead of investigating the dynamic model of the environment.In the paper,we propose the sampled-data RL control strategy to reduce the computational demand.In the sampled-data control strategy,the whole control system is of a hybrid structure,in which the plant is of continuous structure while the controller(RL agent)adopts a discrete structure.Given that the continuous states of the plant will be the input of the agent,the state–action value function is approximated by the fully connected feed-forward neural networks(FCFFNN).Instead of learning the controller at every step during the interaction with the environment,the learning and acting stages are decoupled to learn the control strategy more effectively through experience replay.In the acting stage,the most effective experience obtained during the interaction with the environment will be stored and during the learning stage,the stored experience will be replayed to customized times,which helps enhance the experience replay process.The effectiveness of proposed approach will be verified by simulation examples.

Optimal Control of Nonlinear Systems Using Experience Inference Human-Behavior Learning

Safety critical control is often trained in a simulated environment to mitigate risk.Subsequent migration of the biased controller requires further adjustments.In this paper,an experience inference human-behavior learning is proposed to solve the migration problem of optimal controllers applied to real-world nonlinear systems.The approach is inspired in the complementary properties that exhibits the hippocampus,the neocortex,and the striatum learning systems located in the brain.The hippocampus defines a physics informed reference model of the realworld nonlinear system for experience inference and the neocortex is the adaptive dynamic programming(ADP)or reinforcement learning(RL)algorithm that ensures optimal performance of the reference model.This optimal performance is inferred to the real-world nonlinear system by means of an adaptive neocortex/striatum control policy that forces the nonlinear system to behave as the reference model.Stability and convergence of the proposed approach is analyzed using Lyapunov stability theory.Simulation studies are carried out to verify the approach.

Optimization of Interactive Videos Empowered the Experience of Learning Management System

The Learning management system(LMS)is now being used for uploading educational content in both distance and blended setups.LMS platform has two types of users:the educators who upload the content,and the students who have to access the content.The students,usually rely on text notes or books and video tutorials while their exams are conducted with formal methods.Formal assessments and examination criteria are ineffective with restricted learning space which makes the student tend only to read the educational contents and videos instead of interactive mode.The aim is to design an interactive LMS and examination video-based interface to cater the issues of educators and students.It is designed according to Human-computer interaction(HCI)principles to make the interactive User interface(UI)through User experience(UX).The interactive lectures in the form of annotated videos increase user engagement and improve the self-study context of users involved in LMS.The interface design defines how the design will interact with users and how the interface exchanges information.The findings show that interactive videos for LMS allow the users to have a more personalized learning experience by engaging in the educational content.The result shows a highly personalized learning experience due to the interactive video and quiz within the video.

Research on the Influencing Factors of College Students’Learning Experience in Livestreaming Courses

The learning experience of online courses has always been a hot topic.As livestreaming courses are online courses with real-time interaction between instructors and students,its learning experience directly affects the learning behavior and effect.The evaluation indicators related to online course learning experience were combined with the attitudes of scholars,enterprise practitioners,and learners in livestreaming courses.When the questionnaire was designed,the exploratory and confirmatory factors were analyzed,the Questionnaire on Learning Experience of College Students in Livestreaming Courses was developed to evaluate the learning experience of college students attending livestreaming courses.Last but not the least,based on the survey data,important factors affecting college students’learning experience in livestreaming courses,including course content,learning environment,course interaction,and learning incentives were discussed and analyzed;strategies to optimize the learning experience in livestreaming courses were proposed.

Remote Learning in Higher Education During the Pandemic: A Study of the Experiences of Chinese International Students at United Kingdom and United States Universities in 2020/21

During the COVID-19 pandemic crisis,many universities around the world made a drastic change by transferring most of their offline classes to emergency remote learning(ERL).The aim of this study was to explore how Chinese students,who studied in United Kingdom(UK)and United States(US)universities during the 2020/21 academic year,perceive their experiences of remote learning.As the UK and the US have two relatively advanced education systems,the arrangements of their universities for ERL and their support for international students are worth exploring.Moreover,during the ERL,a portion of Chinese students had online classes in their home countries instead of the country in which their universities are located.Therefore,semi-structured interviews were carried out to explore the academic experiences and social interaction of students who studied in UK and US universities,while remaining in China.The data were analyzed using the thematic analysis method.The findings showed that ERL was perceived negatively by students despite its flexibility in areas of academic learning experiences and social interaction.

A gated recurrent unit model to predict Poisson’s ratio using deep learning

Static Poisson’s ratio(vs)is crucial for determining geomechanical properties in petroleum applications,namely sand production.Some models have been used to predict vs;however,the published models were limited to specific data ranges with an average absolute percentage relative error(AAPRE)of more than 10%.The published gated recurrent unit(GRU)models do not consider trend analysis to show physical behaviors.In this study,we aim to develop a GRU model using trend analysis and three inputs for predicting n s based on a broad range of data,n s(value of 0.1627-0.4492),bulk formation density(RHOB)(0.315-2.994 g/mL),compressional time(DTc)(44.43-186.9 μs/ft),and shear time(DTs)(72.9-341.2μ s/ft).The GRU model was evaluated using different approaches,including statistical error an-alyses.The GRU model showed the proper trends,and the model data ranges were wider than previous ones.The GRU model has the largest correlation coefficient(R)of 0.967 and the lowest AAPRE,average percent relative error(APRE),root mean square error(RMSE),and standard deviation(SD)of 3.228%,1.054%,4.389,and 0.013,respectively,compared to other models.The GRU model has a high accuracy for the different datasets:training,validation,testing,and the whole datasets with R and AAPRE values were 0.981 and 2.601%,0.966 and 3.274%,0.967 and 3.228%,and 0.977 and 2.861%,respectively.The group error analyses of all inputs show that the GRU model has less than 5% AAPRE for all input ranges,which is superior to other models that have different AAPRE values of more than 10% at various ranges of inputs.

Unveiling the Re,Cr,and I diffusion in saturated compacted bentonite using machine-learning methods

The safety assessment of high-level radioactive waste repositories requires a high predictive accuracy for radionuclide diffusion and a comprehensive understanding of the diffusion mechanism.In this study,a through-diffusion method and six machine-learning methods were employed to investigate the diffusion of ReO_(4)^(−),HCrO_(4)^(−),and I−in saturated compacted bentonite under different salinities and compacted dry densities.The machine-learning models were trained using two datasets.One dataset contained six input features and 293 instances obtained from the diffusion database system of the Japan Atomic Energy Agency(JAEA-DDB)and 15 publications.The other dataset,comprising 15,000 pseudo-instances,was produced using a multi-porosity model and contained eight input features.The results indicate that the former dataset yielded a higher predictive accuracy than the latter.Light gradient-boosting exhibited a higher prediction accuracy(R2=0.92)and lower error(MSE=0.01)than the other machine-learning algorithms.In addition,Shapley Additive Explanations,Feature Importance,and Partial Dependence Plot analysis results indicate that the rock capacity factor and compacted dry density had the two most significant effects on predicting the effective diffusion coefficient,thereby offering valuable insights.

QoE oriented intelligent online learning evaluation technology in B5G scenario

Students'demand for online learning has exploded during the post-COvID-19 pandemic era.However,due to their poor learning experience,students'dropout rate and learning performance of online learning are not always satisfactory.The technical advantages of Beyond Fifth Generation(B5G)can guarantee a good multimedia Quality of Experience(QoE).As a special case of multimedia services,online learning takes into account both the usability of the service and the cognitive development of the users.Factors that affect the Quality of Online Learning Experience(OL-QoE)become more complicated.To get over this dilemma,we propose a systematic scheme by integrating big data,Machine Learning(ML)technologies,and educational psychology theory.Specifically,we first formulate a general definition of OL-QoE by data analysis and experimental verification.This formula considers both the subjective and objective factors(i.e.,video watching ratio and test scores)that most affect OLQoE.Then,we induce an extended layer to the classic Broad Learning System(BLS)to construct an Extended Broad Learning System(EBLS)for the students'OL-QoE prediction.Since the extended layer can increase the width of the BLS model and reduce the redundant nodes of BLS,the proposed EBLS can achieve a trade-off between the prediction accuracy and computation complexity.Finally,we provide a series of early intervention suggestions for different types of students according to their predicted OL-QoE values.Through timely interventions,their OL-QoE and learning performance can be improved.Experimental results verify the effectiveness oftheproposed scheme.

How Presence Affects College Students’Online Learning Outcomes:Unveiling Its Underlying Mechanism

Over the past few years,China’s higher education institutions have experienced remarkable growth in online teaching.However,it remains uncertain whether and how the sense of presence perceived by students affects their online learning outcomes when teachers use online teaching media for communication.This sense specifically pertains to the extent to which students perceive themselves as“real persons”and establish connections with others.Therefore,this study constructs a conceptual model elucidating the impact of presence on students’online learning outcomes and empirically examines the mechanism through which three types of presence influence students’online learning.The test results of the structural equation modeling(SEM)indicate that:(a)teaching presence,social presence,and cognitive presence all exhibit significantly positive outcomes on students’online learning outcomes;(b)these three types of presence can also indirectly and positively influence students’online learning outcomes through the mediating effect of flow experience and learning satisfaction;and(c)flow experience and learning satisfaction play a sequential mediating role in the process by which presence impacts students’online learning outcomes.We hope that the relevant research findings may contribute to unveiling the“black box”of the impact of presence on students’online learning outcomes and offer valuable insights for college educators to overcome online teaching constraints and enhance online teaching quality.

Differential diagnosis of Crohn’s disease and intestinal tuberculosis based on ATR-FTIR spectroscopy combined with machine learning

BACKGROUND Crohn’s disease(CD)is often misdiagnosed as intestinal tuberculosis(ITB).However,the treatment and prognosis of these two diseases are dramatically different.Therefore,it is important to develop a method to identify CD and ITB with high accuracy,specificity,and speed.AIM To develop a method to identify CD and ITB with high accuracy,specificity,and speed.METHODS A total of 72 paraffin wax-embedded tissue sections were pathologically and clinically diagnosed as CD or ITB.Paraffin wax-embedded tissue sections were attached to a metal coating and measured using attenuated total reflectance fourier transform infrared spectroscopy at mid-infrared wavelengths combined with XGBoost for differential diagnosis.RESULTS The results showed that the paraffin wax-embedded specimens of CD and ITB were significantly different in their spectral signals at 1074 cm^(-1) and 1234 cm^(-1) bands,and the differential diagnosis model based on spectral characteristics combined with machine learning showed accuracy,specificity,and sensitivity of 91.84%,92.59%,and 90.90%,respectively,for the differential diagnosis of CD and ITB.CONCLUSION Information on the mid-infrared region can reveal the different histological components of CD and ITB at the molecular level,and spectral analysis combined with machine learning to establish a diagnostic model is expected to become a new method for the differential diagnosis of CD and ITB.

Can serious postoperative complications in patients with Crohn’s disease be predicted using machine learning?

The routine introduction of novel anti-inflammatory therapies into the mana-gement algorithms of patients with Crohn’s disease over the last 2 decades has not substantially changed the likelihood of ultimate surgery.Rather it has delayed the operative need and altered the presentation phenotype.The prospect of complic-ations continues to remain high in this modern era but depending upon the cohort assessed,it remains difficult to make strict comparisons between individual spe-cialist centres.Those patients who present rather late after their diagnosis with a septic complication like an intra-abdominal abscess and a penetrating/fistulizing pattern of disease are more likely to have a complicated course particularly if they have clinical features such as difficult percutaneous access to the collection or multilocularity both of which can make preoperative drainage unsuccessful.Eq-ually,those cases with extensive adhesions where an initial laparoscopic approach needs open conversion and where there is an extended operative time,unsur-prisingly will suffer more significant complications that impact their length of hospital stay.The need for a protective stoma also introduces its own derivative costs,utilizing a range of health resources as well as resulting in important alte-rations in quality of life outcomes.Having established the parameters of the pro-blem can the statistical analysis of the available data identify high-risk cases,promote the notion of centralization of specialist services or improve the allo-cation of disease-specific health expenditure?

Machine learning in predicting postoperative complications in Crohn’s disease

Crohn's disease(CD)is a chronic inflammatory bowel disease of unknown origin that can cause significant disability and morbidity with its progression.Due to the unique nature of CD,surgery is often necessary for many patients during their lifetime,and the incidence of postoperative complications is high,which can affect the prognosis of patients.Therefore,it is essential to identify and manage post-operative complications.Machine learning(ML)has become increasingly im-portant in the medical field,and ML-based models can be used to predict post-operative complications of intestinal resection for CD.Recently,a valuable article titled“Predicting short-term major postoperative complications in intestinal resection for Crohn's disease:A machine learning-based study”was published by Wang et al.We appreciate the authors'creative work,and we are willing to share our views and discuss them with the authors.

Machine learning as a tool predicting short-term postoperative complications in Crohn’s disease patients undergoing intestinal resection: What frontiers?

The recent study,“Predicting short-term major postoperative complications in intestinal resection for Crohn’s disease:A machine learning-based study”invest-igated the predictive efficacy of a machine learning model for major postoperative complications within 30 days of surgery in Crohn’s disease(CD)patients.Em-ploying a random forest analysis and Shapley Additive Explanations,the study prioritizes factors such as preoperative nutritional status,operative time,and CD activity index.Despite the retrospective design’s limitations,the model’s robu-stness,with area under the curve values surpassing 0.8,highlights its clinical potential.The findings align with literature supporting preoperative nutritional therapy in inflammatory bowel diseases,emphasizing the importance of compre-hensive assessment and optimization.While a significant advancement,further research is crucial for refining preoperative strategies in CD patients.

On the Unipolar Generator: An Experimental and Theoretical Study

When studying the phenomenon of the induced electromotive force, which originates from Faraday’s unipolar inductor, the contrast between Faraday’s view of the magnetic field dynamic lines and the theory of relativity is revealed. In order to remove this contradiction, this phenomenon was studied in depth, theoretically and experimentally, using an experimental setup similar to Faraday’s. Calculations of the induced electromotive force, based on relativity on the one hand and on Faraday’s view on the other were made with the help of measurements of the magnetic field components. Accurate magnetic field measurements are confirmed by analytical calculations. Precise-induced electromotive force measurements confirmed Faraday’s view and contradicted the theory of relativity.

基于思维品质培养的小学英语词汇教学策略探究——以Unit 5 Dinner’s ready Let’s learn板块为例

以改善目前小学英语词汇教学中思维品质培养意识淡薄的问题为切入点,以PEP小学《英语》四年级(上)Unit 5 Dinner’s ready Let’slearn板块为例,探究如何依托主题与英语学习活动观,在词汇教学中培养学生的思维品质。提出教师应增强Let’slearn板块词汇教学的思维引领与进阶的育人作用,助力学生英语学科核心素养的协调发展。

Analyzing Arabic Twitter-Based Patient Experience Sentiments Using Multi-Dialect Arabic Bidirectional Encoder Representations from Transformers

Healthcare organizations rely on patients’feedback and experiences to evaluate their performance and services,thereby allowing such organizations to improve inadequate services and address any shortcomings.According to the literature,social networks and particularly Twitter are effective platforms for gathering public opinions.Moreover,recent studies have used natural language processing to measure sentiments in text segments collected from Twitter to capture public opinions about various sectors,including healthcare.The present study aimed to analyze Arabic Twitter-based patient experience sentiments and to introduce an Arabic patient experience corpus.The authors collected 12,400 tweets from Arabic patients discussing patient experiences related to healthcare organizations in Saudi Arabia from 1 January 2008 to 29 January 2022.The tweets were labeled according to sentiment(positive or negative)and sector(public or private),and thereby the Hospital Patient Experiences in Saudi Arabia(HoPE-SA)dataset was produced.A simple statistical analysis was conducted to examine differences in patient views of healthcare sectors.The authors trained five models to distinguish sentiments in tweets automatically with the following schemes:a transformer-based model fine-tuned with deep learning architecture and a transformer-based model fine-tuned with simple architecture,using two different transformer-based embeddings based on Bidirectional Encoder Representations from Transformers(BERT),Multi-dialect Arabic BERT(MAR-BERT),and multilingual BERT(mBERT),as well as a pretrained word2vec model with a support vector machine classifier.This is the first study to investigate the use of a bidirectional long short-term memory layer followed by a feedforward neural network for the fine-tuning of MARBERT.The deep-learning fine-tuned MARBERT-based model—the authors’best-performing model—achieved accuracy,micro-F1,and macro-F1 scores of 98.71%,98.73%,and 98.63%,respectively.