Low rank optimization for efficient deep learning:making a balance between compact architecture and fast training

Deep neural networks(DNNs)have achieved great success in many data processing applications.However,high computational complexity and storage cost make deep learning difficult to be used on resource-constrained devices,and it is not environmental-friendly with much power cost.In this paper,we focus on low-rank optimization for efficient deep learning techniques.In the space domain,DNNs are compressed by low rank approximation of the network parameters,which directly reduces the storage requirement with a smaller number of network parameters.In the time domain,the network parameters can be trained in a few subspaces,which enables efficient training for fast convergence.The model compression in the spatial domain is summarized into three categories as pre-train,pre-set,and compression-aware methods,respectively.With a series of integrable techniques discussed,such as sparse pruning,quantization,and entropy coding,we can ensemble them in an integration framework with lower computational complexity and storage.In addition to summary of recent technical advances,we have two findings for motivating future works.One is that the effective rank,derived from the Shannon entropy of the normalized singular values,outperforms other conventional sparse measures such as the?_1 norm for network compression.The other is a spatial and temporal balance for tensorized neural networks.For accelerating the training of tensorized neural networks,it is crucial to leverage redundancy for both model compression and subspace training.

Meta-cognitive Strategy Training and the Development of Learners＇ Autonomy in Language Learning

As the ultimate goal of education, autonomy in language learning has aroused a lot of attention from scholars at home and abroad. While in universities of China, students do not have strong autonomy in English language learning. The author tries to adopt specific meta-cognitive strategies to facilitate students＇ autonomy in learning by improving learners＇ capacities in study planning or management, monitoring and evaluating in learning to raise their consciousness and ability in autonomy, and lay a foundation for life-long learning.

Exploring the Application Effect of Flipped Classroom Combined with Problem-Based Learning Teaching Method in Clinical Skills Teaching of Standardized Training for Resident Doctors of Traditional Chinese Medicine

Objective: To explore the application effect of flipped classroom combined with problem-based learning teaching method in clinical skills teaching of standardized training for resident doctors of traditional Chinese Medicine. Methods: The study used the experimental control method. The study lasted from September to November 2022. The subjects of this study were 49 students of standardized training for resident doctors of traditional Chinese Medicine from grades 2020, 2021 and 2022 of Dazhou integrated TCM & Western Medicine Hospital. They were randomly divided into experiment group (25) and control group (24). The experiment group adopted flipped classroom combined with problem-based learning teaching method, and the control group adopted traditional teaching method. The teaching content was 4 basic clinical skill projects, including four diagnoses of traditional Chinese Medicine, cardiopulmonary resuscitation, dressing change procedure, acupuncture and massage. The evaluation method was carried out by comparing the students’ performance and a self-designed questionnaire was used to investigate the students’ evaluation of the teaching method. Results: The test scores of total scores in the experimental group (90.12 ± 5.89) were all higher than those in the control group (81.47 ± 7.96) (t = 4.53, P P Conclusions: The teaching process of the flipped classroom combined with problem-based learning teaching method is conducive to improving the efficiency of classroom teaching, cultivating students’ self-learning ability, and enhancing students’ willingness to learn.

Multimodal teaching,learning and training in virtual reality:a review and case study

It is becoming increasingly prevalent in digital learning research to encompass an array of different meanings,spaces,processes,and teaching strategies for discerning a global perspective on constructing the student learning experience.Multimodality is an emergent phenomenon that may influence how digital learning is designed,especially when employed in highly interactive and immersive learning environments such as Virtual Reality(VR).VR environments may aid students'efforts to be active learners through consciously attending to,and reflecting on,critique leveraging reflexivity and novel meaning-making most likely to lead to a conceptual change.This paper employs eleven industrial case-studies to highlight the application of multimodal VR-based teaching and training as a pedagogically rich strategy that may be designed,mapped and visualized through distinct VR-design elements and features.The outcomes of the use cases contribute to discern in-VR multimodal teaching as an emerging discourse that couples system design-based paradigms with embodied,situated and reflective praxis in spatial,emotional and temporal VR learning environments.

Effect of behavior training on learning,memory and the expression of NR2B,GluR1 in hippocampus of rats offspring with fetal growth restriction

Objective： To study effects of behavior training on learning, memory and the expression of NR2B, GluR1 in hippocampus of rat＇ s offspring with fetal growth restriction（FGR）. Methods： The rat model of FGR was established by passive smoking method. The rats offspring were divided into the FGR group and the control group, then randomly divided into the trained and untrained group, respectively. Morris water maze test was proceeded on postnatal month（PM2/4） as a behavior training method, then the learning-memory of rats was detected through dark-avoidance and step-down tests. The expressions of NR2B and GluR1 subunits in hippocampal CA1 and CA3 areas were detected by immunohistochemical method. Results： In the dark-avoidance and step-down tests, the performance record of rats with FGR was worse than that of control rats, and the behavior-trained rats was better than the untrained rats, when the FGR model and training factors were analyzed singly. The model factor and training factor had significant interaction（P 〈 0.05）. The expressions of NR2B and GluR1 subunits in hippocampal CA1 and CA3 areas of rats with FGR reduced. In contrast, the expressions of GluR1 and NR2B subunits in CA1 area of behavior-trained rats increased, when the FGR model and training factors were analyzed singly. Conclusion： These findings suggested that the effect of behavior training on the expressions of NR2B and GluR1 subunits in CA1 area should be the mechanistic basis for the training-induced improvement in learning-memory abilities.

Effect of behavior training on learning and memory of young rats with fetal growth restriction

Objective: To investigate the effect of behavior training on the learning and memory of young rats with fetal growth restriction (FGR). Methods: The model of FGR was established by passive smoking method to pregnant rats. The new-born rats were divided into FGR group and normal group, and then randomly subdivided into trained and untrained group respectively. Morris water maze behavior training was performed on postnatal months 2 and 4, then learning and memory abilities of young rats were measured by dark-avoidance testing and step-down testing. Results: In the dark-avoidance and step-down testing, the young rats’ performance of FGR group was worse than that of control group, and the trained group was better than the untrained group significantly. Conclusion: FGR young rats have descended learning and memory abilities. Behavior training could improve the young rats’ learning and memory abilities, especially for the FGR young rats.

Gamification and virtual reality for digital twin learning and training:architecture and challenges

Background Digital Twins are becoming increasingly popular in a variety of industries to manage complex systems.As digital twins become more sophisticated,there is an increased need for effective training and learning systems.Teachers,project leaders,and tool vendors encounter challenges while teaching and training their students,co-workers,and users.Methods In this study,we propose a new method for training users in using digital twins by proposing a gamified and virtual environment.We present an overall architecture and discuss its practical realization.Results We propose a set of future challenges that we consider critical to enabling a more effective learning/training approach.

EU Including: Development of Radiological and Nuclear Training Learning Objectives

Worldwide, about 20 million consignments of radioactive material are transported annually on public roads, railways, aircraft, and ships. About 95% of radioactive consignments are not related to nuclear power. In 2016, a total of 143 incidents of nuclear or other radioactive materials were found to be outside of regulatory control, which occurred in 19 countries. On an international level risk assessment has to account for the potential threats due to millions of radioactive sources in use worldwide and hundreds of tons of military grade U/Pu not under IAEA safeguards. The European Union (EU) has tasked the INCLUDING project consortium, connecting 15 partners from 10 EU Member States, to address this issue and create an innovative cluster for radiological and nuclear (RN) emergencies. The project is coordinated by the Italian Agency for the New Technologies, Energy and Sustainable Economic Development (ENEA). INCLUDING will provide comprehensive training in the RN security sector. Thereby, know-how is enhanced for practitioners in this sector. An important part in this endeavor is the development of radiological- and nuclear training learning objectives. INCLUDING partners involved in this task (Work Package 4) represent companies, organisations and government agencies from Austria, Greece, Italy, Lithuania, Hungary and Portugal. The task has four main objectives: 1) Harmonisation of RN education/training for EU first responders: 2) Identification of main problems in setting norms;3) Developing a training matrix using revised Bloom’s taxonomy;4) Use of the methodology developed for Joint Actions and its application at INCLUDING Cluster Facilities in different EU Member States. The INCLUDING Work Package 4 members have analyzed the EU EDEN Training Matrix and identified gaps in accordance with NATO CBRN training standards related to civil-military cooperation. Furthermore, they analyzed 5 EUHORIZON 2020- and 9 EUFP7-SECURITY projects, and 97 RN training courses offered to the international community by NATO, 6 EU organisations, Qatar, US military- and civilian organisations, and the International Atomic Energy Agency (IAEA). This paper will present these results, which are being used to develop the basic structure for the Learning Objective Catalogue (LOC), comprised of multiple RN-related Learning Objectives for different threat scenarios.

Training and Development Strategies for Senior and Middle Level Managers with the Purpose of Learning Organizations

In the presence of dynamic organizational environment and a growing supply of‘knowledgeable employees’which require more professional managers to address their fast changing and increasing needs,senior and middle level managers are now required to keep up with the dynamic and learning environment more than ever.In order to train senior and middle level managers,the article has recommended four perspectives to encourage the development of learning manager.The first aspect for senior and middle level mangers is to integrate learning talents into their practices.The second point is to encourage managers to provide strong support for individuals and teams to develop a learning organization.The third point encourages learning managers and organizations to be composed into the culture of the organization.The last point advocates for more open and free dissemination of information and knowledge to be allowed within an organization.

Research on the Reform of the Course“Reading of Concrete Structure Plan and Construction Drawings”Under the Background of“Promoting Teaching and Learning Through Competitions”

The inherent teaching approach can no longer meet the demands of society.In this paper,current issues within the teaching landscape of architectural engineering technology in higher vocational colleges as well as the policies and teaching demands that formed the basis of this model were analyzed.The study shows the importance of the implementation of the teaching model“promoting teaching and learning through competitions.”This model puts emphasis on the curriculum and teaching resources,while also integrating the teaching process and evaluation with competition.These efforts aim to drive education reform in order to better align with the objectives of vocational education personnel training,while also acting as a reference for similar courses.

The Application of E-learning and Distance Learning Technologies to Crew Education and Training in the Russian Federation

The article examines the world experience of e-learning as well as distance education technologies within the education process organization on higher and post-higher education programs.There have been listed the results of the most popular e-learning platforms analysis.Furthermore,there have been looked through the core legislative background of the development of the mentioned technologies in Russia and worldwide among the universities,specialized in seafarers training.There have been also drawn up the points of the Admiral Makarov State University of Maritime and Inland Shipping(Admiral Makarov SUMIS)design of the distance education system LMS"FARWATER"in compliance with the International Convention on Standards of Training,Certification and Watchkeeping for Seafarers(STCW Convention).The practical application of distance education system to the advanced professional training has been discussed in the article.

Learning Strategy Training in English Teaching

This paper mainly deals with the comprehensive knowledge system of learning strategy.Then it tries to probe the steps of strategy training and it's significance to English teaching.

Research on Talent Cultivation Model and Application Based on Mobile Cloud Learning Technology-Taking Innovative Talent Cultivation as an Example

Mobile cloud learning and innovation and entrepreneurship education are undoubtedly one of the hot issues in the current development of human resources and education. At present, domestic colleges and universities still lack the industrialization model and platform that apply theory to practice areas, and apply the new mobile cloud learning technology to the research and practice of innovation and entrepreneurship training.

An Investigation and Analysis in English Learning Strategy of SFLS Students

There is a close relationship between English learning strategy and language proficiency. This study is aimed to investigate how frequently students in our school use different English learning strategies. With the detailed analysis of the questionnaire data, it is hoped that strategy awareness can be gradually cultivated in students' mind.

M-learning结合CBL在消化科规培教学中的探讨及应用

目的探究移动学习平台(M-learning,ML)结合案例教学(Case-based Learning,CBL)在消化科住院医师规范化培训(简称规培)教学中的应用效果。方法选取2021年1月—2023年1月于上海市徐汇区中心医院消化科参加规培学习的80名医师作为研究对象,将其按照随机数表法分为研究组和对照组,每组40名。对照组给予传统讲授式教学法,研究组给予M-learning结合CBL教学法,对比两组医师的理论考试成绩、实践技能考试成绩和学习满意度。结果研究组的理论成绩和实践技能考试成绩均高于对照组,差异具有统计学意义(P均<0.05);研究组的学习满意度明显高于对照组,差异具有统计学意义(P<0.05)。结论将Mlearning结合CBL教学法应用于消化科规培教学中,不仅能够提升医师的理论考试成绩和实践技能考试成绩,还能够有效提高医师学习满意度。

Learning strategies training in classroom teaching

In contemporary English teaching, the study of English learning strategies has become one of the main concerns in teachers＇ teaching and research processes. The necessity of implementation of learning strategies training in the field of English teaching practice still remains disputable. This essay first introduces the different reactions towards the field; then advances the idea of combining English teaching strategies with English learning strategies attempting the implementation of learning strategies training in the classroom teaching. Finally, some thinking produced in the process of practicing the strategies training is raised to reexamine this teaching mode.

Deep learning-based fault diagnostic network of high-speed train secondary suspension systems for immunity to track irregularities and wheel wear

Fault detection and isolation of high-speed train suspension systems is of critical importance to guarantee train running safety. Firstly, the existing methods concerning fault detection or isolation of train suspension systems are briefly reviewed and divided into two categories, i.e., model-based and data-driven approaches. The advantages and disadvantages of these two categories of approaches are briefly summarized. Secondly, a 1D convolution network-based fault diagnostic method for highspeed train suspension systems is designed. To improve the robustness of the method, a Gaussian white noise strategy(GWN-strategy) for immunity to track irregularities and an edge sample training strategy(EST-strategy) for immunity to wheel wear are proposed. The whole network is called GWN-EST-1 DCNN method. Thirdly, to show the performance of this method, a multibody dynamics simulation model of a high-speed train is built to generate the lateral acceleration of a bogie frame corresponding to different track irregularities, wheel profiles, and secondary suspension faults. The simulated signals are then inputted into the diagnostic network, and the results show the correctness and superiority of the GWN-EST-1DCNN method. Finally,the 1DCNN method is further validated using tracking data of a CRH3 train running on a high-speed railway line.

Prediction of Outcomes in Mini-Basketball Training Program for Preschool Children with Autism Using Machine Learning Models

In recent years evidence has emerged suggesting that Mini-basketball training program(MBTP)can be an effec-tive intervention method to improve social communication(SC)impairments and restricted and repetitive beha-viors(RRBs)in preschool children suffering from autism spectrum disorder(ASD).However,there is a considerable degree if interindividual variability concerning these social outcomes and thus not all preschool chil-dren with ASD profit from a MBTP intervention to the same extent.In order to make more accurate predictions which preschool children with ASD can benefit from an MBTP intervention or which preschool children with ASD need additional interventions to achieve behavioral improvements,further research is required.This study aimed to investigate which individual factors of preschool children with ASD can predict MBTP intervention out-comes concerning SC impairments and RRBs.Then,test the performance of machine learning models in predict-ing intervention outcomes based on these factors.Participants were 26 preschool children with ASD who enrolled in a quasi-experiment and received MBTP intervention.Baseline demographic variables(e.g.,age,body,mass index[BMI]),indicators of physicalfitness(e.g.,handgrip strength,balance performance),performance in execu-tive function,severity of ASD symptoms,level of SC impairments,and severity of RRBs were obtained to predict treatment outcomes after MBTP intervention.Machine learning models were established based on support vector machine algorithm were implemented.For comparison,we also employed multiple linear regression models in statistics.Ourfindings suggest that in preschool children with ASD symptomatic severity(r=0.712,p<0.001)and baseline SC impairments(r=0.713,p<0.001)are predictors for intervention outcomes of SC impair-ments.Furthermore,BMI(r=-0.430,p=0.028),symptomatic severity(r=0.656,p<0.001),baseline SC impair-ments(r=0.504,p=0.009)and baseline RRBs(r=0.647,p<0.001)can predict intervention outcomes of RRBs.Statistical models predicted 59.6%of variance in post-treatment SC impairments(MSE=0.455,RMSE=0.675,R2=0.596)and 58.9%of variance in post-treatment RRBs(MSE=0.464,RMSE=0.681,R2=0.589).Machine learning models predicted 83%of variance in post-treatment SC impairments(MSE=0.188,RMSE=0.434,R2=0.83)and 85.9%of variance in post-treatment RRBs(MSE=0.051,RMSE=0.226,R2=0.859),which were better than statistical models.Ourfindings suggest that baseline characteristics such as symptomatic severity of 144 IJMHP,2022,vol.24,no.2 ASD symptoms and SC impairments are important predictors determining MBTP intervention-induced improvements concerning SC impairments and RBBs.Furthermore,the current study revealed that machine learning models can successfully be applied to predict the MBTP intervention-related outcomes in preschool chil-dren with ASD,and performed better than statistical models.Ourfindings can help to inform which preschool children with ASD are most likely to benefit from an MBTP intervention,and they might provide a reference for the development of personalized intervention programs for preschool children with ASD.

Adversarial Training Against Adversarial Attacks for Machine Learning-Based Intrusion Detection Systems

Intrusion detection system plays an important role in defending networks from security breaches.End-to-end machine learning-based intrusion detection systems are being used to achieve high detection accuracy.However,in case of adversarial attacks,that cause misclassification by introducing imperceptible perturbation on input samples,performance of machine learning-based intrusion detection systems is greatly affected.Though such problems have widely been discussed in image processing domain,very few studies have investigated network intrusion detection systems and proposed corresponding defence.In this paper,we attempt to fill this gap by using adversarial attacks on standard intrusion detection datasets and then using adversarial samples to train various machine learning algorithms(adversarial training)to test their defence performance.This is achieved by first creating adversarial sample based on Jacobian-based Saliency Map Attack(JSMA)and Fast Gradient Sign Attack(FGSM)using NSLKDD,UNSW-NB15 and CICIDS17 datasets.The study then trains and tests JSMA and FGSM based adversarial examples in seen(where model has been trained on adversarial samples)and unseen(where model is unaware of adversarial packets)attacks.The experiments includes multiple machine learning classifiers to evaluate their performance against adversarial attacks.The performance parameters include Accuracy,F1-Score and Area under the receiver operating characteristic curve(AUC)Score.

一种有效的培训方式:C-training与E-learning的融合

联合国教科文组织亚太地区总办事处、东南亚教育组织教育技术和改革区域中心举办的东南亚优化学校教学与课程领导培训，采取了C-training与E-learning相融合的工作坊培训。此种培训方式可以达到其中任意一种或是两者简单叠加达不到的培训效果：既解决了单纯C—training的开支及时间局限等问题，又避免了单纯E—Learning在情感沟通、操作指导及教学监督方面的弱势。