Quick Weighing of Passing Vehicles Using the Transfer-Learning-Enhanced Convolutional Neural Network

Transfer learning could reduce the time and resources required by the training of new models and be therefore important for generalized applications of the trainedmachine learning algorithms.In this study,a transfer learningenhanced convolutional neural network(CNN)was proposed to identify the gross weight and the axle weight of moving vehicles on the bridge.The proposed transfer learning-enhanced CNN model was expected to weigh different bridges based on a small amount of training datasets and provide high identification accuracy.First of all,a CNN algorithm for bridge weigh-in-motion(B-WIM)technology was proposed to identify the axle weight and the gross weight of the typical two-axle,three-axle,and five-axle vehicles as they crossed the bridge with different loading routes and speeds.Then,the pre-trained CNN model was transferred by fine-tuning to weigh themoving vehicle on another bridge.Finally,the identification accuracy and the amount of training data required were compared between the two CNN models.Results showed that the pre-trained CNN model using transfer learning for B-WIM technology could be successfully used for the identification of the axle weight and the gross weight for moving vehicles on another bridge while reducing the training data by 63%.Moreover,the recognition accuracy of the pre-trained CNN model using transfer learning was comparable to that of the original model,showing its promising potentials in the actual applications.

Application Strategies of Virtual Reality Technology in the Teaching Design of Vocational Courses from the Perspective of Learning Transfer Theory

With the rapid development of virtual reality technology,it has been widely used in the field of education.It can promote the development of learning transfer,which is an effective method for learners to learn effectively.Therefore,this paper describes how to use virtual reality technology to achieve learning transfer in order to achieve teaching goals and improve learning efficiency.

Optimizing Deep Learning for Computer-Aided Diagnosis of Lung Diseases: An Automated Method Combining Evolutionary Algorithm, Transfer Learning, and Model Compression

Recent developments in Computer Vision have presented novel opportunities to tackle complex healthcare issues,particularly in the field of lung disease diagnosis.One promising avenue involves the use of chest X-Rays,which are commonly utilized in radiology.To fully exploit their potential,researchers have suggested utilizing deep learning methods to construct computer-aided diagnostic systems.However,constructing and compressing these systems presents a significant challenge,as it relies heavily on the expertise of data scientists.To tackle this issue,we propose an automated approach that utilizes an evolutionary algorithm(EA)to optimize the design and compression of a convolutional neural network(CNN)for X-Ray image classification.Our approach accurately classifies radiography images and detects potential chest abnormalities and infections,including COVID-19.Furthermore,our approach incorporates transfer learning,where a pre-trainedCNNmodel on a vast dataset of chest X-Ray images is fine-tuned for the specific task of detecting COVID-19.This method can help reduce the amount of labeled data required for the task and enhance the overall performance of the model.We have validated our method via a series of experiments against state-of-the-art architectures.

Image Recognition Model of Fraudulent Websites Based on Image Leader Decision and Inception-V3 Transfer Learning

The fraudulent website image is a vital information carrier for telecom fraud.The efficient and precise recognition of fraudulent website images is critical to combating and dealing with fraudulent websites.Current research on image recognition of fraudulent websites is mainly carried out at the level of image feature extraction and similarity study,which have such disadvantages as difficulty in obtaining image data,insufficient image analysis,and single identification types.This study develops a model based on the entropy method for image leader decision and Inception-v3 transfer learning to address these disadvantages.The data processing part of the model uses a breadth search crawler to capture the image data.Then,the information in the images is evaluated with the entropy method,image weights are assigned,and the image leader is selected.In model training and prediction,the transfer learning of the Inception-v3 model is introduced into image recognition of fraudulent websites.Using selected image leaders to train the model,multiple types of fraudulent websites are identified with high accuracy.The experiment proves that this model has a superior accuracy in recognizing images on fraudulent websites compared to other current models.

Predictive modeling of critical temperatures in magnesium compounds using transfer learning

This study presents a transfer learning approach for discovering potential Mg-based superconductors utilizing a comprehensive target dataset.Initially,a large source dataset(Bandgap dataset)comprising approximately∼75k compounds is utilized for pretraining,followed by fine-tuning with a smaller Critical Temperature(T_(c))dataset containing∼300 compounds.Comparatively,there is a significant improvement in the performance of the transfer learning model over the traditional deep learning(DL)model in predicting Tc.Subsequently,the transfer learning model is applied to predict the properties of approximately 150k compounds.Predictions are validated computationally using density functional theory(DFT)calculations based on lattice dynamics-related theory.Moreover,to demonstrate the extended predictive capability of the transfer learning model for new materials,a pool of virtual compounds derived from prototype crystal structures from the Materials Project(MP)database is generated.T_(c) predictions are obtained for∼3600 virtual compounds,which underwent screening for electroneutrality and thermodynamic stability.An Extra Trees-based model is trained to utilize E_(hull)values to obtain thermodynamically stable materials,employing a dataset containing Ehull values for approximately 150k materials for training.Materials with Ehull values exceeding 5 meV/atom were filtered out,resulting in a refined list of potential Mg-based superconductors.This study showcases the effectiveness of transfer learning in predicting superconducting properties and highlights its potential for accelerating the discovery of Mg-based materials in the field of superconductivity.

Automatic detection of breast lesions in automated 3D breast ultrasound with cross-organ transfer learning

Background Deep convolutional neural networks have garnered considerable attention in numerous machine learning applications,particularly in visual recognition tasks such as image and video analyses.There is a growing interest in applying this technology to diverse applications in medical image analysis.Automated three dimensional Breast Ultrasound is a vital tool for detecting breast cancer,and computer-assisted diagnosis software,developed based on deep learning,can effectively assist radiologists in diagnosis.However,the network model is prone to overfitting during training,owing to challenges such as insufficient training data.This study attempts to solve the problem caused by small datasets and improve model detection performance.Methods We propose a breast cancer detection framework based on deep learning(a transfer learning method based on cross-organ cancer detection)and a contrastive learning method based on breast imaging reporting and data systems(BI-RADS).Results When using cross organ transfer learning and BIRADS based contrastive learning,the average sensitivity of the model increased by a maximum of 16.05%.Conclusion Our experiments have demonstrated that the parameters and experiences of cross-organ cancer detection can be mutually referenced,and contrastive learning method based on BI-RADS can improve the detection performance of the model.

Study of The Technical Index of Online Learning Behavior Analysis of Nursing Majors on The Superstar Platform Based on The Kirkpatrick Evaluation Model

Objective:To analyze the technical indexes of students’online learning behavior analysis based on Kirkman’s evaluation model,sort out the basic indexes of online learning behavior,and extract scientific and efficient evaluation indexes of online learning effect through statistical analysis.Methods:The online learning behavior data of Physiology of nursing students from 2021-2023 and the first semester of 22 nursing classes(3 and 4)were collected and analyzed.The preset learning behavior indexes were analyzed by multi-dimensional analysis and a correlation analysis was conducted between the indexes and the final examination scores to screen for the dominant important indexes for online learning effect evaluation.Results:The study found that the demand for online learning of nursing students from 2021-2023 increased and the effect was statistically significant.Compared with the stage assessment results,the online learning effect was statistically significant.Conclusion:The main indicators for evaluating and classifying online learning behaviors were summarized.These two indicators can help teachers predict which part of students need learning intervention,optimize the teaching process,and help students improve their learning behavior and academic performance.

An Analysis of the Research Trends in Blended Learning Methods in Teaching College English Reading Courses

Curtis J.Bonk defined blended learning as a combination of face-to-face and computer-assisted online learning instruction since it was gradually formed after the emergence of the Internet[1,2].Breen pointed out that blended learning is a learning method that combines online and offline learning activities and resources[3].The blended learning approach is popular in school and e-learning.Moreover,it is one of the important trends in promoting higher education reform in the coming years.Therefore,it has attracted the attention of international researchers[4].In this paper,42 articles in Scopus(established by international institutions)and 30 articles in CNKI(found by Chinese mainland institutions)on the query of“college English reading blended learning”in the field of education were analyzed.Furthermore,CiteSpace software was used to analyze the research hotspots and trends with the keyword clusters and citations that occurred in the last two decades(1999 to 2022)to foresee future research prospects.

Better use of experience from other reservoirs for accurate production forecasting by learn-to-learn method

To assess whether a development strategy will be profitable enough,production forecasting is a crucial and difficult step in the process.The development history of other reservoirs in the same class tends to be studied to make predictions accurate.However,the permeability field,well patterns,and development regime must all be similar for two reservoirs to be considered in the same class.This results in very few available experiences from other reservoirs even though there is a lot of historical information on numerous reservoirs because it is difficult to find such similar reservoirs.This paper proposes a learn-to-learn method,which can better utilize a vast amount of historical data from various reservoirs.Intuitively,the proposed method first learns how to learn samples before directly learning rules in samples.Technically,by utilizing gradients from networks with independent parameters and copied structure in each class of reservoirs,the proposed network obtains the optimal shared initial parameters which are regarded as transferable information across different classes.Based on that,the network is able to predict future production indices for the target reservoir by only training with very limited samples collected from reservoirs in the same class.Two cases further demonstrate its superiority in accuracy to other widely-used network methods.

Assessments of Data-Driven Deep Learning Models on One-Month Predictions of Pan-Arctic Sea Ice Thickness

In recent years,deep learning methods have gradually been applied to prediction tasks related to Arctic sea ice concentration,but relatively little research has been conducted for larger spatial and temporal scales,mainly due to the limited time coverage of observations and reanalysis data.Meanwhile,deep learning predictions of sea ice thickness(SIT)have yet to receive ample attention.In this study,two data-driven deep learning(DL)models are built based on the ConvLSTM and fully convolutional U-net(FC-Unet)algorithms and trained using CMIP6 historical simulations for transfer learning and fine-tuned using reanalysis/observations.These models enable monthly predictions of Arctic SIT without considering the complex physical processes involved.Through comprehensive assessments of prediction skills by season and region,the results suggest that using a broader set of CMIP6 data for transfer learning,as well as incorporating multiple climate variables as predictors,contribute to better prediction results,although both DL models can effectively predict the spatiotemporal features of SIT anomalies.Regarding the predicted SIT anomalies of the FC-Unet model,the spatial correlations with reanalysis reach an average level of 89%over all months,while the temporal anomaly correlation coefficients are close to unity in most cases.The models also demonstrate robust performances in predicting SIT and SIE during extreme events.The effectiveness and reliability of the proposed deep transfer learning models in predicting Arctic SIT can facilitate more accurate pan-Arctic predictions,aiding climate change research and real-time business applications.

A Review of NILM Applications with Machine Learning Approaches

In recent years,Non-Intrusive LoadMonitoring (NILM) has become an emerging approach that provides affordableenergy management solutions using aggregated load obtained from a single smart meter in the power grid.Furthermore, by integrating Machine Learning (ML), NILM can efficiently use electrical energy and offer less ofa burden for the energy monitoring process. However, conducted research works have limitations for real-timeimplementation due to the practical issues. This paper aims to identify the contribution of ML approaches todeveloping a reliable Energy Management (EM) solution with NILM. Firstly, phases of the NILM are discussed,along with the research works that have been conducted in the domain. Secondly, the contribution of machinelearning approaches in three aspects is discussed: Supervised learning, unsupervised learning, and hybridmodeling.It highlights the limitations in the applicability of ML approaches in the field. Then, the challenges in the realtimeimplementation are concerned with six use cases: Difficulty in recognizing multiple loads at a given time,cost of running the NILM system, lack of universal framework for appliance detection, anomaly detection andnew appliance identification, and complexity of the electricity loads and real-time demand side management.Furthermore, options for selecting an approach for an efficientNILMframework are suggested. Finally, suggestionsare provided for future research directions.

Identification of Software Bugs by Analyzing Natural Language-Based Requirements Using Optimized Deep Learning Features

Software project outcomes heavily depend on natural language requirements,often causing diverse interpretations and issues like ambiguities and incomplete or faulty requirements.Researchers are exploring machine learning to predict software bugs,but a more precise and general approach is needed.Accurate bug prediction is crucial for software evolution and user training,prompting an investigation into deep and ensemble learning methods.However,these studies are not generalized and efficient when extended to other datasets.Therefore,this paper proposed a hybrid approach combining multiple techniques to explore their effectiveness on bug identification problems.The methods involved feature selection,which is used to reduce the dimensionality and redundancy of features and select only the relevant ones;transfer learning is used to train and test the model on different datasets to analyze how much of the learning is passed to other datasets,and ensemble method is utilized to explore the increase in performance upon combining multiple classifiers in a model.Four National Aeronautics and Space Administration(NASA)and four Promise datasets are used in the study,showing an increase in the model’s performance by providing better Area Under the Receiver Operating Characteristic Curve(AUC-ROC)values when different classifiers were combined.It reveals that using an amalgam of techniques such as those used in this study,feature selection,transfer learning,and ensemble methods prove helpful in optimizing the software bug prediction models and providing high-performing,useful end mode.

Label Recovery and Trajectory Designable Network for Transfer Fault Diagnosis of Machines With Incorrect Annotation

The success of deep transfer learning in fault diagnosis is attributed to the collection of high-quality labeled data from the source domain.However,in engineering scenarios,achieving such high-quality label annotation is difficult and expensive.The incorrect label annotation produces two negative effects:1)the complex decision boundary of diagnosis models lowers the generalization performance on the target domain,and2)the distribution of target domain samples becomes misaligned with the false-labeled samples.To overcome these negative effects,this article proposes a solution called the label recovery and trajectory designable network(LRTDN).LRTDN consists of three parts.First,a residual network with dual classifiers is to learn features from cross-domain samples.Second,an annotation check module is constructed to generate a label anomaly indicator that could modify the abnormal labels of false-labeled samples in the source domain.With the training of relabeled samples,the complexity of diagnosis model is reduced via semi-supervised learning.Third,the adaptation trajectories are designed for sample distributions across domains.This ensures that the target domain samples are only adapted with the pure-labeled samples.The LRTDN is verified by two case studies,in which the diagnosis knowledge of bearings is transferred across different working conditions as well as different yet related machines.The results show that LRTDN offers a high diagnosis accuracy even in the presence of incorrect annotation.

Cultivation Path of Nursing Undergraduates’Scientific Research and Innovation Ability

Objective: The cultivation of the innovation ability and scientific research is one of the nursing learning objectives for undergraduate students. To explore the method and effect of training system of scientific research innovation ability of nursing undergraduates based on “3332”. Methods: Three course learning modules are constructed: stage-based course learning module, systematic project practice training module and comprehensive practice training module. A practical training platform for scientific research innovation projects is built, and undergraduate scientific research innovation ability training is carried out from both in-class and out-of-class lines. Results: Since 2017, the students have obtained 7 national innovation and entrepreneurship training programs, 52 university-level undergraduate scientific research projects, published more than 10 academic papers, and obtained 2 patent authorization. Conclusions: The training system of scientific research innovation ability of nursing undergraduates based on “3332” is conducive to the development of scientific research innovation ability of nursing students, and to cultivate nursing talents who can adapt to the development of the new era and have better post competence.

Optimal Classification of Minerals by Microscopic Image Analysis Based on Seven-State “Deep Learning” Combined with Optimizers

The development of artificial intelligence (AI), particularly deep learning, has made it possible to accelerate and improve the processing of data collected in different fields (commerce, medicine, surveillance or security, agriculture, etc.). Most related works use open source consistent image databases. This is the case for ImageNet reference data such as coco data, IP102, CIFAR-10, STL-10 and many others with variability representatives. The consistency of its images contributes to the spectacular results observed in its fields with deep learning. The application of deep learning which is making its debut in geology does not, to our knowledge, include a database of microscopic images of thin sections of open source rock minerals. In this paper, we evaluate three optimizers under the AlexNet architecture to check whether our acquired mineral images have object features or patterns that are clear and distinct to be extracted by a neural network. These are thin sections of magmatic rocks (biotite and 2-mica granite, granodiorite, simple granite, dolerite, charnokite and gabbros, etc.) which served as support. We use two hyper-parameters: the number of epochs to perform complete rounds on the entire data set and the “learning rate” to indicate how quickly the weights in the network will be modified during optimization. Using Transfer Learning, the three (3) optimizers all based on the gradient descent methods of Stochastic Momentum Gradient Descent (sgdm), Root Mean Square Propagation (RMSprop) algorithm and Adaptive Estimation of moment (Adam) achieved better performance. The recorded results indicate that the Momentum optimizer achieved the best scores respectively of 96.2% with a learning step set to 10−3 for a fixed choice of 350 epochs during this variation and 96, 7% over 300 epochs for the same value of the learning step. This performance is expected to provide excellent insight into image quality for future studies. Then they participate in the development of an intelligent system for the identification and classification of minerals, seven (7) in total (quartz, biotite, amphibole, plagioclase, feldspar, muscovite, pyroxene) and rocks.

Transfer Learning Approach to Classify the X-Ray Image that Corresponds to Corona Disease Using ResNet50 Pre-Trained by ChexNet

The COVID-19 pandemic has had a widespread negative impact globally. It shares symptoms with other respiratory illnesses such as pneumonia and influenza, making rapid and accurate diagnosis essential to treat individuals and halt further transmission. X-ray imaging of the lungs is one of the most reliable diagnostic tools. Utilizing deep learning, we can train models to recognize the signs of infection, thus aiding in the identification of COVID-19 cases. For our project, we developed a deep learning model utilizing the ResNet50 architecture, pre-trained with ImageNet and CheXNet datasets. We tackled the challenge of an imbalanced dataset, the CoronaHack Chest X-Ray dataset provided by Kaggle, through both binary and multi-class classification approaches. Additionally, we evaluated the performance impact of using Focal loss versus Cross-entropy loss in our model.

Range estimation of few-shot underwater sound source in shallow water based on transfer learning and residual CNN

Taking the real part and the imaginary part of complex sound pressure of the sound field as features,a transfer learning model is constructed.Based on the pre-training of a large amount of underwater acoustic data in the preselected sea area using the convolutional neural network(CNN),the few-shot underwater acoustic data in the test sea area are retrained to study the underwater sound source ranging problem.The S5 voyage data of SWellEX-96 experiment is used to verify the proposed method,realize the range estimation for the shallow source in the experiment,and compare the range estimation performance of the underwater target sound source of four methods:matched field processing(MFP),generalized regression neural network(GRNN),traditional CNN,and transfer learning.Experimental data processing results show that the transfer learning model based on residual CNN can effectively realize range estimation in few-shot scenes,and the estimation performance is remarkably better than that of other methods.

A Novel Hybrid Model Based on Machine and Deep Learning Techniques for the Classification of Microalgae

Classification and monitoring of microalgae species in aquatic ecosystems are important for understanding population dynamics.However,manual classification of algae is a time-consuming method and requires a lot of effort with expertise due to the large number of families and genera in its classification.The recognition of microalgae species has become an increasingly important research area in image recognition in recent years.In this study,machine learning and deep learning methods were proposed to classify images of 12 different microalgae species in order to successfully classify algae cells.8 Different novel models(MobileNetV3Small-Lr,MobileNetV3Small-Rf,MobileNetV3Small-Xg,MobileNetV3Large-Lr,MobileNetV3Large-Rf,MobileNetV3Large-Xg,Mobile-NetV3Small-Improved and MobileNetV3Large-Improved)have been proposed to classify these microalgae species.Among these proposed model structures,the best classification accuracy rate was 92.22%and the loss rate was 0.72,obtained from the MobileNetV3Large-Improved model structure.In addition,as a result of the experimental results obtained,metrics such as the confusion matrix,which can meet the experts in the correct diagnosis of microalgae species,were also evaluated.This research may in the future open a new avenue for the development of a cost-effective,highly sensitive computer-based system for the use of image analysis and deep learning techniques for the identification and classification of different microalgae.

Deep Transfer Learning Based Detection and Classification of Citrus Plant Diseases

Citrus fruit crops are among the world’s most important agricultural products,but pests and diseases impact their cultivation,resulting in yield and quality losses.Computer vision and machine learning have been widely used to detect and classify plant diseases over the last decade,allowing for early disease detection and improving agricultural production.This paper presented an automatic system for the early detection and classification of citrus plant diseases based on a deep learning(DL)model,which improved accuracy while decreasing computational complexity.The most recent transfer learning-based models were applied to the Citrus Plant Dataset to improve classification accuracy.Using transfer learning,this study successfully proposed a Convolutional Neural Network(CNN)-based pre-trained model(EfficientNetB3,ResNet50,MobiNetV2,and InceptionV3)for the identification and categorization of citrus plant diseases.To evaluate the architecture’s performance,this study discovered that transferring an EfficientNetb3 model resulted in the highest training,validating,and testing accuracies,which were 99.43%,99.48%,and 99.58%,respectively.In identifying and categorizing citrus plant diseases,the proposed CNN model outperforms other cuttingedge CNN model architectures developed previously in the literature.

Integration of Theory and Practice in Medical Morphology Curriculum in Postgraduate Training:A Flipped Classroom and Case-based Learning Exercise

Objective:The integration of training in theory and practice across the medical education spectrum is being encouraged to increase student understanding and skills in the sciences.This study aimed to determine the deciding factors that drive students'perceived advantages in class to improve precision education and the teaching model.Methods:A mixed strategy of an existing flipped classroom(FC)and a case-based learning(CBL)model was conducted in a medical morphology curriculum for 575 postgraduate students.The subjective learning evaluation of the individuals(learning time,engagement,study interest and concentration,and professional integration)was collected and analyzed after FC-CBL model learning.Results:The results from the general evaluation showed promising results of the medical morphology in the FC-CBL model.Students felt more engaged by instructors in person and benefited in terms of time-saving,flexible arrangements,and professional improvement.Our study contributed to the FC-CBL model in Research Design in postgraduate training in 4 categories:1)advancing a guideline of precision teaching according to individual characteristics;2)revealing whether a learning background is needed for a Research Design course to guide setting up a preliminary course;3)understanding the perceived advantages and their interfaces;and 4)barriers and/or improvement to implement the FC-CBL model in the Research Design class,such as a richer description of e-learning and hands-on practice.Conclusion:Undertaking a FC-CBL combined model could be a useful addition to pedagogy for medical morphology learning in postgraduate training.