BLS-identification:A device fingerprint classification mechanism based on broad learning for Internet of Things

The popularity of the Internet of Things(IoT)has enabled a large number of vulnerable devices to connect to the Internet,bringing huge security risks.As a network-level security authentication method,device fingerprint based on machine learning has attracted considerable attention because it can detect vulnerable devices in complex and heterogeneous access phases.However,flexible and diversified IoT devices with limited resources increase dif-ficulty of the device fingerprint authentication method executed in IoT,because it needs to retrain the model network to deal with incremental features or types.To address this problem,a device fingerprinting mechanism based on a Broad Learning System(BLS)is proposed in this paper.The mechanism firstly characterizes IoT devices by traffic analysis based on the identifiable differences of the traffic data of IoT devices,and extracts feature parameters of the traffic packets.A hierarchical hybrid sampling method is designed at the preprocessing phase to improve the imbalanced data distribution and reconstruct the fingerprint dataset.The complexity of the dataset is reduced using Principal Component Analysis(PCA)and the device type is identified by training weights using BLS.The experimental results show that the proposed method can achieve state-of-the-art accuracy and spend less training time than other existing methods.

Prediction of Geopolymer Concrete Compressive Strength Using Convolutional Neural Networks

Geopolymer concrete emerges as a promising avenue for sustainable development and offers an effective solution to environmental problems.Its attributes as a non-toxic,low-carbon,and economical substitute for conventional cement concrete,coupled with its elevated compressive strength and reduced shrinkage properties,position it as a pivotal material for diverse applications spanning from architectural structures to transportation infrastructure.In this context,this study sets out the task of using machine learning(ML)algorithms to increase the accuracy and interpretability of predicting the compressive strength of geopolymer concrete in the civil engineering field.To achieve this goal,a new approach using convolutional neural networks(CNNs)has been adopted.This study focuses on creating a comprehensive dataset consisting of compositional and strength parameters of 162 geopolymer concrete mixes,all containing Class F fly ash.The selection of optimal input parameters is guided by two distinct criteria.The first criterion leverages insights garnered from previous research on the influence of individual features on compressive strength.The second criterion scrutinizes the impact of these features within the model’s predictive framework.Key to enhancing the CNN model’s performance is the meticulous determination of the optimal hyperparameters.Through a systematic trial-and-error process,the study ascertains the ideal number of epochs for data division and the optimal value of k for k-fold cross-validation—a technique vital to the model’s robustness.The model’s predictive prowess is rigorously assessed via a suite of performance metrics and comprehensive score analyses.Furthermore,the model’s adaptability is gauged by integrating a secondary dataset into its predictive framework,facilitating a comparative evaluation against conventional prediction methods.To unravel the intricacies of the CNN model’s learning trajectory,a loss plot is deployed to elucidate its learning rate.The study culminates in compelling findings that underscore the CNN model’s accurate prediction of geopolymer concrete compressive strength.To maximize the dataset’s potential,the application of bivariate plots unveils nuanced trends and interactions among variables,fortifying the consistency with earlier research.Evidenced by promising prediction accuracy,the study’s outcomes hold significant promise in guiding the development of innovative geopolymer concrete formulations,thereby reinforcing its role as an eco-conscious and robust construction material.The findings prove that the CNN model accurately estimated geopolymer concrete’s compressive strength.The results show that the prediction accuracy is promising and can be used for the development of new geopolymer concrete mixes.The outcomes not only underscore the significance of leveraging technology for sustainable construction practices but also pave the way for innovation and efficiency in the field of civil engineering.

Visualization for Explanation of Deep Learning-Based Defect Detection Model Using Class Activation Map

Recently,convolutional neural network(CNN)-based visual inspec-tion has been developed to detect defects on building surfaces automatically.The CNN model demonstrates remarkable accuracy in image data analysis;however,the predicted results have uncertainty in providing accurate informa-tion to users because of the“black box”problem in the deep learning model.Therefore,this study proposes a visual explanation method to overcome the uncertainty limitation of CNN-based defect identification.The visual repre-sentative gradient-weights class activation mapping(Grad-CAM)method is adopted to provide visually explainable information.A visualizing evaluation index is proposed to quantitatively analyze visual representations;this index reflects a rough estimate of the concordance rate between the visualized heat map and intended defects.In addition,an ablation study,adopting three-branch combinations with the VGG16,is implemented to identify perfor-mance variations by visualizing predicted results.Experiments reveal that the proposed model,combined with hybrid pooling,batch normalization,and multi-attention modules,achieves the best performance with an accuracy of 97.77%,corresponding to an improvement of 2.49%compared with the baseline model.Consequently,this study demonstrates that reliable results from an automatic defect classification model can be provided to an inspector through the visual representation of the predicted results using CNN models.

Deep Learning Based Sentiment Analysis of COVID-19 Tweets via Resampling and Label Analysis

Twitter has emerged as a platform that produces new data every day through its users which can be utilized for various purposes.People express their unique ideas and views onmultiple topics thus providing vast knowledge.Sentiment analysis is critical from the corporate and political perspectives as it can impact decision-making.Since the proliferation of COVID-19,it has become an important challenge to detect the sentiment of COVID-19-related tweets so that people’s opinions can be tracked.The purpose of this research is to detect the sentiment of people regarding this problem with limited data as it can be challenging considering the various textual characteristics that must be analyzed.Hence,this research presents a deep learning-based model that utilizes the positives of random minority oversampling combined with class label analysis to achieve the best results for sentiment analysis.This research specifically focuses on utilizing class label analysis to deal with the multiclass problem by combining the class labels with a similar overall sentiment.This can be particularly helpful when dealing with smaller datasets.Furthermore,our proposed model integrates various preprocessing steps with random minority oversampling and various deep learning algorithms including standard deep learning and bi-directional deep learning algorithms.This research explores several algorithms and their impact on sentiment analysis tasks and concludes that bidirectional neural networks do not provide any advantage over standard neural networks as standard Neural Networks provide slightly better results than their bidirectional counterparts.The experimental results validate that our model offers excellent results with a validation accuracy of 92.5%and an F1 measure of 0.92.

Challenges and limitations of synthetic minority oversampling techniques in machine learning

Oversampling is the most utilized approach to deal with class-imbalanced datasets,as seen by the plethora of oversampling methods developed in the last two decades.We argue in the following editorial the issues with oversampling that stem from the possibility of overfitting and the generation of synthetic cases that might not accurately represent the minority class.These limitations should be considered when using oversampling techniques.We also propose several alternate strategies for dealing with imbalanced data,as well as a future work perspective.

Advancing COVID-19 Diagnosis with CNNs: An Empirical Study of Learning Rates and Optimization Strategies

The rapid spread of the novel Coronavirus (COVID-19) has emphasized the necessity for advanced diagnostic tools to enhance the detection and management of the virus. This study investigates the effectiveness of Convolutional Neural Networks (CNNs) in the diagnosis of COVID-19 from chest X-ray and CT images, focusing on the impact of varying learning rates and optimization strategies. Despite the abundance of chest X-ray datasets from various institutions, the lack of a dedicated COVID-19 dataset for computational analysis presents a significant challenge. Our work introduces an empirical analysis across four distinct learning rate policies—Cyclic, Step Based, Time-Based, and Epoch Based—each tested with four different optimizers: Adam, Adagrad, RMSprop, and Stochastic Gradient Descent (SGD). The performance of these configurations was evaluated in terms of training and validation accuracy over 100 epochs. Our results demonstrate significant differences in model performance, with the Cyclic learning rate policy combined with SGD optimizer achieving the highest validation accuracy of 83.33%. This study contributes to the existing body of knowledge by outlining effective CNN configurations for COVID-19 image dataset analysis, offering insights into the optimization of machine learning models for the diagnosis of infectious diseases. Our findings underscore the potential of CNNs in supplementing traditional PCR tests, providing a computational approach to identify patterns in chest X-rays and CT scans indicative of COVID-19, thereby aiding in the swift and accurate diagnosis of the virus.

Deep learning-based fault diagnostic network of high-speed train secondary suspension systems for immunity to track irregularities and wheel wear

Fault detection and isolation of high-speed train suspension systems is of critical importance to guarantee train running safety. Firstly, the existing methods concerning fault detection or isolation of train suspension systems are briefly reviewed and divided into two categories, i.e., model-based and data-driven approaches. The advantages and disadvantages of these two categories of approaches are briefly summarized. Secondly, a 1D convolution network-based fault diagnostic method for highspeed train suspension systems is designed. To improve the robustness of the method, a Gaussian white noise strategy(GWN-strategy) for immunity to track irregularities and an edge sample training strategy(EST-strategy) for immunity to wheel wear are proposed. The whole network is called GWN-EST-1 DCNN method. Thirdly, to show the performance of this method, a multibody dynamics simulation model of a high-speed train is built to generate the lateral acceleration of a bogie frame corresponding to different track irregularities, wheel profiles, and secondary suspension faults. The simulated signals are then inputted into the diagnostic network, and the results show the correctness and superiority of the GWN-EST-1DCNN method. Finally,the 1DCNN method is further validated using tracking data of a CRH3 train running on a high-speed railway line.

Learning curve of transumbilical suture-suspension single-incision laparoscopic cholecystectomy

AIM: To investigate the learning curve of transumbilical suture-suspension single-incision laparoscopic cholecystectomy (SILC). METHODS: The clinical data of 180 consecutive transumbilical suture-suspension SILCs performed by a team in our department during the period from August 2009 to March 2011 were retrospectively analyzed. Patients were divided into nine groups according to operation dates, and each group included 20 patients operated on consecutively in each time period. The surgical outcome was assessed by comparing operation time, blood loss during operation, and complications between groups in order to evaluate the improvement in technique.RESULTS: A total of 180 SILCs were successfully performed by five doctors. The average operation time was 53.58 ± 30.08 min (range: 20.00-160.00 min) and average blood loss was 12.70 ± 11.60 mL (range: 0.00-100.00 mL). None of the patients were converted to laparotomy or multi-port laparoscopic cholecystectomy. There were no major complications such as hemorrhage or biliary system injury during surgery. Eight postoperative complications occurred mainly in the first three groups (n = 6), and included ecchymosis around the umbilical incision (n = 7) which resolved without special treatment, and one case of delayed bile leakage in group 8, which was treated by ultrasound-guided puncture and drainage. There were no differences in intraoperative blood loss, postoperative complications and length of postoperative hospital stay among the groups. Bonferroni's test showed that the operation time in group 1 was significantly longer than that in the other groups (F = 7.257, P = 0.000). The majority of patients in each group were discharged within 2 d, with an average postoperative hospital stay of 1.9 ± 1.2 d. CONCLUSION: Following scientific principles and standard procedures, a team experienced in multi-port laparoscopic cholecystectomy can master the technique of SILC after 20 cases.

Applying machine learning for cars’semi-active air suspension under soft and rigid roads

To improve the ride quality and enhance the control efficiency of cars’semi-active air suspensions(SASs)under various surfaces of soft and rigid roads,a machine learning(ML)method is proposed based on the optimized rules of the fuzzy control(FC)method and car dynamic model for application in SASs.The root-mean-square(RMS)acceleration of the driver’s seat and car’s pitch angle are chosen as the objective functions.The results indicate that a soft surface obviously influences a car’s ride quality,particularly when it is traveling at a high-velocity range of over 72 km/h.Using the ML method,the car’s ride quality is improved as compared to those of FC and without control under different simulation conditions.In particular,compared with those cars without control,the RMS acceleration of the driver’s seat and car’s pitch angle using the ML method are respectively reduced by 30.20% and 19.95% on the soft road and 34.36% and 21.66% on the rigid road.In addition,to optimize the ML efficiency,its learning data need to be updated under all various operating conditions of cars.

Development and Analysis of a Machine Learning Based Software for Assisting Online Classes during COVID-19

Amid the Covid-19 widespread, it has been challenging for educational institutions to conduct online classes, facing multiples challenges. This paper provides an insight into different approaches in facing those challenges which includes conducting a fair online class for students. It is tough for an instructor to keep track of their students at the same time because it is difficult to screen if any of the understudies within the class are not present, mindful, or drowsing. This paper discusses a possible solution, something new that can offer support to instructors seeing things from a more significant point of view. The solution is a facial analysis computer program that can let instructors know which students are attentive and who is not. There’s a green and red square box for face detection, for which Instructors can watch by seeing a green box on those mindful students conjointly, a red box on those who are not mindful at all. This paper finds that the program can automatically give attendance by analyzing data from face detection. It has other features for which the teacher can also know if any student leaves the class early. In this paper, model design, performance analysis, and online class assistant aspects of the program have been discussed.

A Study on the improvement strategies to Effectiveness of Online Teaching and Learning in EFL Classes in College

English online learning has been common trend in the world, how to teach and learn effectively in EFL classes through online environment is an urgent study. The purpose of the study to analyze the factors of affecting the effectiveness of online teaching and learning in EFL classes in college. We build up a three-dimensional model in the perspective of teacher, learner and technology. And we propose the strategies of improving the effectiveness of online teaching and learning in EFL classes in college in the dimensions of teacher, learner and technology.

Application of Student-centered Learning Approach to English Listening and Speaking Class in Vocational Schools

Student-centered learning approach is focused on the students' demands and interests.Applying student-centered approach puts forward higher requirement to English teachers.This article first analyzes the theory of student-centered learning approach and compares teacher-centered approach with it.Based on the research information and teaching experience,the author summarizes four strategies about how to apply student-centered learning approach to English listening and speaking class in vocational schools.

A review of addressing class noise problems of remote sensing classification

The development of image classification is one of the most important research topics in remote sensing. The prediction accuracy depends not only on the appropriate choice of the machine learning method but also on the quality of the training datasets. However, real-world data is not perfect and often suffers from noise. This paper gives an overview of noise filtering methods. Firstly, the types of noise and the consequences of class noise on machine learning are presented. Secondly, class noise handling methods at both the data level and the algorithm level are introduced. Then ensemble-based class noise handling methods including class noise removal, correction, and noise robust ensemble learners are presented. Finally, a summary of existing data-cleaning techniques is given.

The Effects of Cooperative-learning in the Oral English Class

Oral English teaching is one of the essential parts in language teaching. However, the oral English teaching in Chinese college English large-scale classes is far from satisfactory. In the instruction process arise a variety of problems such as the passiveness of learners, the failure of timely feedback transmission and fewer chances of oral English practice.This study aims to probe into the effects of cooperative-learning in the oral English teaching of large-scale classes. It is the author's belief that cooperative learning may effectively improve college oral English teaching in large-scale classes.

A New Pattern to Research the Learning:From Phenomenography and Constructivism Perspective——The Case of Guangzhou Academy of Fine Arts

This essay is trying to explore how the arts students experience the teaching and learning context in the English class of the col lege from the phenomenography perspective.The qualitative research methodology of phenomenography has traditionally required a man ual sorting and analysis of interview data.To study the teaching and learning context,the qualitative research method will be applied,and the data collection will base on the face-to-face interview.There are 8 sophomores were interviewed after they had one year study in col lege.The research findings reveal that most student in interview gradually get used to college English class,but never think about changing their learning approach even they study one year in a totally different teaching and learning environment.

Integrating deep learning and logging data analytics for lithofacies classification and 3D modeling of tight sandstone reservoirs

The lithofacies classification is essential for oil and gas reservoir exploration and development.The traditional method of lithofacies classification is based on"core calibration logging"and the experience of geologists.This approach has strong subjectivity,low efficiency,and high uncertainty.This uncertainty may be one of the key factors affecting the results of 3 D modeling of tight sandstone reservoirs.In recent years,deep learning,which is a cutting-edge artificial intelligence technology,has attracted attention from various fields.However,the study of deep-learning techniques in the field of lithofacies classification has not been sufficient.Therefore,this paper proposes a novel hybrid deep-learning model based on the efficient data feature-extraction ability of convolutional neural networks(CNN)and the excellent ability to describe time-dependent features of long short-term memory networks(LSTM)to conduct lithological facies-classification experiments.The results of a series of experiments show that the hybrid CNN-LSTM model had an average accuracy of 87.3%and the best classification effect compared to the CNN,LSTM or the three commonly used machine learning models(Support vector machine,random forest,and gradient boosting decision tree).In addition,the borderline synthetic minority oversampling technique(BSMOTE)is introduced to address the class-imbalance issue of raw data.The results show that processed data balance can significantly improve the accuracy of lithofacies classification.Beside that,based on the fine lithofacies constraints,the sequential indicator simulation method is used to establish a three-dimensional lithofacies model,which completes the fine description of the spatial distribution of tight sandstone reservoirs in the study area.According to this comprehensive analysis,the proposed CNN-LSTM model,which eliminates class imbalance,can be effectively applied to lithofacies classification,and is expected to improve the reality of the geological model for the tight sandstone reservoirs.

Iterative Semi-Supervised Learning Using Softmax Probability

For the classification problem in practice,one of the challenging issues is to obtain enough labeled data for training.Moreover,even if such labeled data has been sufficiently accumulated,most datasets often exhibit long-tailed distribution with heavy class imbalance,which results in a biased model towards a majority class.To alleviate such class imbalance,semisupervised learning methods using additional unlabeled data have been considered.However,as a matter of course,the accuracy is much lower than that from supervised learning.In this study,under the assumption that additional unlabeled data is available,we propose the iterative semi-supervised learning algorithms,which iteratively correct the labeling of the extra unlabeled data based on softmax probabilities.The results show that the proposed algorithms provide the accuracy as high as that from the supervised learning.To validate the proposed algorithms,we tested on the two scenarios:with the balanced unlabeled dataset and with the imbalanced unlabeled dataset.Under both scenarios,our proposed semi-supervised learning algorithms provided higher accuracy than previous state-of-the-arts.Code is available at https://github.com/HeewonChung92/iterative-semi-learning.

Outside Class Reading Contributes to English Learning --A Survey of Non-English Major University Students＇ Opinions on the Relation between Outside Class Reading in English and English Learning

The writer makes a survey among her students to know their opinions on the relation between outside class reading in English and English learning. After the analysis of the results, this paper points out that outside class reading plays a positive role in English learning. Furthermore, some suggestions are made in the end.

Decoding of Raman spectroscopy-encoded suspension arrays based on the detail constraint cycle domain adaptive model

Previous studies have already shown that Raman spectroscopy can be used in the encoding of suspension array technology.However,almost all existing convolutional neural network-based decoding approaches rely on supervision with ground truth,and may not be well generalized to unseen datasets,which were collected under different experimental conditions,applying with the same coded material.In this study,we propose an improved model based on CyCADA,named as Detail constraint Cycle Domain Adaptive Model(DCDA).DCDA implements the clasification of unseen datasets through domain adaptation,adapts representations at the encode level with decoder-share,and enforces coding features while leveraging a feat loss.To improve detailed structural constraints,DCDA takes downsample connection and skips connection.Our model improves the poor generalization of existing models and saves the cost of the labeling process for unseen target datasets.Compared with other models,extensive experiments and ablation studies show the superiority of DCDA in terms of classification stability and generalization.The model proposed by the research achieves a classification with an accuracy of 100%when applied in datasets,in which the spectrum in the source domain is far less than the target domain.