Anomalous Situations Recognition in Surveillance Images Using Deep Learning

Anomalous situations in surveillance videos or images that may result in security issues,such as disasters,accidents,crime,violence,or terrorism,can be identified through video anomaly detection.However,differentiat-ing anomalous situations from normal can be challenging due to variations in human activity in complex environments such as train stations,busy sporting fields,airports,shopping areas,military bases,care centers,etc.Deep learning models’learning capability is leveraged to identify abnormal situations with improved accuracy.This work proposes a deep learning architecture called Anomalous Situation Recognition Network(ASRNet)for deep feature extraction to improve the detection accuracy of various anomalous image situations.The proposed framework has five steps.In the first step,pretraining of the proposed architecture is performed on the CIFAR-100 dataset.In the second step,the proposed pre-trained model and Inception V3 architecture are used for feature extraction by utilizing the suspicious activity recognition dataset.In the third step,serial feature fusion is performed,and then the Dragonfly algorithm is utilized for feature optimization in the fourth step.Finally,using optimized features,various Support Vector Machine(SVM)and K-Nearest Neighbor(KNN)based classification models are utilized to detect anomalous situations.The proposed framework is validated on the suspicious activity dataset by varying the number of optimized features from 100 to 1000.The results show that the proposed method is effective in detecting anomalous situations and achieves the highest accuracy of 99.24%using cubic SVM.

HybridHR-Net:Action Recognition in Video Sequences Using Optimal Deep Learning Fusion Assisted Framework

The combination of spatiotemporal videos and essential features can improve the performance of human action recognition(HAR);however,the individual type of features usually degrades the performance due to similar actions and complex backgrounds.The deep convolutional neural network has improved performance in recent years for several computer vision applications due to its spatial information.This article proposes a new framework called for video surveillance human action recognition dubbed HybridHR-Net.On a few selected datasets,deep transfer learning is used to pre-trained the EfficientNet-b0 deep learning model.Bayesian optimization is employed for the tuning of hyperparameters of the fine-tuned deep model.Instead of fully connected layer features,we considered the average pooling layer features and performed two feature selection techniques-an improved artificial bee colony and an entropy-based approach.Using a serial nature technique,the features that were selected are combined into a single vector,and then the results are categorized by machine learning classifiers.Five publically accessible datasets have been utilized for the experimental approach and obtained notable accuracy of 97%,98.7%,100%,99.7%,and 96.8%,respectively.Additionally,a comparison of the proposed framework with contemporarymethods is done to demonstrate the increase in accuracy.

A Fusion of Residual Blocks and Stack Auto Encoder Features for Stomach Cancer Classification

Diagnosing gastrointestinal cancer by classical means is a hazardous procedure.Years have witnessed several computerized solutions for stomach disease detection and classification.However,the existing techniques faced challenges,such as irrelevant feature extraction,high similarity among different disease symptoms,and the least-important features from a single source.This paper designed a new deep learning-based architecture based on the fusion of two models,Residual blocks and Auto Encoder.First,the Hyper-Kvasir dataset was employed to evaluate the proposed work.The research selected a pre-trained convolutional neural network(CNN)model and improved it with several residual blocks.This process aims to improve the learning capability of deep models and lessen the number of parameters.Besides,this article designed an Auto-Encoder-based network consisting of five convolutional layers in the encoder stage and five in the decoder phase.The research selected the global average pooling and convolutional layers for the feature extraction optimized by a hybrid Marine Predator optimization and Slime Mould optimization algorithm.These features of both models are fused using a novel fusion technique that is later classified using the Artificial Neural Network classifier.The experiment worked on the HyperKvasir dataset,which consists of 23 stomach-infected classes.At last,the proposed method obtained an improved accuracy of 93.90%on this dataset.Comparison is also conducted with some recent techniques and shows that the proposed method’s accuracy is improved.

Cache in fog computing design,concepts,contributions,and security issues in machine learning prospective

The massive growth of diversified smart devices and continuous data generation poses a challenge to communication architectures.To deal with this problem,communication networks consider fog computing as one of promising technologies that can improve overall communication performance.It brings on-demand services proximate to the end devices and delivers the requested data in a short time.Fog computing faces several issues such as latency,bandwidth,and link utilization due to limited resources and the high processing demands of end devices.To this end,fog caching plays an imperative role in addressing data dissemination issues.This study provides a comprehensive discussion of fog computing,Internet of Things(IoTs)and the critical issues related to data security and dissemination in fog computing.Moreover,we determine the fog-based caching schemes and contribute to deal with the existing issues of fog computing.Besides,this paper presents a number of caching schemes with their contributions,benefits,and challenges to overcome the problems and limitations of fog computing.We also identify machine learning-based approaches for cache security and management in fog computing,as well as several prospective future research directions in caching,fog computing,and machine learning.

A Framework of Deep Optimal Features Selection for Apple Leaf Diseases Recognition

Identifying fruit disease manually is time-consuming, expertrequired,and expensive;thus, a computer-based automated system is widelyrequired. Fruit diseases affect not only the quality but also the quantity.As a result, it is possible to detect the disease early on and cure the fruitsusing computer-based techniques. However, computer-based methods faceseveral challenges, including low contrast, a lack of dataset for training amodel, and inappropriate feature extraction for final classification. In thispaper, we proposed an automated framework for detecting apple fruit leafdiseases usingCNNand a hybrid optimization algorithm. Data augmentationis performed initially to balance the selected apple dataset. After that, twopre-trained deep models are fine-tuning and trained using transfer learning.Then, a fusion technique is proposed named Parallel Correlation Threshold(PCT). The fused feature vector is optimized in the next step using a hybridoptimization algorithm. The selected features are finally classified usingmachine learning algorithms. Four different experiments have been carriedout on the augmented Plant Village dataset and yielded the best accuracy of99.8%. The accuracy of the proposed framework is also compared to that ofseveral neural nets, and it outperforms them all.

Human Gait Recognition Based on Sequential Deep Learning and Best Features Selection

Gait recognition is an active research area that uses a walking theme to identify the subject correctly.Human Gait Recognition(HGR)is performed without any cooperation from the individual.However,in practice,it remains a challenging task under diverse walking sequences due to the covariant factors such as normal walking and walking with wearing a coat.Researchers,over the years,have worked on successfully identifying subjects using different techniques,but there is still room for improvement in accuracy due to these covariant factors.This paper proposes an automated model-free framework for human gait recognition in this article.There are a few critical steps in the proposed method.Firstly,optical flow-based motion region esti-mation and dynamic coordinates-based cropping are performed.The second step involves training a fine-tuned pre-trained MobileNetV2 model on both original and optical flow cropped frames;the training has been conducted using static hyperparameters.The third step proposed a fusion technique known as normal distribution serially fusion.In the fourth step,a better optimization algorithm is applied to select the best features,which are then classified using a Bi-Layered neural network.Three publicly available datasets,CASIA A,CASIA B,and CASIA C,were used in the experimental process and obtained average accuracies of 99.6%,91.6%,and 95.02%,respectively.The proposed framework has achieved improved accuracy compared to the other methods.

3D Kronecker Convolutional Feature Pyramid for Brain Tumor Semantic Segmentation in MR Imaging

Brain tumor significantly impacts the quality of life and changes everything for a patient and their loved ones.Diagnosing a brain tumor usually begins with magnetic resonance imaging(MRI).The manual brain tumor diagnosis from the MRO images always requires an expert radiologist.However,this process is time-consuming and costly.Therefore,a computerized technique is required for brain tumor detection in MRI images.Using the MRI,a novel mechanism of the three-dimensional(3D)Kronecker convolution feature pyramid(KCFP)is used to segment brain tumors,resolving the pixel loss and weak processing of multi-scale lesions.A single dilation rate was replaced with the 3D Kronecker convolution,while local feature learning was performed using the 3D Feature Selection(3DFSC).A 3D KCFP was added at the end of 3DFSC to resolve weak processing of multi-scale lesions,yielding efficient segmentation of brain tumors of different sizes.A 3D connected component analysis with a global threshold was used as a post-processing technique.The standard Multimodal Brain Tumor Segmentation 2020 dataset was used for model validation.Our 3D KCFP model performed exceptionally well compared to other benchmark schemes with a dice similarity coefficient of 0.90,0.80,and 0.84 for the whole tumor,enhancing tumor,and tumor core,respectively.Overall,the proposed model was efficient in brain tumor segmentation,which may facilitate medical practitioners for an appropriate diagnosis for future treatment planning.

Two-Stream Deep Learning Architecture-Based Human Action Recognition

Human action recognition(HAR)based on Artificial intelligence reasoning is the most important research area in computer vision.Big breakthroughs in this field have been observed in the last few years;additionally,the interest in research in this field is evolving,such as understanding of actions and scenes,studying human joints,and human posture recognition.Many HAR techniques are introduced in the literature.Nonetheless,the challenge of redundant and irrelevant features reduces recognition accuracy.They also faced a few other challenges,such as differing perspectives,environmental conditions,and temporal variations,among others.In this work,a deep learning and improved whale optimization algorithm based framework is proposed for HAR.The proposed framework consists of a few core stages i.e.,frames initial preprocessing,fine-tuned pre-trained deep learning models through transfer learning(TL),features fusion using modified serial based approach,and improved whale optimization based best features selection for final classification.Two pre-trained deep learning models such as InceptionV3 and Resnet101 are fine-tuned and TL is employed to train on action recognition datasets.The fusion process increases the length of feature vectors;therefore,improved whale optimization algorithm is proposed and selects the best features.The best selected features are finally classified usingmachine learning(ML)classifiers.Four publicly accessible datasets such as Ut-interaction,Hollywood,Free Viewpoint Action Recognition usingMotion History Volumes(IXMAS),and centre of computer vision(UCF)Sports,are employed and achieved the testing accuracy of 100%,99.9%,99.1%,and 100%respectively.Comparison with state of the art techniques(SOTA),the proposed method showed the improved accuracy.

Deep-Net:Fine-Tuned Deep Neural Network Multi-Features Fusion for Brain Tumor Recognition

Manual diagnosis of brain tumors usingmagnetic resonance images(MRI)is a hectic process and time-consuming.Also,it always requires an expert person for the diagnosis.Therefore,many computer-controlled methods for diagnosing and classifying brain tumors have been introduced in the literature.This paper proposes a novel multimodal brain tumor classification framework based on two-way deep learning feature extraction and a hybrid feature optimization algorithm.NasNet-Mobile,a pre-trained deep learning model,has been fine-tuned and twoway trained on original and enhancedMRI images.The haze-convolutional neural network(haze-CNN)approach is developed and employed on the original images for contrast enhancement.Next,transfer learning(TL)is utilized for training two-way fine-tuned models and extracting feature vectors from the global average pooling layer.Then,using a multiset canonical correlation analysis(CCA)method,features of both deep learning models are fused into a single feature matrix—this technique aims to enhance the information in terms of features for better classification.Although the information was increased,computational time also jumped.This issue is resolved using a hybrid feature optimization algorithm that chooses the best classification features.The experiments were done on two publicly available datasets—BraTs2018 and BraTs2019—and yielded accuracy rates of 94.8%and 95.7%,respectively.The proposedmethod is comparedwith several recent studies andoutperformed inaccuracy.In addition,we analyze the performance of each middle step of the proposed approach and find the selection technique strengthens the proposed framework.

Crops Leaf Diseases Recognition:A Framework of Optimum Deep Learning Features

Manual diagnosis of crops diseases is not an easy process;thus,a computerized method is widely used.Froma couple of years,advancements in the domain ofmachine learning,such as deep learning,have shown substantial success.However,they still faced some challenges such as similarity in disease symptoms and irrelevant features extraction.In this article,we proposed a new deep learning architecture with optimization algorithm for cucumber and potato leaf diseases recognition.The proposed architecture consists of five steps.In the first step,data augmentation is performed to increase the numbers of training samples.In the second step,pre-trained DarkNet19 deep model is opted and fine-tuned that later utilized for the training of fine-tuned model through transfer learning.Deep features are extracted from the global pooling layer in the next step that is refined using Improved Cuckoo search algorithm.The best selected features are finally classified using machine learning classifiers such as SVM,and named a few more for final classification results.The proposed architecture is tested using publicly available datasets–Cucumber National Dataset and Plant Village.The proposed architecture achieved an accuracy of 100.0%,92.9%,and 99.2%,respectively.Acomparison with recent techniques is also performed,revealing that the proposed method achieved improved accuracy while consuming less computational time.

Chest Radiographs Based Pneumothorax Detection Using Federated Learning

Pneumothorax is a thoracic condition that occurs when a person’s lungs collapse,causing air to enter the pleural cavity,the area close to the lungs and chest wall.The most persistent disease,as well as one that necessitates particular patient care and the privacy of their health records.The radiologists find it challenging to diagnose pneumothorax due to the variations in images.Deep learning-based techniques are commonly employed to solve image categorization and segmentation problems.However,it is challenging to employ it in the medical field due to privacy issues and a lack of data.To address this issue,a federated learning framework based on an Xception neural network model is proposed in this research.The pneumothorax medical image dataset is obtained from the Kaggle repository.Data preprocessing is performed on the used dataset to convert unstructured data into structured information to improve the model’s performance.Min-max normalization technique is used to normalize the data,and the features are extracted from chest Xray images.Then dataset converts into two windows to make two clients for local model training.Xception neural network model is trained on the dataset individually and aggregates model updates from two clients on the server side.To decrease the over-fitting effect,every client analyses the results three times.Client 1 performed better in round 2 with a 79.0%accuracy,and client 2 performed better in round 2 with a 77.0%accuracy.The experimental result shows the effectiveness of the federated learning-based technique on a deep neural network,reaching a 79.28%accuracy while also providing privacy to the patient’s data.

A Hybrid Attention-Based Residual Unet for Semantic Segmentation of Brain Tumor

Segmenting brain tumors in Magnetic Resonance Imaging(MRI)volumes is challenging due to their diffuse and irregular shapes.Recently,2D and 3D deep neural networks have become famous for medical image segmentation because of the availability of labelled datasets.However,3D networks can be computationally expensive and require significant training resources.This research proposes a 3D deep learning model for brain tumor segmentation that uses lightweight feature extraction modules to improve performance without compromising contextual information or accuracy.The proposed model,called Hybrid Attention-Based Residual Unet(HA-RUnet),is based on the Unet architecture and utilizes residual blocks to extract low-and high-level features from MRI volumes.Attention and Squeeze-Excitation(SE)modules are also integrated at different levels to learn attention-aware features adaptively within local and global receptive fields.The proposed model was trained on the BraTS-2020 dataset and achieved a dice score of 0.867,0.813,and 0.787,as well as a sensitivity of 0.93,0.88,and 0.83 for Whole Tumor,Tumor Core,and Enhancing Tumor,on test dataset respectively.Experimental results show that the proposed HA-RUnet model outperforms the ResUnet and AResUnet base models while having a smaller number of parameters than other state-of-the-art models.Overall,the proposed HA-RUnet model can improve brain tumor segmentation accuracy and facilitate appropriate diagnosis and treatment planning for medical practitioners.

A Framework of Deep Learning and Selection-Based Breast Cancer Detection from Histopathology Images

Breast cancer(BC)is a most spreading and deadly cancerous malady which is mostly diagnosed in middle-aged women worldwide and effecting beyond a half-million people every year.The BC positive newly diagnosed cases in 2018 reached 2.1 million around the world with a death rate of 11.6%of total cases.Early diagnosis and detection of breast cancer disease with proper treatment may reduce the number of deaths.The gold standard for BC detection is biopsy analysis which needs an expert for correct diagnosis.Manual diagnosis of BC is a complex and challenging task.This work proposed a deep learning-based(DL)solution for the early detection of this deadly disease from histopathology images.To evaluate the robustness of the proposed method a large publically available breast histopathology image database containing a total of 277524 histopathology images is utilized.The proposed automatic diagnosis of BC detection and classification mainly involves three steps.Initially,a DL model is proposed for feature extraction.Secondly,the extracted feature vector(FV)is passed to the proposed novel feature selection(FS)framework for the best FS.Finally,for the classification of BC into invasive ductal carcinoma(IDC)and normal class different machine learning(ML)algorithms are used.Experimental outcomes of the proposed methodology achieved the highest accuracy of 92.7%which shows that the proposed technique can successfully be implemented for BC detection to aid the pathologists in the early and accurate diagnosis of BC.

Hybridizing Artificial Bee Colony with Bat Algorithm for Web Service Composition

In the Internet of Things(IoT),the users have complex needs,and the Web Service Composition(WSC)was introduced to address these needs.The WSC’s main objective is to search for the optimal combination of web services in response to the user needs and the level of Quality of Services(QoS)constraints.The challenge of this problem is the huge number of web services that achieve similar functionality with different levels of QoS constraints.In this paper,we introduce an extension of our previous works on the Artificial Bee Colony(ABC)and Bat Algorithm(BA).A new hybrid algorithm was proposed between the ABC and BA to achieve a better tradeoff between local exploitation and global search.The bat agent is used to improve the solution of exhausted bees after a threshold(limits),and also an Elitist Strategy(ES)is added to BA to increase the convergence rate.The performance and convergence behavior of the proposed hybrid algorithm was tested using extensive comparative experiments with current state-ofthe-art nature-inspired algorithms on 12 benchmark datasets using three evaluation criteria(average fitness values,best fitness values,and execution time)that were measured for 30 different runs.These datasets are created from real-world datasets and artificially to form different scale sizes of WSC datasets.The results show that the proposed algorithm enhances the search performance and convergence rate on finding the near-optimal web services combination compared to competitors.TheWilcoxon signed-rank significant test is usedwhere the proposed algorithm results significantly differ fromother algorithms on 100%of datasets.

Human Personality Assessment Based on Gait Pattern Recognition Using Smartphone Sensors

Human personality assessment using gait pattern recognition is one of the most recent and exciting research domains.Gait is a person’s identity that can reflect reliable information about his mood,emotions,and substantial personality traits under scrutiny.This research focuses on recognizing key personality traits,including neuroticism,extraversion,openness to experience,agreeableness,and conscientiousness,in line with the bigfive model of personality.We inferred personality traits based on the gait pattern recognition of individuals utilizing built-in smartphone sensors.For experimentation,we collected a novel dataset of 22 participants using an android application and further segmented it into six data chunks for a critical evaluation.After data pre-processing,we extracted selected features from each data segment and then applied four multiclass machine learning algorithms for training and classifying the dataset corresponding to the users’Big-Five Personality Traits Profiles(BFPT).Experimental results and performance evaluation of the classifiers revealed the efficacy of the proposed scheme for all big-five traits.

Classification of Citrus Plant Diseases Using Deep Transfer Learning

In recent years,the field of deep learning has played an important role towards automatic detection and classification of diseases in vegetables and fruits.This in turn has helped in improving the quality and production of vegetables and fruits.Citrus fruits arewell known for their taste and nutritional values.They are one of the natural and well known sources of vitamin C and planted worldwide.There are several diseases which severely affect the quality and yield of citrus fruits.In this paper,a new deep learning based technique is proposed for citrus disease classification.Two different pre-trained deep learning models have been used in this work.To increase the size of the citrus dataset used in this paper,image augmentation techniques are used.Moreover,to improve the visual quality of images,hybrid contrast stretching has been adopted.In addition,transfer learning is used to retrain the pre-trainedmodels and the feature set is enriched by using feature fusion.The fused feature set is optimized using a meta-heuristic algorithm,the Whale Optimization Algorithm(WOA).The selected features are used for the classification of six different diseases of citrus plants.The proposed technique attains a classification accuracy of 95.7%with superior results when compared with recent techniques.

An Integrated Deep Learning Framework for Fruits Diseases Classification

:Agriculture has been an important research area in the field of image processing for the last five years.Diseases affect the quality and quantity of fruits,thereby disrupting the economy of a country.Many computerized techniques have been introduced for detecting and recognizing fruit diseases.However,some issues remain to be addressed,such as irrelevant features and the dimensionality of feature vectors,which increase the computational time of the system.Herein,we propose an integrated deep learning framework for classifying fruit diseases.We consider seven types of fruits,i.e.,apple,cherry,blueberry,grapes,peach,citrus,and strawberry.The proposed method comprises several important steps.Initially,data increase is applied,and then two different types of features are extracted.In the first feature type,texture and color features,i.e.,classical features,are extracted.In the second type,deep learning characteristics are extracted using a pretrained model.The pretrained model is reused through transfer learning.Subsequently,both types of features are merged using the maximum mean value of the serial approach.Next,the resulting fused vector is optimized using a harmonic threshold-based genetic algorithm.Finally,the selected features are classified using multiple classifiers.An evaluation is performed on the PlantVillage dataset,and an accuracy of 99%is achieved.A comparison with recent techniques indicate the superiority of the proposed method.

Recognition and Tracking of Objects in a Clustered Remote Scene Environment

Object recognition and tracking are two of the most dynamic research sub-areas that belong to the field of Computer Vision.Computer vision is one of the most active research fields that lies at the intersection of deep learning and machine vision.This paper presents an efficient ensemble algorithm for the recognition and tracking of fixed shapemoving objects while accommodating the shift and scale invariances that the object may encounter.The first part uses the Maximum Average Correlation Height(MACH)filter for object recognition and determines the bounding box coordinates.In case the correlation based MACH filter fails,the algorithms switches to a much reliable but computationally complex feature based object recognition technique i.e.,affine scale invariant feature transform(ASIFT).ASIFT is used to accommodate object shift and scale object variations.ASIFT extracts certain features from the object of interest,providing invariance in up to six affine parameters,namely translation(two parameters),zoom,rotation and two camera axis orientations.However,in this paper,only the shift and scale invariances are used.The second part of the algorithm demonstrates the use of particle filters based Approximate Proximal Gradient(APG)technique to periodically update the coordinates of the object encapsulated in the bounding box.At the end,a comparison of the proposed algorithm with other stateof-the-art tracking algorithms has been presented,which demonstrates the effectiveness of the proposed algorithm with respect to the minimization of tracking errors.

Brain Tumor Detection and Classification Using PSO and Convolutional Neural Network

Tumor detection has been an active research topic in recent years due to the high mortality rate.Computer vision(CV)and image processing techniques have recently become popular for detecting tumors inMRI images.The automated detection process is simpler and takes less time than manual processing.In addition,the difference in the expanding shape of brain tumor tissues complicates and complicates tumor detection for clinicians.We proposed a newframework for tumor detection aswell as tumor classification into relevant categories in this paper.For tumor segmentation,the proposed framework employs the Particle Swarm Optimization(PSO)algorithm,and for classification,the convolutional neural network(CNN)algorithm.Popular preprocessing techniques such as noise removal,image sharpening,and skull stripping are used at the start of the segmentation process.Then,PSO-based segmentation is applied.In the classification step,two pre-trained CNN models,alexnet and inception-V3,are used and trained using transfer learning.Using a serial approach,features are extracted from both trained models and fused features for final classification.For classification,a variety of machine learning classifiers are used.Average dice values on datasets BRATS-2018 and BRATS-2017 are 98.11 percent and 98.25 percent,respectively,whereas average jaccard values are 96.30 percent and 96.57%(Segmentation Results).The results were extended on the same datasets for classification and achieved 99.0%accuracy,sensitivity of 0.99,specificity of 0.99,and precision of 0.99.Finally,the proposed method is compared to state-of-the-art existingmethods and outperforms them.

Automatic Heart Disease Detection by Classification of Ventricular Arrhythmias on ECG Using Machine Learning

This paper focuses on detecting diseased signals and arrhythmias classification into two classes:ventricular tachycardia and premature ventricular contraction.The sole purpose of the signal detection is used to determine if a signal has been collected from a healthy or sick person.The proposed research approach presents a mathematical model for the signal detector based on calculating the instantaneous frequency(IF).Once a signal taken from a patient is detected,then the classifier takes that signal as input and classifies the target disease by predicting the class label.While applying the classifier,templates are designed separately for ventricular tachycardia and premature ventricular contraction.Similarities of a given signal with both the templates are computed in the spectral domain.The empirical analysis reveals precisions for the detector and the applied classifier are 100%and 77.27%,respectively.Moreover,instantaneous frequency analysis provides a benchmark that IF of a normal signal ranges from 0.8 to 1.1 Hz whereas IF range for ventricular tachycardia and premature ventricular contraction is 0.08–0.6 Hz.This indicates a serious loss of high-frequency contents in the spectrum,implying that the heart’s overall activity is slowed down.This study may help medical practitioners in detecting the heart disease type based on signal analysis.