An otoscope is traditionally used to examine the eardrum and ear canal.A diagnosis of otitis media(OM)relies on the experience of clinicians.If an examiner lacks experience,the examination may be difficult and time-co...An otoscope is traditionally used to examine the eardrum and ear canal.A diagnosis of otitis media(OM)relies on the experience of clinicians.If an examiner lacks experience,the examination may be difficult and time-consuming.This paper presents an ear disease classification method using middle ear images based on a convolutional neural network(CNN).Especially the segmentation and classification networks are used to classify an otoscopic image into six classes:normal,acute otitis media(AOM),otitis media with effusion(OME),chronic otitis media(COM),congenital cholesteatoma(CC)and traumatic perforations(TMPs).The Mask R-CNN is utilized for the segmentation network to extract the region of interest(ROI)from otoscopic images.The extracted ROIs are used as guiding features for the classification.The classification is based on transfer learning with an ensemble of two CNN classifiers:EfficientNetB0 and Inception-V3.The proposed model was trained with a 5-fold cross-validation technique.The proposed method was evaluated and achieved a classification accuracy of 97.29%.展开更多
Face mask detection has several applications,including real-time surveillance,biometrics,etc.Identifying face masks is also helpful for crowd control and ensuring people wear them publicly.With monitoring personnel,it...Face mask detection has several applications,including real-time surveillance,biometrics,etc.Identifying face masks is also helpful for crowd control and ensuring people wear them publicly.With monitoring personnel,it is impossible to ensure that people wear face masks;automated systems are a much superior option for face mask detection and monitoring.This paper introduces a simple and efficient approach for masked face detection.The architecture of the proposed approach is very straightforward;it combines deep learning and local binary patterns to extract features and classify themasmasked or unmasked.The proposed systemrequires hardware withminimal power consumption compared to state-of-the-art deep learning algorithms.Our proposed system maintains two steps.At first,this work extracted the local features of an image by using a local binary pattern descriptor,and then we used deep learning to extract global features.The proposed approach has achieved excellent accuracy and high performance.The performance of the proposed method was tested on three benchmark datasets:the realworld masked faces dataset(RMFD),the simulated masked faces dataset(SMFD),and labeled faces in the wild(LFW).Performancemetrics for the proposed technique weremeasured in terms of accuracy,precision,recall,and F1-score.Results indicated the efficiency of the proposed technique,providing accuracies of 99.86%,99.98%,and 100%for RMFD,SMFD,and LFW,respectively.Moreover,the proposed method outperformed state-of-the-art deep learning methods in the recent bibliography for the same problem under study and on the same evaluation datasets.展开更多
A novel practical and universal method of mask-wearing detection has been proposed to prevent viral respiratory infections.The proposed method quickly and accurately detects mask and facial regions using welltrained Y...A novel practical and universal method of mask-wearing detection has been proposed to prevent viral respiratory infections.The proposed method quickly and accurately detects mask and facial regions using welltrained You Only Look Once(YOLO)detector,then applies image coordinates of the detected bounding box(bbox).First,the data that is used to train our model is collected under various circumstances such as light disturbances,distances,time variations,and different climate conditions.It also contains various mask types to detect in general and universal application of the model.To detect mask-wearing status,it is important to detect facial and mask region accurately and we created our own dataset by taking picture of images.Furthermore,the Convolutional Neural Network(CNN)model is trained with both our own dataset and open dataset to detect under heavy foot-traffic(Indoors).To make the model robust and reliable in various environment and situations,we collected various sample data in different distances.And through the experiment,we found out that there is a particular gradient according to the mask-wearing status.The proposed method searches the point where the distance between the gradient for each state and the coordinate information of the detected object is the minimum.Then it carry out the classification of mask-wearing status of detected object.Lastly,we defined and classified three different mask-wearing states according to the mask’s position(With mask,Wear a mask around chin and Without mask).The gradient according to the mask-wearing status,is analyzed through linear regression.The regression interpretation is based on coordinate information of mask-wearing status and the sample data collected in simulated environment that considering distances between objects and the camera in the World Coordinate System.Through the experiments,we found out that linear regression analysis is more suitable than logistic regression analysis for classification of people wearing masks in general-purpose environments.And the proposed method,through linear regression analysis,classifies in a very concise way than the others.展开更多
基金This study was supported by a Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Science,ICT&Future Planning NRF-2020R1A2C1014829the Soonchunhyang University Research Fund.
文摘An otoscope is traditionally used to examine the eardrum and ear canal.A diagnosis of otitis media(OM)relies on the experience of clinicians.If an examiner lacks experience,the examination may be difficult and time-consuming.This paper presents an ear disease classification method using middle ear images based on a convolutional neural network(CNN).Especially the segmentation and classification networks are used to classify an otoscopic image into six classes:normal,acute otitis media(AOM),otitis media with effusion(OME),chronic otitis media(COM),congenital cholesteatoma(CC)and traumatic perforations(TMPs).The Mask R-CNN is utilized for the segmentation network to extract the region of interest(ROI)from otoscopic images.The extracted ROIs are used as guiding features for the classification.The classification is based on transfer learning with an ensemble of two CNN classifiers:EfficientNetB0 and Inception-V3.The proposed model was trained with a 5-fold cross-validation technique.The proposed method was evaluated and achieved a classification accuracy of 97.29%.
基金Princess Nourah bint Abdulrahman University Researchers Supporting Project Number (PNURSP2023R442),Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia。
文摘Face mask detection has several applications,including real-time surveillance,biometrics,etc.Identifying face masks is also helpful for crowd control and ensuring people wear them publicly.With monitoring personnel,it is impossible to ensure that people wear face masks;automated systems are a much superior option for face mask detection and monitoring.This paper introduces a simple and efficient approach for masked face detection.The architecture of the proposed approach is very straightforward;it combines deep learning and local binary patterns to extract features and classify themasmasked or unmasked.The proposed systemrequires hardware withminimal power consumption compared to state-of-the-art deep learning algorithms.Our proposed system maintains two steps.At first,this work extracted the local features of an image by using a local binary pattern descriptor,and then we used deep learning to extract global features.The proposed approach has achieved excellent accuracy and high performance.The performance of the proposed method was tested on three benchmark datasets:the realworld masked faces dataset(RMFD),the simulated masked faces dataset(SMFD),and labeled faces in the wild(LFW).Performancemetrics for the proposed technique weremeasured in terms of accuracy,precision,recall,and F1-score.Results indicated the efficiency of the proposed technique,providing accuracies of 99.86%,99.98%,and 100%for RMFD,SMFD,and LFW,respectively.Moreover,the proposed method outperformed state-of-the-art deep learning methods in the recent bibliography for the same problem under study and on the same evaluation datasets.
基金This research was supported by a grant(2019-MOIS32-027)of Regional Specialized Disaster-Safety Research Support Program funded by the Ministry of Interior and Safety(MOIS,Korea)This work was supported by Institute of Information&communications Technology Planning&Evaluation(IITP)grant funded by the Korea government(MSIT)(No.2021-0-01972).
文摘A novel practical and universal method of mask-wearing detection has been proposed to prevent viral respiratory infections.The proposed method quickly and accurately detects mask and facial regions using welltrained You Only Look Once(YOLO)detector,then applies image coordinates of the detected bounding box(bbox).First,the data that is used to train our model is collected under various circumstances such as light disturbances,distances,time variations,and different climate conditions.It also contains various mask types to detect in general and universal application of the model.To detect mask-wearing status,it is important to detect facial and mask region accurately and we created our own dataset by taking picture of images.Furthermore,the Convolutional Neural Network(CNN)model is trained with both our own dataset and open dataset to detect under heavy foot-traffic(Indoors).To make the model robust and reliable in various environment and situations,we collected various sample data in different distances.And through the experiment,we found out that there is a particular gradient according to the mask-wearing status.The proposed method searches the point where the distance between the gradient for each state and the coordinate information of the detected object is the minimum.Then it carry out the classification of mask-wearing status of detected object.Lastly,we defined and classified three different mask-wearing states according to the mask’s position(With mask,Wear a mask around chin and Without mask).The gradient according to the mask-wearing status,is analyzed through linear regression.The regression interpretation is based on coordinate information of mask-wearing status and the sample data collected in simulated environment that considering distances between objects and the camera in the World Coordinate System.Through the experiments,we found out that linear regression analysis is more suitable than logistic regression analysis for classification of people wearing masks in general-purpose environments.And the proposed method,through linear regression analysis,classifies in a very concise way than the others.