Face mask detection has several applications,including real-time surveillance,biometrics,etc.Identifying face masks is also helpful for crowd control and ensuring people wear them publicly.With monitoring personnel,it...Face mask detection has several applications,including real-time surveillance,biometrics,etc.Identifying face masks is also helpful for crowd control and ensuring people wear them publicly.With monitoring personnel,it is impossible to ensure that people wear face masks;automated systems are a much superior option for face mask detection and monitoring.This paper introduces a simple and efficient approach for masked face detection.The architecture of the proposed approach is very straightforward;it combines deep learning and local binary patterns to extract features and classify themasmasked or unmasked.The proposed systemrequires hardware withminimal power consumption compared to state-of-the-art deep learning algorithms.Our proposed system maintains two steps.At first,this work extracted the local features of an image by using a local binary pattern descriptor,and then we used deep learning to extract global features.The proposed approach has achieved excellent accuracy and high performance.The performance of the proposed method was tested on three benchmark datasets:the realworld masked faces dataset(RMFD),the simulated masked faces dataset(SMFD),and labeled faces in the wild(LFW).Performancemetrics for the proposed technique weremeasured in terms of accuracy,precision,recall,and F1-score.Results indicated the efficiency of the proposed technique,providing accuracies of 99.86%,99.98%,and 100%for RMFD,SMFD,and LFW,respectively.Moreover,the proposed method outperformed state-of-the-art deep learning methods in the recent bibliography for the same problem under study and on the same evaluation datasets.展开更多
A face-mask object detection model incorporating hybrid dilation convolutional network termed ResNet Hybrid-dilation-convolution Face-mask-detector (RHF) is proposed in this paper. Furthermore, a lightweight face-mask...A face-mask object detection model incorporating hybrid dilation convolutional network termed ResNet Hybrid-dilation-convolution Face-mask-detector (RHF) is proposed in this paper. Furthermore, a lightweight face-mask dataset named Light Masked Face Dataset (LMFD) and a medium-sized face-mask dataset named Masked Face Dataset (MFD) with data augmentation methods applied is also constructed in this paper. The hybrid dilation convolutional network is able to expand the perception of the convolutional kernel without concern about the discontinuity of image information during the convolution process. For the given two datasets being constructed above, the trained models are significantly optimized in terms of detection performance, training time, and other related metrics. By using the MFD dataset of 55,905 images, the RHF model requires roughly 10 hours less training time compared to ResNet50 with better detection results with mAP of 93.45%.展开更多
The coronavirus(COVID-19)is a lethal virus causing a rapidly infec-tious disease throughout the globe.Spreading awareness,taking preventive mea-sures,imposing strict restrictions on public gatherings,wearing facial ma...The coronavirus(COVID-19)is a lethal virus causing a rapidly infec-tious disease throughout the globe.Spreading awareness,taking preventive mea-sures,imposing strict restrictions on public gatherings,wearing facial masks,and maintaining safe social distancing have become crucial factors in keeping the virus at bay.Even though the world has spent a whole year preventing and curing the disease caused by the COVID-19 virus,the statistics show that the virus can cause an outbreak at any time on a large scale if thorough preventive measures are not maintained accordingly.Tofight the spread of this virus,technologically developed systems have become very useful.However,the implementation of an automatic,robust,continuous,and lightweight monitoring system that can be efficiently deployed on an embedded device still has not become prevalent in the mass community.This paper aims to develop an automatic system to simul-taneously detect social distance and face mask violation in real-time that has been deployed in an embedded system.A modified version of a convolutional neural network,the ResNet50 model,has been utilized to identify masked faces in peo-ple.You Only Look Once(YOLOv3)approach is applied for object detection and the DeepSORT technique is used to measure the social distance.The efficiency of the proposed model is tested on real-time video sequences taken from a video streaming source from an embedded system,Jetson Nano edge computing device,and smartphones,Android and iOS applications.Empirical results show that the implemented model can efficiently detect facial masks and social distance viola-tions with acceptable accuracy and precision scores.展开更多
To automatically detecting whether a person is wearing mask properly,we propose a face mask detection algorithm based on hue-saturation-value(HSV)+histogram of oriented gradient(HOG)features and support vector machine...To automatically detecting whether a person is wearing mask properly,we propose a face mask detection algorithm based on hue-saturation-value(HSV)+histogram of oriented gradient(HOG)features and support vector machines(SVM).Firstly,human face and five feature points are detected with RetinaFace face detection algorithm.The feature points are used to locate to mouth and nose region,and HSV+HOG features of this region are extracted and input to SVM for training to realize detection of wearing masks or not.Secondly,RetinaFace is used to locate to nasal tip area of face,and YCrCb elliptical skin tone model is used to detect the exposure of skin in the nasal tip area,and the optimal classification threshold can be found to determine whether the wear is properly according to experimental results.Experiments show that the accuracy of detecting whether mask is worn can reach 97.9%,and the accuracy of detecting whether mask is worn correctly can reach 87.55%,which verifies the feasibility of the algorithm.展开更多
Effective strategies to control COVID-19 pandemic need high attention to mitigate negatively impacted communal health and global economy,with the brim-full horizon yet to unfold.In the absence of effective antiviral a...Effective strategies to control COVID-19 pandemic need high attention to mitigate negatively impacted communal health and global economy,with the brim-full horizon yet to unfold.In the absence of effective antiviral and limited medical resources,many measures are recommended by WHO to control the infection rate and avoid exhausting the limited medical resources.Wearing mask is among the non-pharmaceutical intervention measures that can be used as barrier to primary route of SARS-CoV2 droplets expelled by presymptomatic or asymptomatic individuals.Regardless of discourse on medical resources and diversities in masks,all countries are mandating coverings over nose and mouth in public areas.Towards contribution of public health,the aim of the paper is to devise a real-time technique that can efficiently detect non mask faces in public and thus enforce to wear mask.The proposed technique is ensemble of one stage and two stage detectors to achieve low inference time and high accuracy.We took ResNet50 as a baseline model and applied the concept of transfer learning to fuse high level semantic information in multiple feature maps.In addition,we also propose a bounding box transformation to improve localization performance during mask detection.The experiments are conducted with three popular baseline models namely ResNet50,AlexNet and MobileNet.We explored the possibility of these models to plug-in with the proposed model,so that highly accurate results can be achieved in less inference time.It is observed that the proposed technique can achieve high accuracy(98.2%)when implemented with ResNet50.Besides,the proposed model can generate 11.07%and 6.44%higher precision and recall respectively in mask detection when compared to RetinaFaceMask detector.展开更多
In recent years,the COVID-19 pandemic has negatively impacted all aspects of social life.Due to ease in the infected method,i.e.,through small liquid particles from the mouth or the nose when people cough,sneeze,speak...In recent years,the COVID-19 pandemic has negatively impacted all aspects of social life.Due to ease in the infected method,i.e.,through small liquid particles from the mouth or the nose when people cough,sneeze,speak,sing,or breathe,the virus can quickly spread and create severe problems for people’s health.According to some research as well as World Health Organization(WHO)recommendation,one of the most economical and effective methods to prevent the spread of the pandemic is to ask people to wear the face mask in the public space.A face mask will help prevent the droplet and aerosol from person to person to reduce the risk of virus infection.This simple method can reduce up to 95%of the spread of the particles.However,this solution depends heavily on social consciousness,which is sometimes unstable.In order to improve the effectiveness of wearing face masks in public spaces,this research proposes an approach for detecting and warning a person who does not wear or misuse the face mask.The approach uses the deep learning technique that relies on GoogleNet,AlexNet,and VGG16 models.The results are synthesized by an ensemble method,i.e.,the bagging technique.From the experimental results,the approach represents a more than 95%accuracy of face mask recognition.展开更多
With the rapid development of road traffic,the number of high-speed rail passengers is huge,and the flow of people is dense.In epidemic situation,it is prone to intensive infection in high-speed rail carriages,which i...With the rapid development of road traffic,the number of high-speed rail passengers is huge,and the flow of people is dense.In epidemic situation,it is prone to intensive infection in high-speed rail carriages,which is not conducive to national prevention and control work.Based on face recognition technology,the intelligent service robot for high-speed rail passengers walks in accordance with the set route and detects the face mask of high-speed rail passengers.The face database of high-speed rail passengers is compared in real time.The passengers who do not wear masks are reminded in time to reduce the risk of infection.Moreover,the robot can accurately remind the passengers of leaving the station in time,and has the functions of automatic selling and student ticket checking.The experimental result is shown to promote the further development of high-speed rail services.展开更多
基金Princess Nourah bint Abdulrahman University Researchers Supporting Project Number (PNURSP2023R442),Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia。
文摘Face mask detection has several applications,including real-time surveillance,biometrics,etc.Identifying face masks is also helpful for crowd control and ensuring people wear them publicly.With monitoring personnel,it is impossible to ensure that people wear face masks;automated systems are a much superior option for face mask detection and monitoring.This paper introduces a simple and efficient approach for masked face detection.The architecture of the proposed approach is very straightforward;it combines deep learning and local binary patterns to extract features and classify themasmasked or unmasked.The proposed systemrequires hardware withminimal power consumption compared to state-of-the-art deep learning algorithms.Our proposed system maintains two steps.At first,this work extracted the local features of an image by using a local binary pattern descriptor,and then we used deep learning to extract global features.The proposed approach has achieved excellent accuracy and high performance.The performance of the proposed method was tested on three benchmark datasets:the realworld masked faces dataset(RMFD),the simulated masked faces dataset(SMFD),and labeled faces in the wild(LFW).Performancemetrics for the proposed technique weremeasured in terms of accuracy,precision,recall,and F1-score.Results indicated the efficiency of the proposed technique,providing accuracies of 99.86%,99.98%,and 100%for RMFD,SMFD,and LFW,respectively.Moreover,the proposed method outperformed state-of-the-art deep learning methods in the recent bibliography for the same problem under study and on the same evaluation datasets.
文摘A face-mask object detection model incorporating hybrid dilation convolutional network termed ResNet Hybrid-dilation-convolution Face-mask-detector (RHF) is proposed in this paper. Furthermore, a lightweight face-mask dataset named Light Masked Face Dataset (LMFD) and a medium-sized face-mask dataset named Masked Face Dataset (MFD) with data augmentation methods applied is also constructed in this paper. The hybrid dilation convolutional network is able to expand the perception of the convolutional kernel without concern about the discontinuity of image information during the convolution process. For the given two datasets being constructed above, the trained models are significantly optimized in terms of detection performance, training time, and other related metrics. By using the MFD dataset of 55,905 images, the RHF model requires roughly 10 hours less training time compared to ResNet50 with better detection results with mAP of 93.45%.
文摘The coronavirus(COVID-19)is a lethal virus causing a rapidly infec-tious disease throughout the globe.Spreading awareness,taking preventive mea-sures,imposing strict restrictions on public gatherings,wearing facial masks,and maintaining safe social distancing have become crucial factors in keeping the virus at bay.Even though the world has spent a whole year preventing and curing the disease caused by the COVID-19 virus,the statistics show that the virus can cause an outbreak at any time on a large scale if thorough preventive measures are not maintained accordingly.Tofight the spread of this virus,technologically developed systems have become very useful.However,the implementation of an automatic,robust,continuous,and lightweight monitoring system that can be efficiently deployed on an embedded device still has not become prevalent in the mass community.This paper aims to develop an automatic system to simul-taneously detect social distance and face mask violation in real-time that has been deployed in an embedded system.A modified version of a convolutional neural network,the ResNet50 model,has been utilized to identify masked faces in peo-ple.You Only Look Once(YOLOv3)approach is applied for object detection and the DeepSORT technique is used to measure the social distance.The efficiency of the proposed model is tested on real-time video sequences taken from a video streaming source from an embedded system,Jetson Nano edge computing device,and smartphones,Android and iOS applications.Empirical results show that the implemented model can efficiently detect facial masks and social distance viola-tions with acceptable accuracy and precision scores.
基金National Natural Science Foundation of China(No.519705449)。
文摘To automatically detecting whether a person is wearing mask properly,we propose a face mask detection algorithm based on hue-saturation-value(HSV)+histogram of oriented gradient(HOG)features and support vector machines(SVM).Firstly,human face and five feature points are detected with RetinaFace face detection algorithm.The feature points are used to locate to mouth and nose region,and HSV+HOG features of this region are extracted and input to SVM for training to realize detection of wearing masks or not.Secondly,RetinaFace is used to locate to nasal tip area of face,and YCrCb elliptical skin tone model is used to detect the exposure of skin in the nasal tip area,and the optimal classification threshold can be found to determine whether the wear is properly according to experimental results.Experiments show that the accuracy of detecting whether mask is worn can reach 97.9%,and the accuracy of detecting whether mask is worn correctly can reach 87.55%,which verifies the feasibility of the algorithm.
文摘Effective strategies to control COVID-19 pandemic need high attention to mitigate negatively impacted communal health and global economy,with the brim-full horizon yet to unfold.In the absence of effective antiviral and limited medical resources,many measures are recommended by WHO to control the infection rate and avoid exhausting the limited medical resources.Wearing mask is among the non-pharmaceutical intervention measures that can be used as barrier to primary route of SARS-CoV2 droplets expelled by presymptomatic or asymptomatic individuals.Regardless of discourse on medical resources and diversities in masks,all countries are mandating coverings over nose and mouth in public areas.Towards contribution of public health,the aim of the paper is to devise a real-time technique that can efficiently detect non mask faces in public and thus enforce to wear mask.The proposed technique is ensemble of one stage and two stage detectors to achieve low inference time and high accuracy.We took ResNet50 as a baseline model and applied the concept of transfer learning to fuse high level semantic information in multiple feature maps.In addition,we also propose a bounding box transformation to improve localization performance during mask detection.The experiments are conducted with three popular baseline models namely ResNet50,AlexNet and MobileNet.We explored the possibility of these models to plug-in with the proposed model,so that highly accurate results can be achieved in less inference time.It is observed that the proposed technique can achieve high accuracy(98.2%)when implemented with ResNet50.Besides,the proposed model can generate 11.07%and 6.44%higher precision and recall respectively in mask detection when compared to RetinaFaceMask detector.
文摘In recent years,the COVID-19 pandemic has negatively impacted all aspects of social life.Due to ease in the infected method,i.e.,through small liquid particles from the mouth or the nose when people cough,sneeze,speak,sing,or breathe,the virus can quickly spread and create severe problems for people’s health.According to some research as well as World Health Organization(WHO)recommendation,one of the most economical and effective methods to prevent the spread of the pandemic is to ask people to wear the face mask in the public space.A face mask will help prevent the droplet and aerosol from person to person to reduce the risk of virus infection.This simple method can reduce up to 95%of the spread of the particles.However,this solution depends heavily on social consciousness,which is sometimes unstable.In order to improve the effectiveness of wearing face masks in public spaces,this research proposes an approach for detecting and warning a person who does not wear or misuse the face mask.The approach uses the deep learning technique that relies on GoogleNet,AlexNet,and VGG16 models.The results are synthesized by an ensemble method,i.e.,the bagging technique.From the experimental results,the approach represents a more than 95%accuracy of face mask recognition.
基金This article is supported by the 2020 Innovation and Entrepreneurship Training Program forCollege Students in Jiangsu Province(Project name:high-speed railway passenger behavior management system,No.202011460091T)This article is supported by the National Natural Science Foundation of China Youth Science Foundation project(Project name:research on Deep Discriminant Spares Representation Learning Method for Feature Extraction,No.61806098)This article is supported by Scientific Research Project of Nanjing Xiaozhuang University(Project name:multi-robot collaborative system,No.2017NXY16)。
文摘With the rapid development of road traffic,the number of high-speed rail passengers is huge,and the flow of people is dense.In epidemic situation,it is prone to intensive infection in high-speed rail carriages,which is not conducive to national prevention and control work.Based on face recognition technology,the intelligent service robot for high-speed rail passengers walks in accordance with the set route and detects the face mask of high-speed rail passengers.The face database of high-speed rail passengers is compared in real time.The passengers who do not wear masks are reminded in time to reduce the risk of infection.Moreover,the robot can accurately remind the passengers of leaving the station in time,and has the functions of automatic selling and student ticket checking.The experimental result is shown to promote the further development of high-speed rail services.