End-to-end spatial transform face detection and recognition

Background Several face detection and recogni tion methods have been proposed in the past decades that have excellent performance.The conventional face recognition pipeline comprises the following:(1)face detection,(2)face alignment,(3)feature extraction,and(4)similarity,which are independent of each other.The separate facial analysis stages lead to redundant model calculations,and are difficult for use in end-to-end training.Methods In this paper,we propose a novel end-to-end trainable convolutional network framework for face detection and recognition,in which a geometric transformation matrix is directly learned to align the faces rather than predicting the facial landmarks.In the training stage,our single CNN model is supervised only by face bounding boxes and personal identities,which are publicly available from WIDER FACE and CASIA-WebFace datasets.Our model is tested on Face Detection Dataset and Benchmark(FDDB)and Labeled Face in the Wild(LFW)datasets.Results The results show 89.24%recall for face detection tasks and 98.63%accura cy for face recognition tasks.

In-pit coal mine personnel uniqueness detection technology based on personnel positioning and face recognition

Since the coal mine in-pit personnel positioning system neither can effectively achieve the function to detect the uniqueness of in-pit coal-mine personnel nor can identify and eliminate violations in attendance management such as multiple cards for one person, and swiping one's cards by others in China at present. Therefore, the research introduces a uniqueness detection system and method for in-pit coal-mine personnel integrated into the in-pit coal mine personnel positioning system, establishing a system mode based on face recognition + recognition of personnel positioning card + release by automatic detection. Aiming at the facts that the in-pit personnel are wearing helmets and faces are prone to be stained during the face recognition, the study proposes the ideas that pre-process face images using the 2D-wavelet-transformation-based Mallat algorithm and extracts three face features: miner light, eyes and mouths, using the generalized symmetry transformation-based algorithm. This research carried out test with 40 clean face images with no helmets and 40 lightly-stained face images, and then compared with results with the one using the face feature extraction method based on grey-scale transformation and edge detection. The results show that the method described in the paper can detect accurately face features in the above-mentioned two cases, and the accuracy to detect face features is 97.5% in the case of wearing helmets and lightly-stained faces.

Frequency Domain Approach for Face Recognition Using Optical Vanderlugt Filters

In this paper human face machine identification is experienced using optical correlation techniques in spatial frequency domain. This approach is tested on ORL dataset of faces which includes face images of 40 subjects, each in 10 different positions. The examined optical setup relies on optical correlation based on developing optical Vanderlugt filters and its basics are described in this article. With the limitation of face database of 40 persons, the recognition is examined successfully with nearly 100% of accuracy in matching the input images with their respective Vanderlugt synthesized filters. Software simulation is implemented by using MATLAB for face identification.

Robust video foreground segmentation and face recognition

Face recognition provides a natural visual interface for human computer interaction （HCI） applications. The process of face recognition, however, is inhibited by variations in the appearance of face images caused by changes in lighting, expression, viewpoint, aging and introduction of occlusion. Although various algorithms have been presented for face recognition, face recognition is still a very challenging topic. A novel approach of real time face recognition for HCI is proposed in the paper. In view of the limits of the popular approaches to foreground segmentation, wavelet multi-scale transform based background subtraction is developed to extract foreground objects. The optimal selection of the threshold is automatically determined, which does not require any complex supervised training or manual experimental calibration. A robust real time face recognition algorithm is presented, which combines the projection matrixes without iteration and kernel Fisher discriminant analysis （KFDA） to overcome some difficulties existing in the real face recognition. Superior performance of the proposed algorithm is demonstrated by comparing with other algorithms through experiments. The proposed algorithm can also be applied to the video image sequences of natural HCI.

An Improved Real-Time Face Recognition System at Low Resolution Based on Local Binary Pattern Histogram Algorithm and CLAHE

This research presents an improved real-time face recognition system at a low resolution of 15 pixels with pose and emotion and resolution variations. We have designed our datasets named LRD200 and LRD100, which have been used for training and classification. The face detection part uses the Viola-Jones algorithm, and the face recognition part receives the face image from the face detection part to process it using the Local Binary Pattern Histogram (LBPH) algorithm with preprocessing using contrast limited adaptive histogram equalization (CLAHE) and face alignment. The face database in this system can be updated via our custom-built standalone android app and automatic restarting of the training and recognition process with an updated database. Using our proposed algorithm, a real-time face recognition accuracy of 78.40% at 15 px and 98.05% at 45 px have been achieved using the LRD200 database containing 200 images per person. With 100 images per person in the database (LRD100) the achieved accuracies are 60.60% at 15 px and 95% at 45 px respectively. A facial deflection of about 30° on either side from the front face showed an average face recognition precision of 72.25%-81.85%. This face recognition system can be employed for law enforcement purposes, where the surveillance camera captures a low-resolution image because of the distance of a person from the camera. It can also be used as a surveillance system in airports, bus stations, etc., to reduce the risk of possible criminal threats.

Real-Time Face Detection and Recognition in Complex Background

This paper provides efficient and robust algorithms for real-time face detection and recognition in complex backgrounds. The algorithms are implemented using a series of signal processing methods including Ada Boost, cascade classifier, Local Binary Pattern (LBP), Haar-like feature, facial image pre-processing and Principal Component Analysis (PCA). The Ada Boost algorithm is implemented in a cascade classifier to train the face and eye detectors with robust detection accuracy. The LBP descriptor is utilized to extract facial features for fast face detection. The eye detection algorithm reduces the false face detection rate. The detected facial image is then processed to correct the orientation and increase the contrast, therefore, maintains high facial recognition accuracy. Finally, the PCA algorithm is used to recognize faces efficiently. Large databases with faces and non-faces images are used to train and validate face detection and facial recognition algorithms. The algorithms achieve an overall true-positive rate of 98.8% for face detection and 99.2% for correct facial recognition.

3D face recognition algorithm based on detecting reliable components

Fisherfaces algorithm is a popular method for face recognition.However,there exist some unstable com- ponents that degrade recognition performance.In this paper,we propose a method based on detecting reliable com- ponents to overcome the problem and introduce it to 3D face recognition.The reliable components are detected within the binary feature vector,which is generated from the Fisherfaces feature vector based on statistical properties,and is used for 3D face recognition as the final feature vector.Experimental results show that the reliable components fea- ture vector is much more effective than the Fisherfaces feature vector for face recognition.

基于SSD与FaceNet的人脸识别系统设计

人脸识别技术广泛应用于考勤管理、移动支付等智慧建设中。伴随着常态化的口罩干扰,传统人脸识别算法已无法满足实际应用需求,为此,本文利用深度学习模型SSD以及FaceNet模型对人脸识别系统展开设计。首先,为消除现有数据集中亚洲人脸占比小造成的类内间距变化差距不明显的问题,在CAS-IA Web Face公开数据集的基础上对亚洲人脸数据进行扩充;其次,为解决不同口罩样式对特征提取的干扰,使用SSD人脸检测模型与DLIB人脸关键点检测模型提取人脸关键点,并利用人脸关键点与口罩的空间位置关系,额外随机生成不同的口罩人脸,组成混合数据集;最后,在混合数据集上进行模型训练并将训练好的模型移植到人脸识别系统中,进行检测速度与识别精度验证。实验结果表明,系统的实时识别速度达20 fps以上,人脸识别模型准确率在构建的混合数据集中达到97.1%,在随机抽取的部分LFW数据集验证的准确率达99.7%,故而该系统可满足实际应用需求,在一定程度上提高人脸识别的鲁棒性与准确性。

Hybrid System for Robust Faces Detection

The automatic detection of faces is a very important problem. The effectiveness of biometric authentication based on face mainly depends on the method used to locate the face in the image. This paper presents a hybrid system for faces detection in unconstrained cases in which the illumination, pose, occlusion, and size of the face are uncontrolled. To do this, the new method of detection proposed in this paper is based primarily on a technique of automatic learning by using the decision of three neural networks, a technique of energy compaction by using the discrete cosine transform, and a technique of segmentation by the color of human skin. A whole of pictures （faces and no faces） are transformed to vectors of data which will be used for learning the neural networks to separate between the two classes. Discrete cosine transform is used to reduce the dimension of the vectors, to eliminate the redundancies of information, and to store only the useful information in a minimum number of coefficients while the segmentation is used to reduce the space of research in the image. The experimental results have shown that this hybridization of methods will give a very significant improvement of the rate of the recognition, quality of detection, and the time of execution.

一种基于MTCNN和MobileFaceNet人脸检测及识别方法

随着智能设备的飞速发展,人脸检测技术在安保方面、金融方面等得到了广泛的应用。该文设计一种基于MTCNN和MobileFaceNet算法的人脸检测及识别系统。通过MTCNN算法输出人脸候选框及面部特征关键点坐标,MobileFaceNet算法根据MTCNN输出的人脸面部特征点进行识别判断,最后基于小视科技的静默活体检测算法,对移动人脸进行检测,最终实现活体检测。实验中人脸识别分数阈值设置为0.4,活体检测置信度设置为0.89,误检率较低,满足设计需求。

Facial optical flow estimation via neural non-rigid registration

Optical flow estimation in human facial video,which provides 2D correspondences between adjacent frames,is a fundamental pre-processing step for many applications,like facial expression capture and recognition.However,it is quite challenging as human facial images contain large areas of similar textures,rich expressions,and large rotations.These characteristics also result in the scarcity of large,annotated realworld datasets.We propose a robust and accurate method to learn facial optical flow in a self-supervised manner.Specifically,we utilize various shape priors,including face depth,landmarks,and parsing,to guide the self-supervised learning task via a differentiable nonrigid registration framework.Extensive experiments demonstrate that our method achieves remarkable improvements for facial optical flow estimation in the presence of significant expressions and large rotations.

基于FaceNet网络的口罩人脸识别人流监测系统

随着新冠疫情面向全球的放开,为排查新型冠状病毒肺炎感染者的时空交集人员,对各大高校场景中人员感染、二次感染等情况进行预防,以及对人员流动做有效监测,提出基于FaceNet网络改进的口罩人脸识别技术。采用MobilenetV2替换FaceNet原有的主干网络,实现戴口罩下人脸身份识别,并将社交距离算法、非接触群体测温技术进行整合,将算法技术融入树莓派4B中。通过对网络模型进行实验以及训练,相比于现有的FaceNet网络极大程度优化了识别精度、推理速度,准确率显著提升,在识别群体人脸时的召回率显著提高。使用较高配置的物联网系统,对开放后的各大高校可精确检测个体人员流动、人员体温、违反社交距离人员、个体时空交集、楼栋中各通道的人流密集度等情况,能够很好预防感染或二次感染。

An Integrated Face Tracking and Facial Expression Recognition System

This article proposes a feature extraction method for an integrated face tracking and facial expression recognition in real time video. The method proposed by Viola and Jones [1] is used to detect the face region in the first frame of the video. A rectangular bounding box is fitted over for the face region and the detected face is tracked in the successive frames using the cascaded Support vector machine (SVM) and cascaded Radial basis function neural network (RBFNN). The haar-like features are extracted from the detected face region and they are used to create a cascaded SVM and RBFNN classifiers. Each stage of the SVM classifier and RBFNN classifier rejects the non-face regions and pass the face regions to the next stage in the cascade thereby efficiently tracking the face. The performance of tracking is evaluated using one hour video data. The performance of the cascaded SVM is compared with the cascaded RBFNN. The experiment results show that the proposed cascaded SVM classifier method gives better performance over the RBFNN and also the methods described in the literature using single SVM classifier [2]. While the face is being tracked, features are extracted from the mouth region for expression recognition. The features are modelled using a multi-class SVM. The SVM finds an optimal hyperplane to distinguish different facial expressions with an accuracy of 96.0%.

基于ArcFace算法的人脸识别应用研究

针对传统课堂考勤方式的局限性,为了减少教师点名的工作量,对基于深度学习的人脸识别技术进行了研究。通过实验对比结果,使用MTCNN算法对图片进行人脸对齐处理,采用LFFD算法进行人脸检测,通过ArcFace算法完成教室课堂场景下多人图像的人脸识别。该模型在LFW人脸识别测试数据集上的准确率可以达到93.2%。将最终模型应用到无感点名系统开发中,供教师课堂点名使用,可以避免浪费课堂时间。

Suicide Ideation Detection of Covid Patients Using Machine Learning Algorithm

During Covid pandemic,many individuals are suffering from suicidal ideation in the world.Social distancing and quarantining,affects the patient emotionally.Affective computing is the study of recognizing human feelings and emotions.This technology can be used effectively during pandemic for facial expression recognition which automatically extracts the features from the human face.Monitoring system plays a very important role to detect the patient condition and to recognize the patterns of expression from the safest distance.In this paper,a new method is proposed for emotion recognition and suicide ideation detection in COVID patients.This helps to alert the nurse,when patient emotion is fear,cry or sad.The research presented in this paper has introduced Image Processing technology for emotional analysis of patients using Machine learning algorithm.The proposed Convolution Neural Networks(CNN)architecture with DnCNN preprocessing enhances the performance of recognition.The system can analyze the mood of patients either in real time or in the form of video files from CCTV cameras.The proposed method accuracy is more when compared to other methods.It detects the chances of suicide attempt based on stress level and emotional recognition.

Study on Real-Time Heart Rate Detection Based on Multi-People

Heart rate is an important vital characteristic which indicates physical and mental health status.Typically heart rate measurement instruments require direct contact with the skin which is time-consuming and costly.Therefore,the study of non-contact heart rate measurement methods is of great importance.Based on the principles of photoelectric volumetric tracing,we use a computer device and camera to capture facial images,accurately detect face regions,and to detect multiple facial images using a multi-target tracking algorithm.Then after the regional segmentation of the facial image,the signal acquisition of the region of interest is further resolved.Finally,frequency detection of the collected Photo-plethysmography(PPG)and Electrocardiography(ECG)signals is completed with peak detection,Fourier analysis,and a Waveletfilter.The experimental results show that the subject’s heart rate can be detected quickly and accurately even when monitoring multiple facial targets simultaneously.

facenet皮尔森判别网络的人脸识别方法

非限制场景下存在光照、遮挡和姿态变化等问题,这严重影响了人脸识别模型的性能和准确度。针对该问题,本文对facenet进行改进,提出了一种基于facenet皮尔森判别网络的人脸识别方法facenetPDN。首先,构建facenetPDN深度卷积神经网络,在facenet前端融合多任务级联卷积神经网络进行人脸检测提取目标人脸。然后,通过深度神经网络提取人脸深度特征信息,采用皮尔森相关系数判别模块替换facenet中的欧氏距离判别模块实现人脸深度特征判别。最后,使用CASIA-WebFace和CASIA-FaceV5人脸数据集训练网络。为了证明本文方法的有效性,训练后的模型在LFW和celeA人脸数据集进行测试和评估,并进行对比分析。实验结果表明,改进后的facenetPDN方法的准确度比原来整体提高了1.34%,在融合训练集下提高了0.78%,该算法鲁棒性和泛化能力优良,可实现多人种的人脸识别,对非限制场景下人脸目标具有良好的识别效果。

课堂考勤系统的无感知改进VIPLFaceNet人脸识别算法

针对现有课堂考勤系统检测率低和数据查询不便的问题,给出一种人脸识别的无感知课堂考勤系统。采用Android开发平台,首先,通过OkHttp3技术将前端采集的图像传入服务器;其次,调取数据库MySQL中某班级人员信息,通过改进的Fust人脸检测算法筛选出每位学生人脸图像,利用类内相似度值和类间相似度值生成VIPLFaceNet人脸识别阈值,对筛选出的人脸图像进行识别,得出考勤结果;最后,将考勤结果传入前端,管理员可以访问服务器进行考勤数据查询。实验结果表明:改进的Fust人脸检测算法召回率与VIPLFaceNet人脸识别算法识别率分别可达90.18%、98.79%。

基于FaceNet的无人值守变电站智能监控终端

为了解决无人值守变电站由于点位众多所导致的难以对进站人员实时监控的问题,本文提出了一种针对进站人员实时监测的智能分类算法,首先采用级联Haar分类器实现对监控画面中人脸图像的捕获与分离,然后基于Face Net深度人脸识别模型完成对人脸图像的特征提取。在此基础上使用支持向量机算法完成对进站人员的智能分类:对于已知人员记录姓名以及进站时间,对于陌生人执行报警功能以及其他规定动作。在实际应用中的实验结果表明,调节算法超参数将获得不同的灵敏度与识别率,经过对超参数的微调,该算法的准确率达到90%左右。基于该算法开发的监控平台已部署到智能终端上,依靠边缘计算技术实现对无人值守变电站进站人员的自动识别,并在生产实践中取得了预期的效果。

A Real-Time Integrated Face Mask Detector to Curtail Spread of Coronavirus

Effective strategies to control COVID-19 pandemic need high attention to mitigate negatively impacted communal health and global economy,with the brim-full horizon yet to unfold.In the absence of effective antiviral and limited medical resources,many measures are recommended by WHO to control the infection rate and avoid exhausting the limited medical resources.Wearing mask is among the non-pharmaceutical intervention measures that can be used as barrier to primary route of SARS-CoV2 droplets expelled by presymptomatic or asymptomatic individuals.Regardless of discourse on medical resources and diversities in masks,all countries are mandating coverings over nose and mouth in public areas.Towards contribution of public health,the aim of the paper is to devise a real-time technique that can efficiently detect non mask faces in public and thus enforce to wear mask.The proposed technique is ensemble of one stage and two stage detectors to achieve low inference time and high accuracy.We took ResNet50 as a baseline model and applied the concept of transfer learning to fuse high level semantic information in multiple feature maps.In addition,we also propose a bounding box transformation to improve localization performance during mask detection.The experiments are conducted with three popular baseline models namely ResNet50,AlexNet and MobileNet.We explored the possibility of these models to plug-in with the proposed model,so that highly accurate results can be achieved in less inference time.It is observed that the proposed technique can achieve high accuracy(98.2%)when implemented with ResNet50.Besides,the proposed model can generate 11.07%and 6.44%higher precision and recall respectively in mask detection when compared to RetinaFaceMask detector.