Wearing helmetswhile riding electric bicycles can significantly reduce head injuries resulting fromtraffic accidents.To effectively monitor compliance,the utilization of target detection algorithms through traffic cam...Wearing helmetswhile riding electric bicycles can significantly reduce head injuries resulting fromtraffic accidents.To effectively monitor compliance,the utilization of target detection algorithms through traffic cameras plays a vital role in identifying helmet usage by electric bicycle riders and recognizing license plates on electric bicycles.However,manual enforcement by traffic police is time-consuming and labor-intensive.Traditional methods face challenges in accurately identifying small targets such as helmets and license plates using deep learning techniques.This paper proposes an enhanced model for detecting helmets and license plates on electric bicycles,addressing these challenges.The proposedmodel improves uponYOLOv8n by deepening the network structure,incorporating weighted connections,and introducing lightweight convolutional modules.These modifications aim to enhance the precision of small target recognition while reducing the model’s parameters,making it suitable for deployment on low-performance devices in real traffic scenarios.Experimental results demonstrate that the model achieves an mAP@0.5 of 91.8%,showing an 11.5%improvement over the baselinemodel,with a 16.2%reduction in parameters.Additionally,themodel achieves a frames per second(FPS)rate of 58,meeting the accuracy and speed requirements for detection in actual traffic scenarios.展开更多
In this paper, we propose an efficient method for license plate localization in the images with various situations and complex background. At the first, in order to reduce problems such as low quality and low contrast...In this paper, we propose an efficient method for license plate localization in the images with various situations and complex background. At the first, in order to reduce problems such as low quality and low contrast in the vehicle images, image contrast is enhanced by the two different methods and the best for following is selected. At the second part, vertical edges of the enhanced image are extracted by sobel mask. Then the most of the noise and background edges are removed by an effective algorithm. The output of this stage is given to a morphological filtering to extract the candidate regions and finally we use several geometrical features such as area of the regions, aspect ratio and edge density to eliminate the non-plate regions and segment the plate from the input car image. This method is performed on some real images that have been captured at the different imaging conditions. The appropriate experimental results show that our proposed method is nearly independent to environmental conditions such as lightening, camera angles and camera distance from the automobile, and license plate rotation.展开更多
Multi-license plate detection in complex scenes is still a challenging task because of multiple vehicle license plates with different sizes and classes in the images having complex background.The edge features of high...Multi-license plate detection in complex scenes is still a challenging task because of multiple vehicle license plates with different sizes and classes in the images having complex background.The edge features of high-density distribution and the high curvature features of stroke turning of Chinese character are important signs to distinguish Chinese license plate from other objects.To accurately detect multiple vehicle license plates with different sizes and classes in complex scenes,a multi-object detection of Chinese license plate method based on improved YOLOv3 network was proposed in this research.The improvements include replacing the residual block of the YOLOv3 backbone network with the Inception-ResNet-A block,imbedding the SPP block into the detection network,cutting the redundant Inception-ResNet-A block to suit for the multi-license plate detection task,and clustering the ground truth boxes of license plates to obtain a new set of anchor boxes.A Chinese vehicle license plate image dataset was built for training and testing the improved network,and the location and class of the license plates in each image were accurately labeled.The dataset has 62,153 pieces of images and 4 classes of China vehicle license plates,almost images have multiple license plates with different sizes.Experiments demonstrated that the multilicense plate detection method obtained 83.4%mAP,98.88%precision,98.17%recall,98.52 F1 score,89.196 BFLOPS and 22 FPS on the test dataset,and whole performance was better than the other five compared networks including YOLOv3,SSD,Faster-RCNN,EfficientDet and RetinaNet.展开更多
License plate recognition technology use widely in intelligent trafficmanagement and control. Researchers have been committed to improving thespeed and accuracy of license plate recognition for nearly 30 years. This p...License plate recognition technology use widely in intelligent trafficmanagement and control. Researchers have been committed to improving thespeed and accuracy of license plate recognition for nearly 30 years. This paperis the first to propose combining the attention mechanism with YOLO-v5and LPRnet to construct a new license plate recognition model (LPR-CBAMNet).Through the attention mechanism CBAM(Convolutional Block AttentionModule), the importance of different feature channels in license platerecognition can be re-calibrated to obtain proper attention to features. Forceinformation to achieve the purpose of improving recognition speed andaccuracy. Experimental results show that the model construction methodis superior in speed and accuracy to traditional license plate recognitionalgorithms. The accuracy of the recognition model of the CBAM model isincreased by two percentage points to 97.2%, and the size of the constructedmodel is only 1.8 M, which can meet the requirements of real-time executionof embedded low-power devices. The codes for training and evaluating LPRCBAM-Net are available under the open-source MIT License at: https://github.com/To2rk/LPR-CBAM-Net.展开更多
This paper introduces the third enhanced version of a genetic algorithm-based technique to allow fast and accurate detection of vehicle plate numbers(VPLN)in challenging image datasets.Since binarization of the input ...This paper introduces the third enhanced version of a genetic algorithm-based technique to allow fast and accurate detection of vehicle plate numbers(VPLN)in challenging image datasets.Since binarization of the input image is the most important and difficult step in the detection of VPLN,a hybrid technique is introduced that fuses the outputs of three fast techniques into a pool of connected components objects(CCO)and hence enriches the solution space with more solution candidates.Due to the combination of the outputs of the three binarization techniques,many CCOs are produced into the output pool from which one or more sequences are to be selected as candidate solutions.The pool is filtered and submitted to a new memetic algorithm to select the best fit sequence of CCOs based on an objective distance between the tested sequence and the defined geometrical relationship matrix that represents the layout of the VPLN symbols inside the concerned plate prototype.Using any of the previous versions will give moderate results but with very low speed.Hence,a new local search is added as a memetic operator to increase the fitness of the best chromosomes based on the linear arrangement of the license plate symbols.The memetic operator speeds up the convergence to the best solution and hence compensates for the overhead of the used hybrid binarization techniques and allows for real-time detection especially after using GPUs in implementing most of the used techniques.Also,a deep convolutional network is used to detect false positives to prevent fake detection of non-plate text or similar patterns.Various image samples with a wide range of scale,orientation,and illumination conditions have been experimented with to verify the effect of the new improvements.Encouraging results with 97.55%detection precision have been reported using the recent challenging public Chinese City Parking Dataset(CCPD)outperforming the author of the dataset by 3.05%and the state-of-the-art technique by 1.45%.展开更多
In recent years,license plate recognition system(LPRS)is widely used in various places.Fast and accurate license plate detection is the first and critical step in LPRS.In order to improve the performance of license pl...In recent years,license plate recognition system(LPRS)is widely used in various places.Fast and accurate license plate detection is the first and critical step in LPRS.In order to improve the performance of license plate detection in complex environment,we propose a novel attention U-net with multilevel fusion(AUMF).At first,input images are fed to the network.Then,the feature maps of each level are generated by convolution operations of the original images.Before the feature connection,there are multi-layer splicing and convolution to detect more features.The attention mechanisms are used to retain the information of important regions.In order to ensure that the size of the input and output images are the same,down-sampling and up-sampling are employed to resize the feature mappings between the upper and lower levels.In the complex environment,the AUMF can accurately detect the license plate.To validate the effectiveness of the proposed method,we conducted a series of experiments on the AOLP dataset.The experimental results show that our approach effectively improves the performance of license plate detection under the three different license plate environments of AOLP dataset.展开更多
传统中文车牌识别方法对场景约束有要求,算法实时性差,且无法被部署在边缘设备上。针对上述问题,文中提出一种基于YOLO(You Only Look Once)的无约束场景中文车牌检测与识别方法。该方法分为车牌检测和车牌字符识别两个模块。在车牌检...传统中文车牌识别方法对场景约束有要求,算法实时性差,且无法被部署在边缘设备上。针对上述问题,文中提出一种基于YOLO(You Only Look Once)的无约束场景中文车牌检测与识别方法。该方法分为车牌检测和车牌字符识别两个模块。在车牌检测部分,使用改进的YOLOv5模型,在预测目标候选区域的基础上多预测4组关键点用于车牌矫正,并使用在COCO数据集上训练的预训练模型进行训练,减少了由环境复杂引起的误检问题,具有高实时性。在车牌字符识别部分,改进了CRNN(Convolutional Recurrent Neural Network)模型,减少了算法的参数量和计算量,使其能成功部署于各类边缘设备。实验结果表明所提出的车牌识别方法能在复杂环境中高效检测并识别车牌。文中提出的车牌检测模型在车牌检测数据集上的map值相较Retina-face提升了3.0%,车牌字符识别模型在车牌识别数据集上精确度相比LPR-Net提升了4.2%。展开更多
基金supported by the Ningxia Key Research and Development Program(Talent Introduction Special Project)Project(2022YCZX0013)North Minzu University 2022 School-Level Scientific Research Platform“Digital Agriculture Enabling Ningxia Rural Revitalization Innovation Team”(2022PT_S10)+1 种基金Yinchuan City University-Enterprise Joint Innovation Project(2022XQZD009)Ningxia Key Research and Development Program(Key Project)Project(2023BDE02001).
文摘Wearing helmetswhile riding electric bicycles can significantly reduce head injuries resulting fromtraffic accidents.To effectively monitor compliance,the utilization of target detection algorithms through traffic cameras plays a vital role in identifying helmet usage by electric bicycle riders and recognizing license plates on electric bicycles.However,manual enforcement by traffic police is time-consuming and labor-intensive.Traditional methods face challenges in accurately identifying small targets such as helmets and license plates using deep learning techniques.This paper proposes an enhanced model for detecting helmets and license plates on electric bicycles,addressing these challenges.The proposedmodel improves uponYOLOv8n by deepening the network structure,incorporating weighted connections,and introducing lightweight convolutional modules.These modifications aim to enhance the precision of small target recognition while reducing the model’s parameters,making it suitable for deployment on low-performance devices in real traffic scenarios.Experimental results demonstrate that the model achieves an mAP@0.5 of 91.8%,showing an 11.5%improvement over the baselinemodel,with a 16.2%reduction in parameters.Additionally,themodel achieves a frames per second(FPS)rate of 58,meeting the accuracy and speed requirements for detection in actual traffic scenarios.
文摘In this paper, we propose an efficient method for license plate localization in the images with various situations and complex background. At the first, in order to reduce problems such as low quality and low contrast in the vehicle images, image contrast is enhanced by the two different methods and the best for following is selected. At the second part, vertical edges of the enhanced image are extracted by sobel mask. Then the most of the noise and background edges are removed by an effective algorithm. The output of this stage is given to a morphological filtering to extract the candidate regions and finally we use several geometrical features such as area of the regions, aspect ratio and edge density to eliminate the non-plate regions and segment the plate from the input car image. This method is performed on some real images that have been captured at the different imaging conditions. The appropriate experimental results show that our proposed method is nearly independent to environmental conditions such as lightening, camera angles and camera distance from the automobile, and license plate rotation.
基金supported by the China Sichuan Science and Technology Program under Grant 2019YFG0299the Fundamental Research Funds of China West Normal University under Grant 19B045the Research Foundation for Talents of China Normal University under Grant 17YC163。
文摘Multi-license plate detection in complex scenes is still a challenging task because of multiple vehicle license plates with different sizes and classes in the images having complex background.The edge features of high-density distribution and the high curvature features of stroke turning of Chinese character are important signs to distinguish Chinese license plate from other objects.To accurately detect multiple vehicle license plates with different sizes and classes in complex scenes,a multi-object detection of Chinese license plate method based on improved YOLOv3 network was proposed in this research.The improvements include replacing the residual block of the YOLOv3 backbone network with the Inception-ResNet-A block,imbedding the SPP block into the detection network,cutting the redundant Inception-ResNet-A block to suit for the multi-license plate detection task,and clustering the ground truth boxes of license plates to obtain a new set of anchor boxes.A Chinese vehicle license plate image dataset was built for training and testing the improved network,and the location and class of the license plates in each image were accurately labeled.The dataset has 62,153 pieces of images and 4 classes of China vehicle license plates,almost images have multiple license plates with different sizes.Experiments demonstrated that the multilicense plate detection method obtained 83.4%mAP,98.88%precision,98.17%recall,98.52 F1 score,89.196 BFLOPS and 22 FPS on the test dataset,and whole performance was better than the other five compared networks including YOLOv3,SSD,Faster-RCNN,EfficientDet and RetinaNet.
基金supported in part by the Natural Science Foundation of Hainan Province under Grant 621MS017the National Natural Science Foundation of China under Grant U19B2044.
文摘License plate recognition technology use widely in intelligent trafficmanagement and control. Researchers have been committed to improving thespeed and accuracy of license plate recognition for nearly 30 years. This paperis the first to propose combining the attention mechanism with YOLO-v5and LPRnet to construct a new license plate recognition model (LPR-CBAMNet).Through the attention mechanism CBAM(Convolutional Block AttentionModule), the importance of different feature channels in license platerecognition can be re-calibrated to obtain proper attention to features. Forceinformation to achieve the purpose of improving recognition speed andaccuracy. Experimental results show that the model construction methodis superior in speed and accuracy to traditional license plate recognitionalgorithms. The accuracy of the recognition model of the CBAM model isincreased by two percentage points to 97.2%, and the size of the constructedmodel is only 1.8 M, which can meet the requirements of real-time executionof embedded low-power devices. The codes for training and evaluating LPRCBAM-Net are available under the open-source MIT License at: https://github.com/To2rk/LPR-CBAM-Net.
基金Acknowledgements: The project is supported by the National Natural Science Foundation of China (No. 40471101) and Research Foundation of Nanjing University of Information Science and Technology.
文摘This paper introduces the third enhanced version of a genetic algorithm-based technique to allow fast and accurate detection of vehicle plate numbers(VPLN)in challenging image datasets.Since binarization of the input image is the most important and difficult step in the detection of VPLN,a hybrid technique is introduced that fuses the outputs of three fast techniques into a pool of connected components objects(CCO)and hence enriches the solution space with more solution candidates.Due to the combination of the outputs of the three binarization techniques,many CCOs are produced into the output pool from which one or more sequences are to be selected as candidate solutions.The pool is filtered and submitted to a new memetic algorithm to select the best fit sequence of CCOs based on an objective distance between the tested sequence and the defined geometrical relationship matrix that represents the layout of the VPLN symbols inside the concerned plate prototype.Using any of the previous versions will give moderate results but with very low speed.Hence,a new local search is added as a memetic operator to increase the fitness of the best chromosomes based on the linear arrangement of the license plate symbols.The memetic operator speeds up the convergence to the best solution and hence compensates for the overhead of the used hybrid binarization techniques and allows for real-time detection especially after using GPUs in implementing most of the used techniques.Also,a deep convolutional network is used to detect false positives to prevent fake detection of non-plate text or similar patterns.Various image samples with a wide range of scale,orientation,and illumination conditions have been experimented with to verify the effect of the new improvements.Encouraging results with 97.55%detection precision have been reported using the recent challenging public Chinese City Parking Dataset(CCPD)outperforming the author of the dataset by 3.05%and the state-of-the-art technique by 1.45%.
基金Supported by the National Natural Science Foundation of China(62006150)Shanghai Young Science and Technology Talents Sailing Program(19YF1418400)+1 种基金Shanghai Key Laboratory of Multidimensional Information Processing(2020MIP001)Fundamental Research Funds for the Central Universities
文摘In recent years,license plate recognition system(LPRS)is widely used in various places.Fast and accurate license plate detection is the first and critical step in LPRS.In order to improve the performance of license plate detection in complex environment,we propose a novel attention U-net with multilevel fusion(AUMF).At first,input images are fed to the network.Then,the feature maps of each level are generated by convolution operations of the original images.Before the feature connection,there are multi-layer splicing and convolution to detect more features.The attention mechanisms are used to retain the information of important regions.In order to ensure that the size of the input and output images are the same,down-sampling and up-sampling are employed to resize the feature mappings between the upper and lower levels.In the complex environment,the AUMF can accurately detect the license plate.To validate the effectiveness of the proposed method,we conducted a series of experiments on the AOLP dataset.The experimental results show that our approach effectively improves the performance of license plate detection under the three different license plate environments of AOLP dataset.