Ozone Depletion Identification in Stratosphere Through Faster Region-Based Convolutional Neural Network

The concept of classification through deep learning is to build a model that skillfully separates closely-related images dataset into different classes because of diminutive but continuous variations that took place in physical systems over time and effect substantially.This study has made ozone depletion identification through classification using Faster Region-Based Convolutional Neural Network(F-RCNN).The main advantage of F-RCNN is to accumulate the bounding boxes on images to differentiate the depleted and non-depleted regions.Furthermore,image classification’s primary goal is to accurately predict each minutely varied case’s targeted classes in the dataset based on ozone saturation.The permanent changes in climate are of serious concern.The leading causes beyond these destructive variations are ozone layer depletion,greenhouse gas release,deforestation,pollution,water resources contamination,and UV radiation.This research focuses on the prediction by identifying the ozone layer depletion because it causes many health issues,e.g.,skin cancer,damage to marine life,crops damage,and impacts on living being’s immune systems.We have tried to classify the ozone images dataset into two major classes,depleted and non-depleted regions,to extract the required persuading features through F-RCNN.Furthermore,CNN has been used for feature extraction in the existing literature,and those extricated diverse RoIs are passed on to the CNN for grouping purposes.It is difficult to manage and differentiate those RoIs after grouping that negatively affects the gathered results.The classification outcomes through F-RCNN approach are proficient and demonstrate that general accuracy lies between 91%to 93%in identifying climate variation through ozone concentration classification,whether the region in the image under consideration is depleted or non-depleted.Our proposed model presented 93%accuracy,and it outperforms the prevailing techniques.

Diagnosis of primary clear cell carcinoma of the liver based on Faster region-based convolutional neural network

Background:Distinguishing between primary clear cell carcinoma of the liver(PCCCL)and common hepatocellular carcinoma(CHCC)through traditional inspection methods before the operation is difficult.This study aimed to establish a Faster region-based convolutional neural network(RCNN)model for the accurate differential diagnosis of PCCCL and CHCC.Methods:In this study,we collected the data of 62 patients with PCCCL and 1079 patients with CHCC in Beijing YouAn Hospital from June 2012 to May 2020.A total of 109 patients with CHCC and 42 patients with PCCCL were randomly divided into the training validation set and the test set in a ratio of 4:1.The Faster RCNN was used for deep learning of patients’data in the training validation set,and established a convolutional neural network model to distinguish PCCCL and CHCC.The accuracy,average precision,and the recall of the model for diagnosing PCCCL and CHCC were used to evaluate the detection performance of the Faster RCNN algorithm.Results:A total of 4392 images of 121 patients(1032 images of 33 patients with PCCCL and 3360 images of 88 patients with CHCC)were uesd in test set for deep learning and establishing the model,and 1072 images of 30 patients(320 images of nine patients with PCCCL and 752 images of 21 patients with CHCC)were used to test the model.The accuracy of the model for accurately diagnosing PCCCL and CHCC was 0.962(95%confidence interval[CI]:0.931-0.992).The average precision of the model for diagnosing PCCCL was 0.908(95%CI:0.823-0.993)and that for diagnosing CHCC was 0.907(95%CI:0.823-0.993).The recall of the model for diagnosing PCCCL was 0.951(95%CI:0.916-0.985)and that for diagnosing CHCC was 0.960(95%CI:0.854-0.962).The time to make a diagnosis using the model took an average of 4 s for each patient.Conclusion:The Faster RCNN model can accurately distinguish PCCCL and CHCC.This model could be important for clinicians to make appropriate treatment plans for patients with PCCCL or CHCC.

Establishment and application of an artificial intelligence diagnosis system for pancreatic cancer with a faster region-based convolutional neural network

Background:Early diagnosis and accurate staging are important to improve the cure rate and prognosis for pancreatic cancer.This study was performed to develop an automatic and accurate imaging processing technique system,allowing this system to read computed tomography(CT)images correctly and make diagnosis of pancreatic cancer faster.Methods:The establishment of the artificial intelligence(AI)system for pancreatic cancer diagnosis based on sequential contrastenhanced CT images were composed of two processes:training and verification.During training process,our study used all 4385 CT images from 238 pancreatic cancer patients in the database as the training data set.Additionally,we used VGG16,which was pretrained in ImageNet and contained 13 convolutional layers and three fully connected layers,to initialize the feature extraction network.In the verification experiment,we used sequential clinical CT images from 238 pancreatic cancer patients as our experimental data and input these data into the faster region-based convolution network(Faster R-CNN)model that had completed training.Totally,1699 images from 100 pancreatic cancer patients were included for clinical verification.Results:A total of 338 patients with pancreatic cancer were included in the study.The clinical characteristics(sex,age,tumor location,differentiation grade,and tumor-node-metastasis stage)between the two training and verification groups were insignificant.The mean average precision was 0.7664,indicating a good training ejffect of the Faster R-CNN.Sequential contrastenhanced CT images of 100 pancreatic cancer patients were used for clinical verification.The area under the receiver operating characteristic curve calculated according to the trapezoidal rule was 0.9632.It took approximately 0.2 s for the Faster R-CNN AI to automatically process one CT image,which is much faster than the time required for diagnosis by an imaging specialist.Conclusions:Faster R-CNN AI is an effective and objective method with high accuracy for the diagnosis of pancreatic cancer.

基于Faster-RCNN的肺结节检测算法

针对目前的肺结节检测中存在的个体差异、同病异影、同影异病的问题,提出一种大样本条件下的基于Faster-RCNN的肺结节检测算法,对比研究目前的深度学习模型的适应性,给出一种通用的随着样本数量增加肺结节检测率持续提升的策略。首先搭建深度学习的软硬件环境,设置影像数据接口与Faster-RCNN的网络接口匹配;然后搭建Faster-RCNN的单类分类网络,并对网络结构的参数进行调整优化;最后用包含2000例病人的肺结节数据集,通过不同的卷积神经网络模型(包括ZF和VGG),计算CT图像在各自模型中的特征。对测试结果进行分析评估,分别统计其漏检率、检测准确率,并探讨不同训练数量和数据增广类型对最终检测准确率的影响。最终ZF模型的检测准确率为90.82%,准确率的波动方差为13.30%;VGG模型的检测准确率为87.02%,准确率的波动方差为37.10%。ZF模型的波动方差小,检测精确度高,综合考虑,ZF模型对肺结节的检测效果优于VGG模型的检出效果。所提出的肺结节检测技术具有良好的理论价值和工程应用价值。

Faster R-CNN模型在车辆检测中的应用

针对传统机器学习方法在车辆检测应用中易受光照、目标尺度和图像质量等因素影响,效率低下且泛化能力较差的问题,提出一种基于改进的较快的基于区域卷积神经网络(R-CNN)模型的车辆检测方法。该方法以Faster R-CNN模型为基础,通过对输入图像进行卷积和池化等操作提取车辆特征,结合多尺度训练和难负样本挖掘策略降低复杂环境的影响,利用KITTI数据集对深度神经网络模型进行训练,并采集实际场景中的图像进行测试。仿真实验中,在保证检测时间的情况下,相对原Faster R-CNN算法检测精确度提高了约8%。实验结果表明,所提方法能够自动地提取车辆特征,解决了传统方法提取特征费时费力的问题,同时提高了车辆检测精确度,具有良好的泛化能力和适用范围。

一种面向自动驾驶路况的目标检测算法

为了对常见的行人和车辆进行检测,采用自行标注的数据集,通过基于faster regionbased convolutional neural network(RCNN)框架的算法进行调参与优化.主干网络采用轻量化网络MobileNetv2,在原生锚框的基础上,区域建议网络(RPN)部分增加2个面积尺度,检测部分使用感兴趣区域(ROI)Align结构,减少特征图映射和均分过程中的误差.实验结果表明:使用faster RCNN目标检测网络,可以有效完成行人和车辆的检测任务,整体效果良好.

Small objects detection in UAV aerial images based on improved Faster R-CNN

In order to solve the problem of small objects detection in unmanned aerial vehicle(UAV)aerial images with complex background,a general detection method for multi-scale small objects based on Faster region-based convolutional neural network(Faster R-CNN)is proposed.The bird’s nest on the high-voltage tower is taken as the research object.Firstly,we use the improved convolutional neural network ResNet101 to extract object features,and then use multi-scale sliding windows to obtain the object region proposals on the convolution feature maps with different resolutions.Finally,a deconvolution operation is added to further enhance the selected feature map with higher resolution,and then it taken as a feature mapping layer of the region proposals passing to the object detection sub-network.The detection results of the bird’s nest in UAV aerial images show that the proposed method can precisely detect small objects in aerial images.

基于Faster R-CNN的颜色导向火焰检测

基于深度特征的目标检测方法Faster R-CNN在火焰检测任务上存在检测效率低的问题,因此提出了基于颜色引导的抛锚策略。该策略设计火焰颜色模型来限制锚的生成,即利用火焰颜色约束锚的生成区域,从而减少了初始锚的数量,提升了计算效率。为了进一步提高网络的计算效率,将区域生成网络中的卷积层替换成掩膜卷积。为了验证所提方法的检测效果,采用BoWFire和Corsician数据集进行验证。实验结果表明,该方法实际检测速度相较于原Faster R-CNN提高了10.1%,BoWFire上该方法的火焰检测F值为0.87,Corsician上该方法的准确度可达99.33%。所提方法可以提高火焰检测的效率,并能够准确检测图像中的火焰。

Object detection of artifact threaded hole based on Faster R-CNN

In order to improve the accuracy of threaded hole object detection,combining a dual camera vision system with the Hough transform circle detection,we propose an object detection method of artifact threaded hole based on Faster region-ased convolutional neural network(Faster R-CNN).First,a dual camera image acquisition system is established.One industrial camera placed at a high position is responsible for collecting the whole image of the workpiece,and the suspected screw hole position on the workpiece can be preliminarily selected by Hough transform detection algorithm.Then,the other industrial camera is responsible for collecting the local images of the suspected screw holes that have been detected by Hough transform one by one.After that,ResNet50-based Faster R-CNN object detection model is trained on the self-built screw hole data set.Finally,the local image of the threaded hole is input into the trained Faster R-CNN object detection model for further identification and location.The experimental results show that the proposed method can effectively avoid small object detection of threaded holes,and compared with the method that only uses Hough transform or Faster RCNN object detection alone,it has high recognition and positioning accuracy.

基于Faster R-CNN的自动扶梯乘客异常位姿检测研究

针对扶梯运行时光照的变化、阴影、背景中固定对象的移动等因素严重影响机器视觉检测精度问题,为了提高对扶梯乘客位姿目标的检测精度和效率,采用VGG16卷积神经网络作为Faster-RCNN(Faster-Regions with CNN features)的基础网络,提出基于改进Faster R-CNN的扶梯乘客异常位姿实时检测改进算法。首先Faster R-CNN对视频图像进行全卷积操作得到特征图,再通过RPN层得到被测对象的类别分数以及对象物体所在原图中所在的位置,利用Faster R-CNN算法处理后的图像得到扶梯上乘客诸如下蹲、身体弯曲等异常位姿,从而判断乘客是否处于危险状态。实验结果表明:FasterR-CNN的检测算法能准确实时地识别出扶梯乘客的危险位姿,从而实现控制系统及时做出相应的安全保护措施,提高自动扶梯运行的安全性能。

基于深度学习的肺炎图像目标检测

肺炎是一种严重危害身体健康的疾病,通常使用肺部X光片进行检查。肺炎诊断是肺炎治疗前非常重要的环节,但是由于肺部其他疾病的干扰、医疗数据的爆发式增长以及专业病理医生的缺乏等,导致肺炎的准确诊断较为困难。深度学习能够模仿人脑的机制准确高效地解释医学图像数据,在肺炎图像检测方面获得了广泛应用。构建了3种基于深度学习的图像目标检测模型,单发多框探测器(SSD)、faster-RCNN和faster-RCNN优化模型,对来自Kaggle数据集的26 684张带标签的肺部X光图像进行研究。原始X光图像经预处理后输入3种深度学习模型,分别对单处和两处病灶区域进行目标检测。随机选取500张测试图像,利用损失函数、分类准确率、回归精度和误检病灶数等指标对各模型的性能进行评估。结果表明,faster-RCNN的性能指标优于SSD;Faster-RCNN优化模型的性能指标均优于其他两种模型,其损失函数值小且可快速达到稳定,平均分类准确率为93.7%,平均回归精度为79.8%,且误检病灶数为0。该方法有助于肺炎的准确识别和诊断。

可燃性粉尘云的图像检测方法

近年来粉尘爆炸引起的安全生产事故频繁发生,在线检测粉尘易集聚场所的粉尘云浓度并进行预警,成为控制粉尘爆炸的关键手段,而目前粉尘浓度传感器在大空间粉尘云聚集场所存在安装与识别局限性。为此,提出基于深度学习的可燃性粉尘云图像检测方法;采用基于卷积神经网络(CNN)的Faster R-CNN模型,对可燃性粉尘云进行端到端的检测与识别;并通过建立的粉尘云标准浓度图像数据库验证模型的有效性。结果表明:Faster R-CNN模型具有较高的识别精度。

基于迁移学习的航拍图像车辆目标检测方法研究

为有效识别航拍图片中的车辆目标,将迁移学习应用到Faster-RCNN算法模型训练中:将大规模数据集训练好的网络用于模型参数初始化,以减少训练时间并提高识别精度;针对ZF和VGG-16 2种经典网络模型,分别选取不同超参数进行了多组对比实验,以选取最优超参数,并对比分析2种模型的检测效果。实验结果表明,该种方法可以在航拍图片集中有效检测到车辆目标,检测结果优于传统的机器学习方法,同时具有识别速度快的特点,可用于实时检测,在军事侦察及交通管控等方面具有应用价值。

Deep neural network-assisted computed tomography diagnosis of metastatic lymph nodes from gastric cancer

Background:Artificial intelligence-assisted image recognition technology is currently able to detect the target area of an image and fetch information to make classifications according to target features.This study aimed to use deep neural netAVorks for computed tomography(CT)diagnosis of perigastric metastatic lymph nodes(PGMLNs)to simulate the recognition of lymph nodes by radiologists,and to acquire more accurate identification results.Methods:A total of 1371 images of suspected lymph node metastasis from enhanced abdominal CT scans were identified and labeled by radiologists and were used with 18,780 original images for faster region-based convolutional neural networks(FR-CNN)deep learning.The identification results of 6000 random CT images from 100 gastric cancer patients by the FR-CNN were compared with results obtained from radiologists in terms of their identification accuracy.Similarly,1004 CT images with metastatic lymph nodes that had been post-operatively confirmed by pathological examination and 11,340 original images were used in the identification and learning processes described above.The same 6000 gastric cancer CT images were used for the verification,according to which the diagnosis results were analyzed.Results:In the initial group,precision-recall curves were generated based on the precision rates,the recall rates of nodule classes of the training set and the validation set;the mean average precision(mAP)value was 0.5019.To verify the results of the initial learning group,the receiver operating characteristic curves was generated,and the corresponding area under the curve(AUC)value was calculated as 0.8995.After the second phase of precise learning,all the indicators were improved,and the mAP and AUC values were 0.7801 and 0.9541,respectively.Conclusion:Through deep learning,FR-CNN achieved high judgment effectiveness and recognition accuracy for CT diagnosis of PGMLNs.

基于机器视觉的路桥裂缝病害自动检测技术

为解决路桥表面因荷载作用、疲劳与腐蚀效应、材料老化以及维修养护不及时等原因产生裂缝病害的问题,进一步提高日常养护工作效率,对机器视觉技术、图像处理技术在路桥裂缝病害检测工作中的应用进行了研究。采用对比分析和数据验证相结合的方法,重点针对利用机器视觉技术实现病害特征提取、特征识别和量化计算算法进行了比较研究。研究结果显示:①采用修正后的Faster RCNN和深度可分离卷积网络能够有效减少参数数量,实现算法速度和精度的平衡;②采用小波变换滤波和KD树算法相结合的方式能够精确实现裂缝病害的连续特征提取;③基于裂缝的统计特征可快速实现病害分类。基于上述研究成果,提出并研发了一种路桥裂缝病害的自动检测方法,通过在广东省8条高速上的实例验证和模型优化,实现了路桥裂缝病害的自动化检测,精度达到95%,大幅度地提升了检测效率,有助于提高路桥的安全运行水平。

人脸检测算法的优化

面部特征被广泛应用于一系列视频监控系统,其中公安系统中人脸检测模块尤为突出。由于人脸的巨大视觉变化,如遮挡、光照、大的姿态变化问题使人脸检测一直存在着瓶颈,在实际应用中这些问题依旧很常见。对此,文中通过简要介绍候选框生成算法,同时结合FasterRCNN、联合人脸检测和对齐的级联卷积神经网络框架的优缺点进行分析和改进,提出了快速级联卷积神经网络模型。由于候选框网络和RoI检测网络共享卷积层,在候选框网络中使用多层卷积层信息,采用RoI池化和L2归一化将身体信息与面部信息进行融合,实现结合身体上下文信息来处理较小的人脸区域,并对数据集进行测试来验证模型的有效性,弥补因视觉变化导致人脸检测中的不足,提高人脸检测网络性能。

A method to generate foggy optical images based on unsupervised depth estimation

For traffic object detection in foggy environment based on convolutional neural network(CNN),data sets in fog-free environment are generally used to train the network directly.As a result,the network cannot learn the object characteristics in the foggy environment in the training set,and the detection effect is not good.To improve the traffic object detection in foggy environment,we propose a method of generating foggy images on fog-free images from the perspective of data set construction.First,taking the KITTI objection detection data set as an original fog-free image,we generate the depth image of the original image by using improved Monodepth unsupervised depth estimation method.Then,a geometric prior depth template is constructed to fuse the image entropy taken as weight with the depth image.After that,a foggy image is acquired from the depth image based on the atmospheric scattering model.Finally,we take two typical object-detection frameworks,that is,the two-stage object-detection Fster region-based convolutional neural network(Faster-RCNN)and the one-stage object-detection network YOLOv4,to train the original data set,the foggy data set and the mixed data set,respectively.According to the test results on RESIDE-RTTS data set in the outdoor natural foggy environment,the model under the training on the mixed data set shows the best effect.The mean average precision(mAP)values are increased by 5.6%and by 5.0%under the YOLOv4 model and the Faster-RCNN network,respectively.It is proved that the proposed method can effectively improve object identification ability foggy environment.

基于深度学习和灰度纹理特征的铁路接触网绝缘子状态检测

铁路接触网绝缘子状态检测对铁路行车安全有着重大的意义,为解决目前人工对绝缘子图像检测结果的不确定性,提出一种深度学习结合灰度纹理特征的检测方法。首先使用Faster R-CNN (faster region-based convolutional neural network)目标检测算法对图像中绝缘子精确识别,再通过灰度共生矩阵对绝缘子纹理特征进行分析提取,之后结合支持向量机将绝缘子分为正常绝缘子和异常绝缘子,实验数据结果证明使用能量、熵、相关度3种纹理特征进行绝缘子状态分类时对实验数据中的正常状态绝缘子的分类精度可达100%,异常状态绝缘子的分类精度达97.5%,最后依据绝缘子图像灰度分布的周期性特点,利用灰度积分投影将异常绝缘子分为破损绝缘子和夹杂异物绝缘子。实验结果表明所提方法可以有效对绝缘子状态进行检测分类。

基于膨胀卷积的多尺度焊缝缺陷检测算法

本文针对焊缝缺陷尺度变化不一导致的检测率效果不理想,提出了一种基于更快地区域卷积神经网络(faster region-based convolutional neural network, Faster R-CNN)对焊缝缺陷检测的改进算法。算法利用膨胀卷积在不同扩张率下进行特征融合,结合不同感受野下的卷积核更全面地提取不同尺度的特征信息,来提升目标的检测精度。同时利用深度可分离卷积,来对模型进行压缩,提高检测速度。实验表明,改进后的网络在保证运行速度的同时,能够提高检测速度,检测精度可以达到72%。