The crack is a common pavement failure problem.A lack of periodic maintenance will result in extending the cracks and damage the pavement,which will affect the normal use of the road.Therefore,it is significant to est...The crack is a common pavement failure problem.A lack of periodic maintenance will result in extending the cracks and damage the pavement,which will affect the normal use of the road.Therefore,it is significant to establish an efficient intelligent identification model for pavement cracks.The neural network is a method of simulating animal nervous systems using gradient descent to predict results by learning a weight matrix.It has been widely used in geotechnical engineering,computer vision,medicine,and other fields.However,there are three major problems in the application of neural networks to crack identification.There are too few layers,extracted crack features are not complete,and the method lacks the efficiency to calculate the whole picture.In this study,a fully convolutional neural network based on ResNet-101 is used to establish an intelligent identification model of pavement crack regions.This method,using a convolutional layer instead of a fully connected layer,realizes full convolution and accelerates calculation.The region proposals come from the feature map at the end of the base network,which avoids multiple computations of the same picture.Online hard example mining and data-augmentation techniques are adopted to improve the model’s recognition accuracy.We trained and tested Concrete Crack Images for Classification(CCIC),which is a public dataset collected using smartphones,and the Crack Image Database(CIDB),which was automatically collected using vehicle-mounted charge-coupled device cameras,with identification accuracy reaching 91.4%and 86.4%,respectively.The proposed model has a higher recognition accuracy and recall rate than Faster RCNN and different depth models,and can extract more complete and accurate crack features in CIDB.We also analyzed translation processing,fuzzy,scaling,and distorted images.The proposed model shows a strong robustness and stability,and can automatically identify image cracks of different forms.It has broad application prospects in practical engineering problems.展开更多
Conforming to the rapidly increasing market demand of crack detection for tall buildings,the idea of integrating deep network technology into wall-climbing robot for crack detection is put forward in this paper.Taking...Conforming to the rapidly increasing market demand of crack detection for tall buildings,the idea of integrating deep network technology into wall-climbing robot for crack detection is put forward in this paper.Taking the dependence and hardware requirements when deployed on such edge devices as Raspberry Pi into consideration,the Darknet neural network is selected as the basic framework for detection.In order to improve the inference efficiency on edge devices and avoid the possible premature over-fitting of deep networks,the lite YOLOv4-tiny algorithm is then improved from the original YOLOv4-tiny algorithm and its structure is illustrated using Netron accordingly.The images downloaded from Internet and taken from the buildings in campus are processed to form crack detection data sets,which are trained on personal computer with the AlexeyAB version of Darknet to generate weight files.Meanwhile,the AlexeyAB version of Darknet accelerated by NNpack package is deployed on Raspberry Pi 4B,and the crack detection experiments are carried out.Some characteristics,e.g.,fast speed and lower false detection rate of the lite YOLOv4-tiny algorithm,are confirmed by comparison with those of original YOLOv4-tiny algorithm.The innovations of this paper focus on the simple network structure,fewer network layers,and earlier forward transmission of features to prevent over-fitting,showing the new lite neural network exceeds the original YOLOv4-tiny network significantly.展开更多
Aiming at the limitations of the existing knowledge representations in intelligent detection,a novel extension-based knowledge representation(EKR) is proposed.The definitions,grammar rules,and formal semantics of EKR ...Aiming at the limitations of the existing knowledge representations in intelligent detection,a novel extension-based knowledge representation(EKR) is proposed.The definitions,grammar rules,and formal semantics of EKR are presented.A rhombus solving strategy(RSS) based on EKR is discussed in detail,including creation of the problem oriented model,extension operator,the solution formation of contradictions problem and extended inference of matter-element.A knowledge base system based on EKR and RSS is developed,which is applied in intelligent detection in the Dendrobium huoshanense photosynthesis process(DHPP).More reasonable results are obtained than traditional rule-based system.The EKR is feasible in intelligent detection to solve the limitations of traditional knowledge representations.展开更多
Security is a significant issue for everyone due to new and creative ways to commit cybercrime.The Closed-Circuit Television(CCTV)systems are being installed in offices,houses,shopping malls,and on streets to protect ...Security is a significant issue for everyone due to new and creative ways to commit cybercrime.The Closed-Circuit Television(CCTV)systems are being installed in offices,houses,shopping malls,and on streets to protect lives.Operators monitor CCTV;however,it is difficult for a single person to monitor the actions of multiple people at one time.Consequently,there is a dire need for an automated monitoring system that detects a person with ammunition or any other harmful material Based on our research and findings of this study,we have designed a new Intelligent Ammunition Detection and Classification(IADC)system using Convolutional Neural Network(CNN).The proposed system is designed to identify persons carrying weapons and ammunition using CCTV cameras.When weapons are identified,the cameras sound an alarm.In the proposed IADC system,CNN was used to detect firearms and ammunition.The CNN model which is a Deep Learning technique consists of neural networks,most commonly applied to analyzing visual imagery has gained popularity for unstructured(images,videos)data classification.Additionally,this system generates an early warning through detection of ammunition before conditions become critical.Hence the faster and earlier the prediction,the lower the response time,loses and potential victims.The proposed IADC system provides better results than earlier published models like VGGNet,OverFeat-1,OverFeat-2,and OverFeat-3.展开更多
A model of intelligent intrusion detection based on rough neural network (RNN), which combines the neural network and rough set, is presented. It works by capturing network packets to identify network intrusions or ma...A model of intelligent intrusion detection based on rough neural network (RNN), which combines the neural network and rough set, is presented. It works by capturing network packets to identify network intrusions or malicious attacks using RNN with sub-nets. The sub-net is constructed by detection-oriented signatures extracted using rough set theory to detect different intrusions. It is proved that RNN detection method has the merits of adaptive, high universality, high convergence speed, easy upgrading and management.展开更多
In view of the uncertainty of the status of primary users in cognitive networks and the fact that the random detection strategy cannot guarantee cognitive users to accurately find available channels,this paper propose...In view of the uncertainty of the status of primary users in cognitive networks and the fact that the random detection strategy cannot guarantee cognitive users to accurately find available channels,this paper proposes a joint random detection strategy using the idle cognitive users in cognitive wireless networks.After adding idle cognitive users for detection,the compressed sensing model is employed to describe the number of available channels obtained by the cognitive base station to derive the detection performance of the cognitive network at this time.Both theoretical analysis and simulation results show that using idle cognitive users can reduce service delay and improve the throughput of cognitive networks.After considering the time occupied by cognitive users to report detection information,the optimal participation number of idle cognitive users in joint detection is obtained through the optimization algorithm.展开更多
Taking a study area in Jinzhong Basin in Qixian County,Shanxi Province,as an example,this work performs an intelligent interpretation of ground fissures.On the basis of a complete analysis of the regional geological b...Taking a study area in Jinzhong Basin in Qixian County,Shanxi Province,as an example,this work performs an intelligent interpretation of ground fissures.On the basis of a complete analysis of the regional geological background in the study area,dip-steering cube operation and median filtering of seismic data were performed using fast Fourier transform to improve the continuity of seismic events and eliminate random noise.A total of 200 stratigraphic continuous sample training points and 500 discontinuous training points were obtained from the processed seismic data.Thereafter,a variety of attributes(coherence,curvature,amplitude,frequency,etc.)were extracted as the input for the multilayer perceptron neural network training.During the training period,the training results were traced by normalized root mean square error(RMSE)and misclassifi cation.The training results showed a downward trend during the training period.The misclassifi cation curve was stable at 0.3,and the normalized RMSE curve was stable at 0.68.When the value of the normalized RMSE curve reached the minimum,the training was terminated,and the training results were extended to the whole data volume to obtain the attribute cube of intelligent ground fi ssure detection.The characteristics of ground fi ssures were analyzed and identifi ed from the sections and slices.A total of 11 ground fissures were finally interpreted.The interpretation results showed that the dip angles were 60°-85°,the fault throws were 0-43 m,and the extension lengths were 300-1,100 m in the whole area.The strike of 73%of the ground fi ssures was consistent with the direction of the regional tectonic settings.Specifi cally,four ground fi ssures coincided with the surface disclosed,and the verifi cation rate reached 100%.In conclusion,the intelligent ground fi ssure detection attribute based on the dip-steering cube is eff ective in predicting the spatial distribution of ground fi ssures.展开更多
Generating ground truth data for developing object detection algorithms of intelligent surveillance systems is a considerably important yet time-consuming task; therefore, a user-friendly tool to annotate videos effic...Generating ground truth data for developing object detection algorithms of intelligent surveillance systems is a considerably important yet time-consuming task; therefore, a user-friendly tool to annotate videos efficiently and accurately is required. In this paper, the development of a semi-automatic video annotation tool is described. For efficiency, the developed tool can automatically generate the initial annotation data for the input videos utilizing automatic object detection modules, which are developed independently and registered in the tool. To guarantee the accuracy of the ground truth data, the system also has several user-friendly functions to help users check and edit the initial annotation data generated by the automatic object detection modules. According to the experiment's results, employing the developed annotation tool is considerably beneficial for reducing annotation time; when compared to manual annotation schemes, using the tool resulted in an annotation time reduction of up to 2.3 times.展开更多
The goal of artificial intelligence in colonoscopy is to improve adenoma detection rate and reduce interval colorectal cancer.Artificial intelligence in polyp detection during colonoscopy has evolved tremendously over...The goal of artificial intelligence in colonoscopy is to improve adenoma detection rate and reduce interval colorectal cancer.Artificial intelligence in polyp detection during colonoscopy has evolved tremendously over the last decade mainly due to the implementation of neural networks.Computer aided detection(CADe)utilizing neural networks allows real time detection of polyps and adenomas.Current CADe systems are built in single centers by multidisciplinary teams and have only been utilized in limited clinical research studies.We review the most recent prospective randomized controlled trials here.These randomized control trials,both non-blinded and blinded,demonstrated increase in adenoma and polyp detection rates when endoscopists used CADe systems vs standard high definition colonoscopes.Increase of polyps and adenomas detected were mainly small and sessile in nature.CADe systems were found to be safe with little added time to the overall procedure.Results are promising as more CADe have shown to have ability to increase accuracy and improve quality of colonoscopy.Overall limitations included selection bias as all trials built and utilized different CADe developed at their own institutions,non-blinded arms,and question of external validity.展开更多
As an important component of load transfer,various fatigue damages occur in the track as the rail service life and train traffic increase gradually,such as rail corrugation,rail joint damage,uneven thermite welds,rail ...As an important component of load transfer,various fatigue damages occur in the track as the rail service life and train traffic increase gradually,such as rail corrugation,rail joint damage,uneven thermite welds,rail squats fas-tener defects,etc.Real-time recognition of track defects plays a vital role in ensuring the safe and stable operation of rail transit.In this paper,an intelligent and innovative method is proposed to detect the track defects by using axle-box vibration acceleration and deep learning network,and the coexistence of the above-mentioned typical track defects in the track system is considered.Firstly,the dynamic relationship between the track defects(using the example of the fastening defects)and the axle-box vibration acceleration(ABVA)is investigated using the dynamic vehicle-track model.Then,a simulation model for the coupled dynamics of the vehicle and track with different track defects is established,and the wavelet power spectrum(WPS)analysis is performed for the vibra-tion acceleration signals of the axle box to extract the characteristic response.Lastly,using wavelet spectrum photos as input,an automatic detection technique based on the deep convolution neural network(DCNN)is sug-gested to realize the real-time intelligent detection and identification of various track problems.Thefindings demonstrate that the suggested approach achieves a 96.72%classification accuracy.展开更多
在部分生产线上,钢坯从炉内出炉的过程中,需要依靠人眼判断钢坯是否到达指定位置,到位后再利用推钢机推动炉内的钢坯完成出炉过程。在这个过程中,人眼长时间观察摄像头屏幕容易疲劳,人工劳动强度大成本高,生产工作效率较低。针对以上问...在部分生产线上,钢坯从炉内出炉的过程中,需要依靠人眼判断钢坯是否到达指定位置,到位后再利用推钢机推动炉内的钢坯完成出炉过程。在这个过程中,人眼长时间观察摄像头屏幕容易疲劳,人工劳动强度大成本高,生产工作效率较低。针对以上问题,文中提出利用机器视觉系统替代人类视觉系统进行钢坯位置的实时定位,首先将钢坯定位问题转换为关键点检测问题,然后提出了基于ResNet网络和基于关键点分割网络(Key Point Segmentation Network,KPSN)的两种模型来进行关键点检测,最后,通过测试和分析所提出的两种方法,提出了多方法融合的关键点检测方案,降低了极端情况下误检的风险,实际应用表明,文中所提方法具有较高的鲁棒性,达到了实际应用的要求。展开更多
基金funded by the National Key Research and Development Program of China(No.2017YFC1501200)the National Natural Science Foundation of China(Nos.51678536,41404096)+2 种基金supported by Department of education’s Production-Study-Research combined innovation Funding-“Blue fire plan(Huizhou)”(CXZJHZ01742)the Program for Science and Technology Innovation Talents in Universities of Henan Province(Grant No.19HASTIT043)the Outstanding Young Talent Research Fund of Zhengzhou University(1621323001).
文摘The crack is a common pavement failure problem.A lack of periodic maintenance will result in extending the cracks and damage the pavement,which will affect the normal use of the road.Therefore,it is significant to establish an efficient intelligent identification model for pavement cracks.The neural network is a method of simulating animal nervous systems using gradient descent to predict results by learning a weight matrix.It has been widely used in geotechnical engineering,computer vision,medicine,and other fields.However,there are three major problems in the application of neural networks to crack identification.There are too few layers,extracted crack features are not complete,and the method lacks the efficiency to calculate the whole picture.In this study,a fully convolutional neural network based on ResNet-101 is used to establish an intelligent identification model of pavement crack regions.This method,using a convolutional layer instead of a fully connected layer,realizes full convolution and accelerates calculation.The region proposals come from the feature map at the end of the base network,which avoids multiple computations of the same picture.Online hard example mining and data-augmentation techniques are adopted to improve the model’s recognition accuracy.We trained and tested Concrete Crack Images for Classification(CCIC),which is a public dataset collected using smartphones,and the Crack Image Database(CIDB),which was automatically collected using vehicle-mounted charge-coupled device cameras,with identification accuracy reaching 91.4%and 86.4%,respectively.The proposed model has a higher recognition accuracy and recall rate than Faster RCNN and different depth models,and can extract more complete and accurate crack features in CIDB.We also analyzed translation processing,fuzzy,scaling,and distorted images.The proposed model shows a strong robustness and stability,and can automatically identify image cracks of different forms.It has broad application prospects in practical engineering problems.
基金the National Natural Science Foundation of China (No.51875335)。
文摘Conforming to the rapidly increasing market demand of crack detection for tall buildings,the idea of integrating deep network technology into wall-climbing robot for crack detection is put forward in this paper.Taking the dependence and hardware requirements when deployed on such edge devices as Raspberry Pi into consideration,the Darknet neural network is selected as the basic framework for detection.In order to improve the inference efficiency on edge devices and avoid the possible premature over-fitting of deep networks,the lite YOLOv4-tiny algorithm is then improved from the original YOLOv4-tiny algorithm and its structure is illustrated using Netron accordingly.The images downloaded from Internet and taken from the buildings in campus are processed to form crack detection data sets,which are trained on personal computer with the AlexeyAB version of Darknet to generate weight files.Meanwhile,the AlexeyAB version of Darknet accelerated by NNpack package is deployed on Raspberry Pi 4B,and the crack detection experiments are carried out.Some characteristics,e.g.,fast speed and lower false detection rate of the lite YOLOv4-tiny algorithm,are confirmed by comparison with those of original YOLOv4-tiny algorithm.The innovations of this paper focus on the simple network structure,fewer network layers,and earlier forward transmission of features to prevent over-fitting,showing the new lite neural network exceeds the original YOLOv4-tiny network significantly.
基金the National Natural Science Founda-tion of China(No.60974038)
文摘Aiming at the limitations of the existing knowledge representations in intelligent detection,a novel extension-based knowledge representation(EKR) is proposed.The definitions,grammar rules,and formal semantics of EKR are presented.A rhombus solving strategy(RSS) based on EKR is discussed in detail,including creation of the problem oriented model,extension operator,the solution formation of contradictions problem and extended inference of matter-element.A knowledge base system based on EKR and RSS is developed,which is applied in intelligent detection in the Dendrobium huoshanense photosynthesis process(DHPP).More reasonable results are obtained than traditional rule-based system.The EKR is feasible in intelligent detection to solve the limitations of traditional knowledge representations.
文摘Security is a significant issue for everyone due to new and creative ways to commit cybercrime.The Closed-Circuit Television(CCTV)systems are being installed in offices,houses,shopping malls,and on streets to protect lives.Operators monitor CCTV;however,it is difficult for a single person to monitor the actions of multiple people at one time.Consequently,there is a dire need for an automated monitoring system that detects a person with ammunition or any other harmful material Based on our research and findings of this study,we have designed a new Intelligent Ammunition Detection and Classification(IADC)system using Convolutional Neural Network(CNN).The proposed system is designed to identify persons carrying weapons and ammunition using CCTV cameras.When weapons are identified,the cameras sound an alarm.In the proposed IADC system,CNN was used to detect firearms and ammunition.The CNN model which is a Deep Learning technique consists of neural networks,most commonly applied to analyzing visual imagery has gained popularity for unstructured(images,videos)data classification.Additionally,this system generates an early warning through detection of ammunition before conditions become critical.Hence the faster and earlier the prediction,the lower the response time,loses and potential victims.The proposed IADC system provides better results than earlier published models like VGGNet,OverFeat-1,OverFeat-2,and OverFeat-3.
文摘A model of intelligent intrusion detection based on rough neural network (RNN), which combines the neural network and rough set, is presented. It works by capturing network packets to identify network intrusions or malicious attacks using RNN with sub-nets. The sub-net is constructed by detection-oriented signatures extracted using rough set theory to detect different intrusions. It is proved that RNN detection method has the merits of adaptive, high universality, high convergence speed, easy upgrading and management.
基金Mine IOT converged communication network architecture and its transmission technology and equipment(2017YFC0804405).
文摘In view of the uncertainty of the status of primary users in cognitive networks and the fact that the random detection strategy cannot guarantee cognitive users to accurately find available channels,this paper proposes a joint random detection strategy using the idle cognitive users in cognitive wireless networks.After adding idle cognitive users for detection,the compressed sensing model is employed to describe the number of available channels obtained by the cognitive base station to derive the detection performance of the cognitive network at this time.Both theoretical analysis and simulation results show that using idle cognitive users can reduce service delay and improve the throughput of cognitive networks.After considering the time occupied by cognitive users to report detection information,the optimal participation number of idle cognitive users in joint detection is obtained through the optimization algorithm.
基金The study was supported by Open Fund of State Key Laboratory of Coal Resources and Safe Mining(Grant No.SKLCRSM19ZZ02)the National Natural Science Foundation of China(No.41702173)。
文摘Taking a study area in Jinzhong Basin in Qixian County,Shanxi Province,as an example,this work performs an intelligent interpretation of ground fissures.On the basis of a complete analysis of the regional geological background in the study area,dip-steering cube operation and median filtering of seismic data were performed using fast Fourier transform to improve the continuity of seismic events and eliminate random noise.A total of 200 stratigraphic continuous sample training points and 500 discontinuous training points were obtained from the processed seismic data.Thereafter,a variety of attributes(coherence,curvature,amplitude,frequency,etc.)were extracted as the input for the multilayer perceptron neural network training.During the training period,the training results were traced by normalized root mean square error(RMSE)and misclassifi cation.The training results showed a downward trend during the training period.The misclassifi cation curve was stable at 0.3,and the normalized RMSE curve was stable at 0.68.When the value of the normalized RMSE curve reached the minimum,the training was terminated,and the training results were extended to the whole data volume to obtain the attribute cube of intelligent ground fi ssure detection.The characteristics of ground fi ssures were analyzed and identifi ed from the sections and slices.A total of 11 ground fissures were finally interpreted.The interpretation results showed that the dip angles were 60°-85°,the fault throws were 0-43 m,and the extension lengths were 300-1,100 m in the whole area.The strike of 73%of the ground fi ssures was consistent with the direction of the regional tectonic settings.Specifi cally,four ground fi ssures coincided with the surface disclosed,and the verifi cation rate reached 100%.In conclusion,the intelligent ground fi ssure detection attribute based on the dip-steering cube is eff ective in predicting the spatial distribution of ground fi ssures.
文摘Generating ground truth data for developing object detection algorithms of intelligent surveillance systems is a considerably important yet time-consuming task; therefore, a user-friendly tool to annotate videos efficiently and accurately is required. In this paper, the development of a semi-automatic video annotation tool is described. For efficiency, the developed tool can automatically generate the initial annotation data for the input videos utilizing automatic object detection modules, which are developed independently and registered in the tool. To guarantee the accuracy of the ground truth data, the system also has several user-friendly functions to help users check and edit the initial annotation data generated by the automatic object detection modules. According to the experiment's results, employing the developed annotation tool is considerably beneficial for reducing annotation time; when compared to manual annotation schemes, using the tool resulted in an annotation time reduction of up to 2.3 times.
文摘The goal of artificial intelligence in colonoscopy is to improve adenoma detection rate and reduce interval colorectal cancer.Artificial intelligence in polyp detection during colonoscopy has evolved tremendously over the last decade mainly due to the implementation of neural networks.Computer aided detection(CADe)utilizing neural networks allows real time detection of polyps and adenomas.Current CADe systems are built in single centers by multidisciplinary teams and have only been utilized in limited clinical research studies.We review the most recent prospective randomized controlled trials here.These randomized control trials,both non-blinded and blinded,demonstrated increase in adenoma and polyp detection rates when endoscopists used CADe systems vs standard high definition colonoscopes.Increase of polyps and adenomas detected were mainly small and sessile in nature.CADe systems were found to be safe with little added time to the overall procedure.Results are promising as more CADe have shown to have ability to increase accuracy and improve quality of colonoscopy.Overall limitations included selection bias as all trials built and utilized different CADe developed at their own institutions,non-blinded arms,and question of external validity.
基金supported by the Doctoral Fund Project(Grant No.X22003Z).
文摘As an important component of load transfer,various fatigue damages occur in the track as the rail service life and train traffic increase gradually,such as rail corrugation,rail joint damage,uneven thermite welds,rail squats fas-tener defects,etc.Real-time recognition of track defects plays a vital role in ensuring the safe and stable operation of rail transit.In this paper,an intelligent and innovative method is proposed to detect the track defects by using axle-box vibration acceleration and deep learning network,and the coexistence of the above-mentioned typical track defects in the track system is considered.Firstly,the dynamic relationship between the track defects(using the example of the fastening defects)and the axle-box vibration acceleration(ABVA)is investigated using the dynamic vehicle-track model.Then,a simulation model for the coupled dynamics of the vehicle and track with different track defects is established,and the wavelet power spectrum(WPS)analysis is performed for the vibra-tion acceleration signals of the axle box to extract the characteristic response.Lastly,using wavelet spectrum photos as input,an automatic detection technique based on the deep convolution neural network(DCNN)is sug-gested to realize the real-time intelligent detection and identification of various track problems.Thefindings demonstrate that the suggested approach achieves a 96.72%classification accuracy.
文摘在部分生产线上,钢坯从炉内出炉的过程中,需要依靠人眼判断钢坯是否到达指定位置,到位后再利用推钢机推动炉内的钢坯完成出炉过程。在这个过程中,人眼长时间观察摄像头屏幕容易疲劳,人工劳动强度大成本高,生产工作效率较低。针对以上问题,文中提出利用机器视觉系统替代人类视觉系统进行钢坯位置的实时定位,首先将钢坯定位问题转换为关键点检测问题,然后提出了基于ResNet网络和基于关键点分割网络(Key Point Segmentation Network,KPSN)的两种模型来进行关键点检测,最后,通过测试和分析所提出的两种方法,提出了多方法融合的关键点检测方案,降低了极端情况下误检的风险,实际应用表明,文中所提方法具有较高的鲁棒性,达到了实际应用的要求。