In the actual complex environment,the recognition accuracy of crop leaf disease is often not high.Inspired by the brain parallel interaction mechanism,a two-stream parallel interactive convolutional neural network(TSP...In the actual complex environment,the recognition accuracy of crop leaf disease is often not high.Inspired by the brain parallel interaction mechanism,a two-stream parallel interactive convolutional neural network(TSPI-CNN)is proposed to improve the recognition accuracy.TSPI-CNN includes a two-stream parallel network(TSP-Net)and a parallel interactive network(PI-Net).TSP-Net simulates the ventral and dorsal stream.PI-Net simulates the interaction between two pathways in the process of human brain visual information transmission.A large number of experiments shows that the proposed TSPI-CNN performs well on MK-D2,PlantVillage,Apple-3 leaf,and Cassava leaf datasets.Furthermore,the effect of numbers of interactions on the recognition performance of TSPI-CNN is discussed.The experimental results show that as the number of interactions increases,the recognition accuracy of the network also increases.Finally,the network is visualized to show the working mechanism of the network and provide enlightenment for future research.展开更多
Leaf disease recognition using image processing and deep learning techniques is currently a vibrant research area.Most studies have focused on recognizing diseases from images of whole leaves.This approach limits the ...Leaf disease recognition using image processing and deep learning techniques is currently a vibrant research area.Most studies have focused on recognizing diseases from images of whole leaves.This approach limits the resulting models’ability to estimate leaf disease severity or identify multiple anomalies occurring on the same leaf.Recent studies have demonstrated that classifying leaf diseases based on individual lesions greatly enhances disease recognition accuracy.In those studies,however,the lesions were laboriously cropped by hand.This study proposes a semi-automatic algorithm that facilitates the fast and efficient preparation of datasets of individual lesions and leaf image pixel maps to overcome this problem.These datasets were then used to train and test lesion classifier and semantic segmentation Convolutional Neural Network(CNN)models,respectively.We report that GoogLeNet’s disease recognition accuracy improved by more than 15%when diseases were recognized from lesion images compared to when disease recognition was done using images of whole leaves.A CNN model which performs semantic segmentation of both the leaf and lesions in one pass is also proposed in this paper.The proposed KijaniNet model achieved state-of-the-art segmentation performance in terms of mean Intersection over Union(mIoU)score of 0.8448 and 0.6257 for the leaf and lesion pixel classes,respectively.In terms of mean boundary F1 score,the KijaniNet model attained 0.8241 and 0.7855 for the two pixel classes,respectively.Lastly,a fully automatic algorithm for leaf disease recognition from individual lesions is proposed.The algorithm employs the semantic segmentation network cascaded to a GoogLeNet classifier for lesion-wise disease recognition.The proposed fully automatic algorithm outperforms competing methods in terms of its superior segmentation and classification performance despite being trained on a small dataset.展开更多
Apple leaf disease is one of the main factors to constrain the apple production and quality.It takes a long time to detect the diseases by using the traditional diagnostic approach,thus farmers often miss the best tim...Apple leaf disease is one of the main factors to constrain the apple production and quality.It takes a long time to detect the diseases by using the traditional diagnostic approach,thus farmers often miss the best time to prevent and treat the diseases.Apple leaf disease recognition based on leaf image is an essential research topic in the field of computer vision,where the key task is to find an effective way to represent the diseased leaf images.In this research,based on image processing techniques and pattern recognition methods,an apple leaf disease recognition method was proposed.A color transformation structure for the input RGB(Red,Green and Blue)image was designed firstly and then RGB model was converted to HSI(Hue,Saturation and Intensity),YUV and gray models.The background was removed based on a specific threshold value,and then the disease spot image was segmented with region growing algorithm(RGA).Thirty-eight classifying features of color,texture and shape were extracted from each spot image.To reduce the dimensionality of the feature space and improve the accuracy of the apple leaf disease identification,the most valuable features were selected by combining genetic algorithm(GA)and correlation based feature selection(CFS).Finally,the diseases were recognized by SVM classifier.In the proposed method,the selected feature subset was globally optimum.The experimental results of more than 90%correct identification rate on the apple diseased leaf image database which contains 90 disease images for there kinds of apple leaf diseases,powdery mildew,mosaic and rust,demonstrate that the proposed method is feasible and effective.展开更多
基金National Natural Science Foundation of China(Nos.61806051 and 61903078)Fundamental Research Funds for the Central Universities,China(Nos.2232021A-10 and 2232021D-32)Natural Science Foundation of Shanghai,China(No.20ZR1400400)。
文摘In the actual complex environment,the recognition accuracy of crop leaf disease is often not high.Inspired by the brain parallel interaction mechanism,a two-stream parallel interactive convolutional neural network(TSPI-CNN)is proposed to improve the recognition accuracy.TSPI-CNN includes a two-stream parallel network(TSP-Net)and a parallel interactive network(PI-Net).TSP-Net simulates the ventral and dorsal stream.PI-Net simulates the interaction between two pathways in the process of human brain visual information transmission.A large number of experiments shows that the proposed TSPI-CNN performs well on MK-D2,PlantVillage,Apple-3 leaf,and Cassava leaf datasets.Furthermore,the effect of numbers of interactions on the recognition performance of TSPI-CNN is discussed.The experimental results show that as the number of interactions increases,the recognition accuracy of the network also increases.Finally,the network is visualized to show the working mechanism of the network and provide enlightenment for future research.
文摘Leaf disease recognition using image processing and deep learning techniques is currently a vibrant research area.Most studies have focused on recognizing diseases from images of whole leaves.This approach limits the resulting models’ability to estimate leaf disease severity or identify multiple anomalies occurring on the same leaf.Recent studies have demonstrated that classifying leaf diseases based on individual lesions greatly enhances disease recognition accuracy.In those studies,however,the lesions were laboriously cropped by hand.This study proposes a semi-automatic algorithm that facilitates the fast and efficient preparation of datasets of individual lesions and leaf image pixel maps to overcome this problem.These datasets were then used to train and test lesion classifier and semantic segmentation Convolutional Neural Network(CNN)models,respectively.We report that GoogLeNet’s disease recognition accuracy improved by more than 15%when diseases were recognized from lesion images compared to when disease recognition was done using images of whole leaves.A CNN model which performs semantic segmentation of both the leaf and lesions in one pass is also proposed in this paper.The proposed KijaniNet model achieved state-of-the-art segmentation performance in terms of mean Intersection over Union(mIoU)score of 0.8448 and 0.6257 for the leaf and lesion pixel classes,respectively.In terms of mean boundary F1 score,the KijaniNet model attained 0.8241 and 0.7855 for the two pixel classes,respectively.Lastly,a fully automatic algorithm for leaf disease recognition from individual lesions is proposed.The algorithm employs the semantic segmentation network cascaded to a GoogLeNet classifier for lesion-wise disease recognition.The proposed fully automatic algorithm outperforms competing methods in terms of its superior segmentation and classification performance despite being trained on a small dataset.
基金Natural Science Foundation of China(grant Nos.61473237,61202170,and 61402331)It is also supported by the Shaanxi Provincial Natural Science Foundation Research Project(2014JM2-6096)+3 种基金Tianjin Research Program of Application Foundation and Advanced Technology(14JCYBJC42500)Tianjin science and technology correspondent project(16JCTPJC47300)the 2015 key projects of Tianjin science and technology support program(No.15ZCZDGX00200)the Fund of Tianjin Food Safety&Low Carbon Manufacturing Collaborative Innovation Center.
文摘Apple leaf disease is one of the main factors to constrain the apple production and quality.It takes a long time to detect the diseases by using the traditional diagnostic approach,thus farmers often miss the best time to prevent and treat the diseases.Apple leaf disease recognition based on leaf image is an essential research topic in the field of computer vision,where the key task is to find an effective way to represent the diseased leaf images.In this research,based on image processing techniques and pattern recognition methods,an apple leaf disease recognition method was proposed.A color transformation structure for the input RGB(Red,Green and Blue)image was designed firstly and then RGB model was converted to HSI(Hue,Saturation and Intensity),YUV and gray models.The background was removed based on a specific threshold value,and then the disease spot image was segmented with region growing algorithm(RGA).Thirty-eight classifying features of color,texture and shape were extracted from each spot image.To reduce the dimensionality of the feature space and improve the accuracy of the apple leaf disease identification,the most valuable features were selected by combining genetic algorithm(GA)and correlation based feature selection(CFS).Finally,the diseases were recognized by SVM classifier.In the proposed method,the selected feature subset was globally optimum.The experimental results of more than 90%correct identification rate on the apple diseased leaf image database which contains 90 disease images for there kinds of apple leaf diseases,powdery mildew,mosaic and rust,demonstrate that the proposed method is feasible and effective.