The Global Wheat Head Detection(GWHD)dataset was created in 2020 and has assembled 193,634 labelled wheat heads from 4700 RGB images acquired from various acquisition platforms and 7 countries/institutions.With an ass...The Global Wheat Head Detection(GWHD)dataset was created in 2020 and has assembled 193,634 labelled wheat heads from 4700 RGB images acquired from various acquisition platforms and 7 countries/institutions.With an associated competition hosted in Kaggle,GWHD_2020 has successfully attracted attention from both the computer vision and agricultural science communities.From this first experience,a few avenues for improvements have been identified regarding data size,head diversity,and label reliability.To address these issues,the 2020 dataset has been reexamined,relabeled,and complemented by adding 1722 images from 5 additional countries,allowing for 81,553 additional wheat heads.We now release in 2021 a new version of the Global Wheat Head Detection dataset,which is bigger,more diverse,and less noisy than the GWHD_2020 version.展开更多
The detection of wheat heads in plant images is an important task for estimating pertinent wheat traits including head population density and head characteristics such as health,size,maturity stage,and the presence of...The detection of wheat heads in plant images is an important task for estimating pertinent wheat traits including head population density and head characteristics such as health,size,maturity stage,and the presence of awns.Several studies have developed methods for wheat head detection from high-resolution RGB imagery based on machine learning algorithms.However,these methods have generally been calibrated and validated on limited datasets.High variability in observational conditions,genotypic differences,development stages,and head orientation makes wheat head detection a challenge for computer vision.Further,possible blurring due to motion or wind and overlap between heads for dense populations make this task even more complex.Through a joint international collaborative effort,we have built a large,diverse,and well-labelled dataset of wheat images,called the Global Wheat Head Detection(GWHD)dataset.It contains 4700 high-resolution RGB images and 190000 labelled wheat heads collected from several countries around the world at different growth stages with a wide range of genotypes.Guidelines for image acquisition,associating minimum metadata to respect FAIR principles,and consistent head labelling methods are proposed when developing new head detection datasets.The GWHD dataset is publicly available at http://www.global-wheat.com/and aimed at developing and benchmarking methods for wheat head detection.展开更多
The number of leaves at a given time is important to characterize plant growth and development.In this work,we developed a high-throughput method to count the number of leaves by detecting leaf tips in RGB images.The ...The number of leaves at a given time is important to characterize plant growth and development.In this work,we developed a high-throughput method to count the number of leaves by detecting leaf tips in RGB images.The digital plant phenotyping platform was used to simulate a large and diverse dataset of RGB images and corresponding leaf tip labels of wheat plants at seedling stages(150,000 images with over 2 million labels).The realism of the images was then improved using domain adaptation methods before training deep learning models.The results demonstrate the efficiency of the proposed method evaluated on a diverse test dataset,collecting measurements from 5 countries obtained under different environments,growth stages,and lighting conditions with different cameras(450 images with over 2,162 labels).Among the 6 combinations of deep learning models and domain adaptation techniques,the Faster-RCNN model with cycle-consistent generative adversarial network adaptation technique provided the best performance(R^(2)=0.94,root mean square error=8.7).Complementary studies show that it is essential to simulate images with sufficient realism(background,leaf texture,and lighting conditions)before applying domain adaptation techniques.Furthermore,the spatial resolution should be better than 0.6 mm per pixel to identify leaf tips.The method is claimed to be self-supervised since no manual labeling is required for model training.The self-supervised phenotyping approach developed here offers great potential for addressing a wide range of plant phenotyping problems.The trained networks are available at https://github.com/YinglunLi/Wheat-leaf-tip-detection.展开更多
Jujube is widely cultivated in the semi-arid region of the Loess Plateau in Northwest China due to its high water deficit tolerance.In such an ecologically vulnerable area,it is critical to explore the water consumpti...Jujube is widely cultivated in the semi-arid region of the Loess Plateau in Northwest China due to its high water deficit tolerance.In such an ecologically vulnerable area,it is critical to explore the water consumption processes of key tree species and their responses to driving factors.Sap flow data gathered during a two-year field study in a jujube plantation were analyzed as a surrogate for transpiration measurements.The measured sap flows were related to changes in the soil water content,meteorological factors(the vapor pressure deficit and the level of photosynthetically active radiation),and plant physiological factors(the sap wood area,leaf area and leaf area index).The factors that govern sap flow were found to vary depending on the growing season,and on hourly and daily timescales.The plants’drought tolerance could be predicted based on their peak sap flows and the variation in their sap flow rates at different soil water levels.The sap flow was most strongly affected by the water content of the topmost(0-20 cm)soil layer.Of the studied meteorological factors,the photosynthetically active radiation had a greater effect on sap flow than the vapor pressure deficit.The correlation we found could be applied to predict jujube tree water consumption and assist the design of irrigation scheme.展开更多
Deep learning has been widely used for plant disease recognition in smart agriculture and has proven to be a powerful tool for image classification and pattern recognition.However,it has limited interpretability for d...Deep learning has been widely used for plant disease recognition in smart agriculture and has proven to be a powerful tool for image classification and pattern recognition.However,it has limited interpretability for deep features.With the transfer of expert knowledge,handcrafted features provide a new way for personalized diagnosis of plant diseases.However,irrelevant and redundant features lead to high dimensionality.In this study,we proposed a swarm intelligence algorithm for feature selection[salp swarm algorithm for feature selection(SSAFS)]in image-based plant disease detection.SSAFS is employed to determine the ideal combination of handcrafted features to maximize classification success while minimizing the number of features.To verify the effectiveness of the developed SSAFS algorithm,we conducted experimental studies using SSAFS and 5 metaheuristic algorithms.Several evaluation metrics were used to evaluate and analyze the performance of these methods on 4 datasets from the UCI machine learning repository and 6 plant phenomics datasets from PlantVillage.Experimental results and statistical analyses validated the outstanding performance of SSAFS compared to existing state-of-the-art algorithms,confirming the superiority of SSAFS in exploring the feature space and identifying the most valuable features for diseased plant image classification.This computational tool will allow us to explore an optimal combination of handcrafted features to improve plant disease recognition accuracy and processing time.展开更多
Accurate assessment of crop biochemical profiles plays a crucial role in diagnosing their physiological status.The conventional destructive methods,although reliable,demand extensive laboratory work for measuring vari...Accurate assessment of crop biochemical profiles plays a crucial role in diagnosing their physiological status.The conventional destructive methods,although reliable,demand extensive laboratory work for measuring various traits.On the other hand,nondestructive techniques,while efficient and adaptable,often suffer from reduced precision due to the intricate interplay of the field environment and canopy structure.Striking a delicate balance between efficiency and accuracy,we have developed the Bio-Master phenotyping system.This system is capable of simultaneously measuring four vital biochemical components of the canopy profile:dry matter,water,chlorophyll,and nitrogen content.Bio-Master initiates the process by addressing structural influences,through segmenting the fresh plant and then further chopping the segment into uniform small pieces.Subsequently,the system quantifies hyperspectral reflectance and fresh weight over the sample within a controlled dark chamber,utilizing an independent light source.The final step involves employing an embedded estimation model to provide synchronous estimates for the four biochemical components of the measured sample.In this study,we established a comprehensive training dataset encompassing a wide range of rice varieties,nitrogen levels,and growth stages.Gaussian process regression model was used to estimate biochemical contents utilizing reflectance data obtained by Bio-Master.Leave-one-out validation revealed the model's capacity to accurately estimate these contents at both leaf and plant scales.With Bio-Master,measuring a single rice plant takes approximately only 5 min,yielding around 10 values for each of the four biochemical components across the vertical profile.Furthermore,the Bio-Master system allows for immediate measurements near the field,mitigating potential alterations in plant status during transportation and processing.As a result,our measurements are more likely to faithfully represent in situ values.To summarize,the Bio-Master phenotyping system offers an efficient tool for comprehensive crop biochemical profiling.It harnesses the benefits of remote sensing techniques,providing significantly greater efficiency than conventional destructive methods while maintaining superior accuracy when compared to nondestructive approaches.展开更多
基金the French National Research Agency under the Investments for the Future Program,referred as ANR-16-CONV-0004 PIA#Digitag.Institut Convergences Agriculture Numérique,Hiphen supported the organization of the competition.Japan:Kubota supported the organization of the competi-tion.Australia:Grains Research and Development Corpora-tion(UOQ2002-008RTX machine learning applied to high-throughput feature extraction from imagery to map spatial variability and UOQ2003-011RTX INVITA-a technology and analytics platform for improving variety selection)sup-ported competition.
文摘The Global Wheat Head Detection(GWHD)dataset was created in 2020 and has assembled 193,634 labelled wheat heads from 4700 RGB images acquired from various acquisition platforms and 7 countries/institutions.With an associated competition hosted in Kaggle,GWHD_2020 has successfully attracted attention from both the computer vision and agricultural science communities.From this first experience,a few avenues for improvements have been identified regarding data size,head diversity,and label reliability.To address these issues,the 2020 dataset has been reexamined,relabeled,and complemented by adding 1722 images from 5 additional countries,allowing for 81,553 additional wheat heads.We now release in 2021 a new version of the Global Wheat Head Detection dataset,which is bigger,more diverse,and less noisy than the GWHD_2020 version.
基金The French team received support from ANRT for the CIFRE grant of Etienne David,cofunded by Arvalis.The study was partly supported by several projects including ANR PHENOME,ANR BREEDWHEAT,CASDAR LITERAL,and FSOV“Plastix”.Many thanks are due to the people who annotated the French datasets,including Frederic Venault,Xiuliang Jin,Mario Serouard,Ilias Sarbout,Carole Gigot,Eloïse Issert,and Elise Lepage.The Japanese team received support from JST CREST(Grant Numbers JPMJCR16O3,JPMJCR16O2,and JPMJCR1512)and MAFF Smart-Breeding System for Innovative Agriculture(BAC1003),Japan.Many thanks are due to the people who annotated the Japanese dataset,including Kozue Wada,Masanori Ishii,Ryuuichi Kanzaki,Sayoko Ishibashi,and Sumiko Kaneko.The Canadian team received funding from the Plant Phenotyping and Imaging Research Center through a grant from the Canada First Research Excellence Fund.Many thanks are due to Steve Shirtliffe,Scott Noble,Tyrone Keep,Keith Halco,and Craig Gavelin for managing the field site and collecting images.Rothamsted Research received support from the Biotechnology and Biological Sciences Research Council(BBSRC)of the United Kingdom as part of the Designing Future Wheat(BB/P016855/1)project.We are also thankful to Prof.MalcolmJ.Hawkesford,who leads the DFWproject and Dr.Nicolas Virlet for conducting the experiment at Rothamsted Research.The Gatton,Australia dataset was collected on a field trial conducted by CSIRO and UQ,with trial conduct and measurements partly funded by the Grains Research and Development Corporation(GRDC)in project CSP00179.A new GRDC project involves several of the authors and supports their contribution to this paper.The dataset collected in China was supported by the Program for High-Level Talents Introduction of Nanjing Agricultural University(440—804005).Many thanks are due to Jie Zhou and many volunteers from Nanjing Agricultural University to accomplish the annotation.The dataset collection at ETHZ was supported by Prof.AchimWalter,who leads the Crop Science group.Many thanks are due to Kevin Keller for the initial preparation of the ETHZ dataset and Lara Wyser,Ramon Winterberg,Damian Käch,Marius Hodel,and Mario Serouard(INRAE)for the annotation of the ETHZ dataset and to Brigita Herzog and Hansueli Zellweger for crop husbandry.
文摘The detection of wheat heads in plant images is an important task for estimating pertinent wheat traits including head population density and head characteristics such as health,size,maturity stage,and the presence of awns.Several studies have developed methods for wheat head detection from high-resolution RGB imagery based on machine learning algorithms.However,these methods have generally been calibrated and validated on limited datasets.High variability in observational conditions,genotypic differences,development stages,and head orientation makes wheat head detection a challenge for computer vision.Further,possible blurring due to motion or wind and overlap between heads for dense populations make this task even more complex.Through a joint international collaborative effort,we have built a large,diverse,and well-labelled dataset of wheat images,called the Global Wheat Head Detection(GWHD)dataset.It contains 4700 high-resolution RGB images and 190000 labelled wheat heads collected from several countries around the world at different growth stages with a wide range of genotypes.Guidelines for image acquisition,associating minimum metadata to respect FAIR principles,and consistent head labelling methods are proposed when developing new head detection datasets.The GWHD dataset is publicly available at http://www.global-wheat.com/and aimed at developing and benchmarking methods for wheat head detection.
基金supported by the National Key R&D Program of China(nos.2021YFD2000105 and 2022YFE0116200)Jiangsu Funding Program for Excellent Postdoctoral Talent(no.2022ZB349)+3 种基金Young Scientists Fund of the Natural Science Foundation of Jiangsu Province,China(no.BK20210411)Young Scientists Fund of the National Natural Science Foundation of China(no.42201437)Fundamental Research Funds for the Central Universities of Ministry of Education of China(no.KYCXJC2022005)Project of Seed Industry Revitalization in Jiangsu Province,China(JBGS[2021]007).
文摘The number of leaves at a given time is important to characterize plant growth and development.In this work,we developed a high-throughput method to count the number of leaves by detecting leaf tips in RGB images.The digital plant phenotyping platform was used to simulate a large and diverse dataset of RGB images and corresponding leaf tip labels of wheat plants at seedling stages(150,000 images with over 2 million labels).The realism of the images was then improved using domain adaptation methods before training deep learning models.The results demonstrate the efficiency of the proposed method evaluated on a diverse test dataset,collecting measurements from 5 countries obtained under different environments,growth stages,and lighting conditions with different cameras(450 images with over 2,162 labels).Among the 6 combinations of deep learning models and domain adaptation techniques,the Faster-RCNN model with cycle-consistent generative adversarial network adaptation technique provided the best performance(R^(2)=0.94,root mean square error=8.7).Complementary studies show that it is essential to simulate images with sufficient realism(background,leaf texture,and lighting conditions)before applying domain adaptation techniques.Furthermore,the spatial resolution should be better than 0.6 mm per pixel to identify leaf tips.The method is claimed to be self-supervised since no manual labeling is required for model training.The self-supervised phenotyping approach developed here offers great potential for addressing a wide range of plant phenotyping problems.The trained networks are available at https://github.com/YinglunLi/Wheat-leaf-tip-detection.
基金the Special Foundation of National Science&TechnologySupporting Plan(No.2011BAD29B04&No.2013BAD20B03).
文摘Jujube is widely cultivated in the semi-arid region of the Loess Plateau in Northwest China due to its high water deficit tolerance.In such an ecologically vulnerable area,it is critical to explore the water consumption processes of key tree species and their responses to driving factors.Sap flow data gathered during a two-year field study in a jujube plantation were analyzed as a surrogate for transpiration measurements.The measured sap flows were related to changes in the soil water content,meteorological factors(the vapor pressure deficit and the level of photosynthetically active radiation),and plant physiological factors(the sap wood area,leaf area and leaf area index).The factors that govern sap flow were found to vary depending on the growing season,and on hourly and daily timescales.The plants’drought tolerance could be predicted based on their peak sap flows and the variation in their sap flow rates at different soil water levels.The sap flow was most strongly affected by the water content of the topmost(0-20 cm)soil layer.Of the studied meteorological factors,the photosynthetically active radiation had a greater effect on sap flow than the vapor pressure deficit.The correlation we found could be applied to predict jujube tree water consumption and assist the design of irrigation scheme.
基金supported by the Nat-ural Science Foundation of Jiangsu Province(No.BK20211210)the Fundamental Research Funds for the Central Universities(KYCXJC2022005)+1 种基金the startup award of new professors at Nanjing Agricultural University(No.106/804001)supported by the Natural Science Foundation of Zhejiang province(No.LY20F020003).
文摘Deep learning has been widely used for plant disease recognition in smart agriculture and has proven to be a powerful tool for image classification and pattern recognition.However,it has limited interpretability for deep features.With the transfer of expert knowledge,handcrafted features provide a new way for personalized diagnosis of plant diseases.However,irrelevant and redundant features lead to high dimensionality.In this study,we proposed a swarm intelligence algorithm for feature selection[salp swarm algorithm for feature selection(SSAFS)]in image-based plant disease detection.SSAFS is employed to determine the ideal combination of handcrafted features to maximize classification success while minimizing the number of features.To verify the effectiveness of the developed SSAFS algorithm,we conducted experimental studies using SSAFS and 5 metaheuristic algorithms.Several evaluation metrics were used to evaluate and analyze the performance of these methods on 4 datasets from the UCI machine learning repository and 6 plant phenomics datasets from PlantVillage.Experimental results and statistical analyses validated the outstanding performance of SSAFS compared to existing state-of-the-art algorithms,confirming the superiority of SSAFS in exploring the feature space and identifying the most valuable features for diseased plant image classification.This computational tool will allow us to explore an optimal combination of handcrafted features to improve plant disease recognition accuracy and processing time.
基金supported by the National Key R&D Program of China(nos.2022YFD2300700 and 2022YFE0116200)National Key R&D Program of China(no.2021YFD2000105)+4 种基金Young Scientists Fund of the Natural Science Foundation of Jiangsu Province,China(no.BK20210411)Young Scientists Fund of the National Natural Science Foundation of China(no.42201437)Fundamental Research Funds for the Central Universities of Ministry of Education of China(no.KYCXJC2022005)Project of Seed Industry Revitalization in Jiangsu Province(JBGS[2021]007)Hainan Yazhou Bay Seed Lab(no.B21HJ1005).
文摘Accurate assessment of crop biochemical profiles plays a crucial role in diagnosing their physiological status.The conventional destructive methods,although reliable,demand extensive laboratory work for measuring various traits.On the other hand,nondestructive techniques,while efficient and adaptable,often suffer from reduced precision due to the intricate interplay of the field environment and canopy structure.Striking a delicate balance between efficiency and accuracy,we have developed the Bio-Master phenotyping system.This system is capable of simultaneously measuring four vital biochemical components of the canopy profile:dry matter,water,chlorophyll,and nitrogen content.Bio-Master initiates the process by addressing structural influences,through segmenting the fresh plant and then further chopping the segment into uniform small pieces.Subsequently,the system quantifies hyperspectral reflectance and fresh weight over the sample within a controlled dark chamber,utilizing an independent light source.The final step involves employing an embedded estimation model to provide synchronous estimates for the four biochemical components of the measured sample.In this study,we established a comprehensive training dataset encompassing a wide range of rice varieties,nitrogen levels,and growth stages.Gaussian process regression model was used to estimate biochemical contents utilizing reflectance data obtained by Bio-Master.Leave-one-out validation revealed the model's capacity to accurately estimate these contents at both leaf and plant scales.With Bio-Master,measuring a single rice plant takes approximately only 5 min,yielding around 10 values for each of the four biochemical components across the vertical profile.Furthermore,the Bio-Master system allows for immediate measurements near the field,mitigating potential alterations in plant status during transportation and processing.As a result,our measurements are more likely to faithfully represent in situ values.To summarize,the Bio-Master phenotyping system offers an efficient tool for comprehensive crop biochemical profiling.It harnesses the benefits of remote sensing techniques,providing significantly greater efficiency than conventional destructive methods while maintaining superior accuracy when compared to nondestructive approaches.