Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.)
Substantial effort has been made in manually tracking plant maturity and to measure early-stage plant density and crop height in experimental fields. In this study, RGB drone imagery and deep learning (DL) approaches are explored to measure relative maturity (RM), stand count (SC), and plant height...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Association for the Advancement of Science (AAAS)
2024-01-01
|
| Series: | Plant Phenomics |
| Online Access: | https://spj.science.org/doi/10.34133/plantphenomics.0278 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846150856766914560 |
|---|---|
| author | Leonardo Volpato Evan M. Wright Francisco E. Gomez |
| author_facet | Leonardo Volpato Evan M. Wright Francisco E. Gomez |
| author_sort | Leonardo Volpato |
| collection | DOAJ |
| description | Substantial effort has been made in manually tracking plant maturity and to measure early-stage plant density and crop height in experimental fields. In this study, RGB drone imagery and deep learning (DL) approaches are explored to measure relative maturity (RM), stand count (SC), and plant height (PH), potentially offering higher throughput, accuracy, and cost-effectiveness than traditional methods. A time series of drone images was utilized to estimate dry bean RM employing a hybrid convolutional neural network (CNN) and long short-term memory (LSTM) model. For early-stage SC assessment, Faster RCNN object detection algorithm was evaluated. Flight frequencies, image resolution, and data augmentation techniques were investigated to enhance DL model performance. PH was obtained using a quantile method from digital surface model (DSM) and point cloud (PC) data sources. The CNN-LSTM model showed high accuracy in RM prediction across various conditions, outperforming traditional image preprocessing approaches. The inclusion of growing degree days (GDD) data improved the model’s performance under specific environmental stresses. The Faster R-CNN model effectively identified early-stage bean plants, demonstrating superior accuracy over traditional methods and consistency across different flight altitudes. For PH estimation, moderate correlations with ground-truth data were observed across both datasets analyzed. The choice between PC and DSM source data may depend on specific environmental and flight conditions. Overall, the CNN-LSTM and Faster R-CNN models proved more effective than conventional techniques in quantifying RM and SC. The subtraction method proposed for estimating PH without accurate ground elevation data yielded results comparable to the difference-based method. Additionally, the pipeline and open-source software developed hold potential to significantly benefit the phenotyping community. |
| format | Article |
| id | doaj-art-e10469ab8e2f447b8c92eb0a3bc070e3 |
| institution | Kabale University |
| issn | 2643-6515 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | American Association for the Advancement of Science (AAAS) |
| record_format | Article |
| series | Plant Phenomics |
| spelling | doaj-art-e10469ab8e2f447b8c92eb0a3bc070e32024-11-28T08:00:28ZengAmerican Association for the Advancement of Science (AAAS)Plant Phenomics2643-65152024-01-01610.34133/plantphenomics.0278Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.)Leonardo Volpato0Evan M. Wright1Francisco E. Gomez2Department of Plant, Soil, and Microbial Sciences, Michigan State University, East Lansing, MI 48824, USA.Department of Plant, Soil, and Microbial Sciences, Michigan State University, East Lansing, MI 48824, USA.Department of Plant, Soil, and Microbial Sciences, Michigan State University, East Lansing, MI 48824, USA.Substantial effort has been made in manually tracking plant maturity and to measure early-stage plant density and crop height in experimental fields. In this study, RGB drone imagery and deep learning (DL) approaches are explored to measure relative maturity (RM), stand count (SC), and plant height (PH), potentially offering higher throughput, accuracy, and cost-effectiveness than traditional methods. A time series of drone images was utilized to estimate dry bean RM employing a hybrid convolutional neural network (CNN) and long short-term memory (LSTM) model. For early-stage SC assessment, Faster RCNN object detection algorithm was evaluated. Flight frequencies, image resolution, and data augmentation techniques were investigated to enhance DL model performance. PH was obtained using a quantile method from digital surface model (DSM) and point cloud (PC) data sources. The CNN-LSTM model showed high accuracy in RM prediction across various conditions, outperforming traditional image preprocessing approaches. The inclusion of growing degree days (GDD) data improved the model’s performance under specific environmental stresses. The Faster R-CNN model effectively identified early-stage bean plants, demonstrating superior accuracy over traditional methods and consistency across different flight altitudes. For PH estimation, moderate correlations with ground-truth data were observed across both datasets analyzed. The choice between PC and DSM source data may depend on specific environmental and flight conditions. Overall, the CNN-LSTM and Faster R-CNN models proved more effective than conventional techniques in quantifying RM and SC. The subtraction method proposed for estimating PH without accurate ground elevation data yielded results comparable to the difference-based method. Additionally, the pipeline and open-source software developed hold potential to significantly benefit the phenotyping community.https://spj.science.org/doi/10.34133/plantphenomics.0278 |
| spellingShingle | Leonardo Volpato Evan M. Wright Francisco E. Gomez Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.) Plant Phenomics |
| title | Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.) |
| title_full | Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.) |
| title_fullStr | Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.) |
| title_full_unstemmed | Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.) |
| title_short | Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.) |
| title_sort | drone based digital phenotyping to evaluating relative maturity stand count and plant height in dry beans phaseolus vulgaris l |
| url | https://spj.science.org/doi/10.34133/plantphenomics.0278 |
| work_keys_str_mv | AT leonardovolpato dronebaseddigitalphenotypingtoevaluatingrelativematuritystandcountandplantheightindrybeansphaseolusvulgarisl AT evanmwright dronebaseddigitalphenotypingtoevaluatingrelativematuritystandcountandplantheightindrybeansphaseolusvulgarisl AT franciscoegomez dronebaseddigitalphenotypingtoevaluatingrelativematuritystandcountandplantheightindrybeansphaseolusvulgarisl |