Hostname: page-component-55f67697df-twqc4 Total loading time: 0 Render date: 2025-05-11T06:08:14.013Z Has data issue: false hasContentIssue false

Spectral discrimination of crops and weeds using deep learning assisted by wavelet transform and statistical preprocessing

Published online by Cambridge University Press:  12 November 2024

Vahid Mohammadi
Affiliation:
Doctoral Student, Biosystems Engineering Department, Faculty of Agriculture, Tarbiat Modares University, Tehran, Iran, and ImViA, UFR Sciences et Techniques, Université de Bourgogne, Franche-Comté, Dijon, France
Saeid Minaei*
Affiliation:
Professor, Biosystems Engineering Department, Faculty of Agriculture, Tarbiat Modares University, Tehran, Iran
Pierre Gouton
Affiliation:
Professor, ImViA, UFR Sciences et Techniques, Université de Bourgogne, Franche-Comté, Dijon, France
Ali Reza Mahdavian
Affiliation:
Assistant Professor, Biosystems Engineering Department, Faculty of Agriculture, Tarbiat Modares University, Tehran, Iran
Mohammad Hadi Khoshtaghaza
Affiliation:
Professor, Biosystems Engineering Department, Faculty of Agriculture, Tarbiat Modares University, Tehran, Iran
*
Corresponding author: Saeid Minaei; Email: [email protected]

Abstract

Automatic detection and removal of weeds is a challenging task that requires precise sensors. While crops and weeds possess similar features in terms of appearance, they can be discriminated based on spectral information. This can be done because any object has its own specific spectral signature based on its physical structure and chemical contents. This study examined the use of wavelet transform and deep learning for discrimination of weeds from crops. A total of 626 spectral reflectances in the range of 380 to 1,000 nm were obtained for three crops (cucumber [Cucumis sativus L.], tomato [Solanum lycopersicum L.], and bell pepper [Capsicum annuum L.]) and five different weeds (bindweed [Convolvulus spp.], purple nutsedge [Cyperus rotundus L.], narrowleaf plantain [Plantago lanceolata L.], common cinquefoil [Potentilla simplex Michx.], and garden sorrel [Rumex acetosa L.]). Morse wavelet was employed to decompose the spectra and extract the scalograms, which are the RGB representations of the spectral data. Two deep convolutional neural networks (i.e., GoogLeNet and SqueezNet) were employed for the recognition of crops and weeds. In addition, six common classifiers, including linear discriminant analysis, quadratic discriminant analysis, linear support vector machine, quadratic support vector machine, artificial neural networks, and k-nearest neighbors classifier (KNN), were used for the task of crop/weed discrimination to build the comparison with the proposed method. The error of prediction gradually decreased, and a 100% correct classification was achieved after 258 iterations. Analysis showed that SqueezNet provided classification of 100% accuracy, while GoogLeNet’s accuracy was 97.8% for the test set. Among the common classifiers, KNN provided the highest accuracy (i.e., 100%). This study showed that the proposed method can be successfully utilized for classification of crops and weeds.

Type
Research Article
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of Weed Science Society of America

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

Associate Editor: William Vencill, University of Georgia

References

Abdulridha, J, Ampatzidis, Y, Ehsani, R, de Castro, AI (2018) Evaluating the performance of spectral features and multivariate analysis tools to detect laurel wilt disease and nutritional deficiency in avocado. Comput Electron Agric 155:203211 CrossRefGoogle Scholar
Acquah, GE, Via, BK, Billor, N, Fasina, OO (2016) Eckhardt LG. Identifying plant part composition of forest logging residue using infrared spectral data and linear discriminant analysis. Sensors 16:13751390 CrossRefGoogle ScholarPubMed
Adelabu, S, Mutanga, O, Adam, E, Sebego, R (2013) Spectral discrimination of insect defoliation levels in mopane woodland using hyperspectral data. IEEE J Sel Top Appl Earth Obs Remote Sens 7:177186 CrossRefGoogle Scholar
Agüera-Vega, F, Agüera-Puntas, M, Agüera-Vega, J, Martínez-Carricondo, P, Carvajal-Ramírez, F (2021) Multi-sensor imagery rectification and registration for herbicide testing. Measurement 175:109049 CrossRefGoogle Scholar
Akbarzadeh, S, Paap, A, Ahderom, S, Apopei, B, Alameh, K (2018) Plant discrimination by Support Vector Machine classifier based on spectral reflectance. Comput Electron Agric 148:250258 CrossRefGoogle Scholar
Amirvaresi, A, Nikounezhad, N, Amirahmadi, M, Daraei, B, Parastar, H (2021) Comparison of near-infrared (NIR) and mid-infrared (MIR) spectroscopy based on chemometrics for saffron authentication and adulteration detection. Food Chem 344:128647 CrossRefGoogle ScholarPubMed
Andrea, CC, Daniel, BB, Misael, JB (2017) Precise weed and maize classification through convolutional neuronal networks. Pages 16 in 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM), 16–20 October 2017. Salinas, Ecuador: IEEE Google Scholar
Andújar, D, Calle, M, Fernández-Quintanilla, C, Ribeiro, Á, Dorado, J (2018) Three-dimensional modeling of weed plants using low-cost photogrammetry. Sensors 18:1077 CrossRefGoogle ScholarPubMed
Ayala-Silva, T, Beyl, CA (2005) Changes in spectral reflectance of wheat leaves in response to specific macronutrient deficiency. Adv Space Res 35:305317 CrossRefGoogle ScholarPubMed
Barrero, O, Perdomo, SA (2018) RGB and multispectral UAV image fusion for Gramineae weed detection in rice fields. Precis Agric 19:809822 CrossRefGoogle Scholar
Bell, IE, Baranoski, GV (2004) Reducing the dimensionality of plant spectral databases. IEEE Trans Geosci Remote Sens 42:570576 CrossRefGoogle Scholar
Bradter, U, O’Connell, J, Kunin, WE, Boffey, CW, Ellis, RJ, Benton, TG (2020) Classifying grass-dominated habitats from remotely sensed data: the influence of spectral resolution, acquisition time and the vegetation classification system on accuracy and thematic resolution. Sci Total Environ 711:134584 CrossRefGoogle ScholarPubMed
Buddenhagen, CE, Gunnarsson, M, Rolston, P, Chynoweth, RJ, Bourdot, G, James, TK (2020) Costs and risks associated with surveying the extent of herbicide resistance in New Zealand. NZ J Agric Res 63:430448 CrossRefGoogle Scholar
Che’Ya, NN, Dunwoody, E, Gupta, M (2021) Assessment of weed classification using hyperspectral reflectance and optimal multispectral UAV imagery. Agronomy 11:1435 CrossRefGoogle Scholar
Cordon, G, Andrade, C, Barbara, L, Romero, AM (2021) Early detection of tomato bacterial canker by reflectance indices. Inf Process Agric 9:184194 Google Scholar
De Souza, MF, do Amaral, LR, de Medeiros Oliveira, SR, Coutinho, MAN, Netto, CF (2020) Spectral differentiation of sugarcane from weeds. Biosyst Eng 190:4146 CrossRefGoogle Scholar
Durgante, FM, Higuchi, N, Almeida, A, Vicentini, A (2013) Species spectral signature: discriminating closely related plant species in the Amazon with near-infrared leaf-spectroscopy. For Ecol Manag 291:240248 CrossRefGoogle Scholar
Esposito, M, Crimaldi, M, Cirillo, V, Sarghini, F, Maggio, A (2021) Drone and sensor technology for sustainable weed management: a review. Chem Biol Technol Agric 8:111 CrossRefGoogle Scholar
Falcioni, R, Moriwaki, T, Pattaro, M, Furlanetto, RH, Nanni, MR, Antunes, WC (2020) High resolution leaf spectral signature as a tool for foliar pigment estimation displaying potential for species differentiation. J Plant Physiol 249:153161 CrossRefGoogle ScholarPubMed
Fletcher, RS, Reddy, KN, Turley, RB (2016) Spectral discrimination of two pigweeds from cotton with different leaf colors. Am J Plant Sci 7:21382151 CrossRefGoogle Scholar
Garibaldi-Márquez, F, Flores, G, Mercado-Ravell, DA, Ramírez-Pedraza, A, Valentín-Coronado, LM (2022) Weed classification from natural corn field-multi-plant images based on shallow and deep learning. Sensors 22:3021 CrossRefGoogle ScholarPubMed
Gerhards, R, Andujar Sanchez, D, Hamouz, P, Peteinatos, GG, Christensen, S, Fernandez-Quintanilla, C (2022) Advances in site-specific weed management in agriculture—a review. Weed Res 62:123133 CrossRefGoogle Scholar
Gómez-Casero, MT, Castillejo-González, IL, García-Ferrer, A, Peña-Barragán, JM, Jurado-Expósito, M, García-Torres, L, López-Granados, F (2010) Spectral discrimination of wild oat and canary grass in wheat fields for less herbicide application. Agron Sustain Dev 30:689699 CrossRefGoogle Scholar
Hennessy, A, Clarke, K, Lewis, M (2020) Hyperspectral classification of plants: a review of waveband selection generalisability. Remote Sens 12:113 CrossRefGoogle Scholar
Hom, KMH, Bajwa, SG, Lym, RG, Nowatzki, JF (2020) Discrimination of leafy spurge (Euphorbia esula) and purple loosestrife (Lythrum salicaria) based on field spectral data. Weed Technol 34:250259 CrossRefGoogle Scholar
Hua, W, Lin, Z, Guo, D, Fan, G, Zhang, Y, Yang, K, Hu, Q, Zhu, L (2019) Simulated long-term vegetation–climate feedbacks in the Tibetan Plateau. Asia-Pac J Atmos Sci 55:4152 CrossRefGoogle Scholar
Huang, Y, Li, J, Yang, R, Wang, F, Li, Y, Zhang, S, Wan, F, Qiao, X, Qian, W (2021) Hyperspectral imaging for identification of an invasive plant Mikania micrantha Kunth. Front Plant Sci 12:626516 CrossRefGoogle ScholarPubMed
Iqbal, N, Khaliq, A, Cheema, ZA (2020) Weed control through allelopathic crop water extracts and S-metolachlor in cotton. Inf Process Agric 7:165172 Google Scholar
Jarocińska, A, Kopeć, D, Tokarska-Guzik, B, Raczko, E (2021) Intra-annual variabilities of Rubus caesius L. discrimination on hyperspectral and LiDAR data. Remote Sens 13:107129 CrossRefGoogle Scholar
Jiang, J, Steven, MD, He, R, Chen, Y, Du, P, Guo, H (2015) Identifying the spectral responses of several plant species under CO2 leakage and waterlogging stresses. Int J Greenhouse Gas Control 37:111 CrossRefGoogle Scholar
Jiang, H, Zhang, C, Qiao, Y, Zhang, Z, Zhang, W, Song, C (2020) CNN feature based graph convolutional network for weed and crop recognition in smart farming. Comput Electron Agric 174:105450 CrossRefGoogle Scholar
Jin, X, Bagavathiannan, M, Maity, A, Chen, Y, Yu, J (2022) Deep learning for detecting herbicide weed control spectrum in turfgrass. Plant Methods 18:94 CrossRefGoogle ScholarPubMed
Jones, EA, Austin, R, Dunne, JC, Leon, RG, Everman, WJ (2023) Discrimination between protoporphyrinogen oxidase–inhibiting herbicide-resistant and herbicide-susceptible redroot pigweed (Amaranthus retroflexus) with spectral reflectance. Weed Sci 71:198205 CrossRefGoogle Scholar
Kamath, R, Balachandra, M, Prabhu, S (2020) Crop and weed discrimination using Laws’ texture masks. Int J Agric Biol Eng 13:191197 Google Scholar
Le, VNT, Apopei, B, Alameh, K (2019) Effective plant discrimination based on the combination of local binary pattern operators and multiclass support vector machine methods. Inf Process Agric 6:116131 Google Scholar
Li, Y, Al-Sarayreh, M, Irie, K, Hackell, D, Bourdot, G, Reis, MM, Ghamkhar, K (2021) Identification of weeds based on hyperspectral imaging and machine learning. Front Plant Sci 11:611622 CrossRefGoogle ScholarPubMed
Liang, WC, Yang, YJ, Chao, CM (2019) Low-cost weed identification system using drones. Pages 260263 in Seventh International Symposium on Computing and Networking Workshops, 26–29 November 2019. Nagasaki, Japan: IEEE Google Scholar
Liu, B, Li, R, Li, H, You, G, Yan, S, Tong, Q (2019) Crop/weed discrimination using a field imaging spectrometer system. Sensors 19:5154 CrossRefGoogle ScholarPubMed
Longchamps, L, Panneton, B, Samson, G, Leroux, GD, Thériault, R (2010) Discrimination of corn, grasses and dicot weeds by their UV-induced fluorescence spectral signature. Precis Agric 11:181197 CrossRefGoogle Scholar
Louargant, M, Jones, G, Faroux, R, Paoli, JN, Maillot, T, Gée, C, Villette, S (2018) Unsupervised classification algorithm for early weed detection in row-crops by combining spatial and spectral information. Remote Sens 10:761779 CrossRefGoogle Scholar
Mahlein, AK, Rumpf, T, Welke, P, Dehne, HW, Plümer, L, Steiner, U, Oerke, EC (2013) Development of spectral indices for detecting and identifying plant diseases. Remote Sens Environ 128:2130 CrossRefGoogle Scholar
Mahlein, AK, Steiner, U, Dehne, HW, Oerke, EC (2010) Spectral signatures of sugar beet leaves for the detection and differentiation of diseases. Precis Agric 11:413431 CrossRefGoogle Scholar
Manevski, K, Manakos, I, Petropoulos, GP, Kalaitzidis, C (2011) Discrimination of common Mediterranean plant species using field spectroradiometry. Int J Appl Earth Obs Geoinf 13:922933 Google Scholar
Nagasubramanian, K, Jones, S, Singh, AK, Sarkar, S, Singh, A, Ganapathysubramanian, B (2019) Plant disease identification using explainable 3D deep learning on hyperspectral images. Plant Methods 15:110 CrossRefGoogle ScholarPubMed
Nguyen, C, Sagan, V, Maimaitiyiming, M, Maimaitijiang, M, Bhadra, S, Kwasniewski, MT (2021) Early detection of plant viral disease using hyperspectral imaging and deep learning. Sensors 21:742 CrossRefGoogle ScholarPubMed
Nidamanuri, RR (2020) Hyperspectral discrimination of tea plant varieties using machine learning, and spectral matching methods. Remote Sens Appl 19:100350 Google Scholar
Noble, SD, Brown, RB (2009) Plant species discrimination using spectral/spatial descriptive statistics. Pages 82–92 in Proceedings of the 1st International Workshop on Computer Image Analysis in Agriculture, August 27–28. Potsdam, GermanyGoogle Scholar
Osorio, K, Puerto, A, Pedraza, C, Jamaica, D, Rodríguez, L (2020) A deep learning approach for weed detection in lettuce crops using multispectral images. AgriEngineering 2:471488 CrossRefGoogle Scholar
Özlüoymak, ÖB (2020) Determination of plant height for crop and weed discrimination by using stereo vision system. Tekirdağ Ziraat Fakültesi Dergisi 17:97107 CrossRefGoogle Scholar
Pignatti, S, Casa, R, Harfouche, A, Huang, W, Palombo, A, Pascucci, S (2019) Maize crop and weeds species detection by using UAV VNIR hyperpectral data. Pages 72357238 in IEEE International Geoscience and Remote Sensing Symposium, 28 July 2019 – 02 August 2019. Yokohama, Japan: IEEE Google Scholar
Prospere, K, McLaren, K, Wilson, B (2014) Plant species discrimination in a tropical wetland using in situ hyperspectral data. Remote Sens 6:84948523 CrossRefGoogle Scholar
Putra, BTW (2020) New low-cost portable sensing system integrated with on-the-go fertilizer application system for plantation crops. Measurement 155:107562 CrossRefGoogle Scholar
Rasmussen, J, Azim, S, Nielsen, J (2021) Pre-harvest weed mapping of Cirsium arvense L. based on free satellite imagery—the importance of weed aggregation and image resolution. Eur J Agron 130:126373 CrossRefGoogle Scholar
Reiser, D, Vázquez-Arellano, M, Paraforos, DS, Garrido-Izard, M, Griepentrog, HW (2018) Iterative individual plant clustering in maize with assembled 2D LiDAR data. Comput Ind 99:4252 CrossRefGoogle Scholar
Revanasiddappa, B, Arvind, CS, Swamy, S (2020) Real-time early detection of weed plants in pulse crop field using drone with IoT. Int J Agric Technol 16:12271242 Google Scholar
Rock, G, Gerhards, M, Schlerf, M, Hecker, C, Udelhoven, T (2016) Plant species discrimination using emissive thermal infrared imaging spectroscopy. Int J Appl Earth Obs Geoinf 53:1626 Google Scholar
Sabzi, S, Abbaspour-Gilandeh, Y (2018) Using video processing to classify potato plant and three types of weed using hybrid of artificial neural network and particle swarm algorithm. Meas 126:2236 CrossRefGoogle Scholar
Sandoval, JD, Gor, SR, Ramallo, J, Sfer, A, Colombo, E, Vilaseca, M, Pujol, J (2012) Spectral signatures: a way to identify species and conditions of vegetables. Pages 308321 in Caivano, JL, Buera, MD, eds. Color in Food. Boca Raton, FL: CRC Press Google Scholar
Sayed Yones, M, Amin Aboelghar, M, Ali Khdery, G, Massoud Ali, A, Hussien Salem, N, Farag, E, Ahmed Mahmoud Mamon, S (2019) Spectral measurements for monitoring of sugar beet infestation and its relation with production. Asian J Agric Biol 7:386–95Google Scholar
Shafri, HZ, Anuar, MI, Seman, IA, Noor, NM (2011) Spectral discrimination of healthy and Ganoderma-infected oil palms from hyperspectral data. Int J Remote Sens 32:71117129 CrossRefGoogle Scholar
Shahbazi, N, Ashworth, MB, Callow, JN, Mian, A, Beckie, HJ, Speidel, S, Nicholls, E, Flower, KC (2021) Assessing the capability and potential of LiDAR for weed detection. Sensors 21:2328 CrossRefGoogle ScholarPubMed
Shanmugam, S, Assunção, E, Mesquita, R, Veiros, A, Gaspar, PD (2020) Automated weed detection systems: a review. KnE Eng 5:271284 Google Scholar
Shendryk, Y, Rossiter-Rachor, NA, Setterfield, SA, Levick, SR (2020) Leveraging high-resolution satellite imagery and gradient boosting for invasive weed mapping. IEEE J Sel Top Appl Earth Obs Remote Sens 13:44434450 CrossRefGoogle Scholar
Shirzadifar, A, Bajwa, S, Mireei, SA, Howatt, K, Nowatzki, J (2018) Weed species discrimination based on SIMCA analysis of plant canopy spectral data. Biosyst Eng 171:143154 CrossRefGoogle Scholar
Silalahi, DD, Reaño, CE, Lansigan, FP, Panopio, RG, Bantayan, NC (2016) Using genetic algorithm neural network on near infrared spectral data for ripeness grading of oil palm (Elaeis guineensis Jacq.) fresh fruit. Inf Process Agric 3:252261 Google Scholar
Slaven, MJ, Koch, M, Borger, CP (2023) Exploring the potential of electric weed control: a review. Weed Sci 71:403421 CrossRefGoogle Scholar
Sodjinou, SG, Mohammadi, V, Mahama, ATS, Gouton, P (2021) A deep semantic segmentation-based algorithm to segment crops and weeds in agronomic color images. Inf Process Agric 9:355364 Google Scholar
Strothmann, W, Ruckelshausen, A, Hertzberg, J, Scholz, C, Langsenkamp, F (2017) Plant classification with in-field-labeling for crop/weed discrimination using spectral features and 3d surface features from a multi-wavelength laser line profile system. Comput Electron Agric 134:7993 CrossRefGoogle Scholar
Su, J, Yi, D, Coombes, M, Liu, C, Zhai, X, McDonald-Maier, K, Chen, WH (2022) Spectral analysis and mapping of blackgrass weed by leveraging machine learning and UAV multispectral imagery. Comput Electron Agric 192:106621 CrossRefGoogle Scholar
Su, WH (2020) Advanced machine learning in point spectroscopy, RGB-and hyperspectral-imaging for automatic discriminations of crops and weeds: a review. Smart Cities 3:767792 CrossRefGoogle Scholar
Su, WH, Fennimore, SA, Slaughter, DC (2019) Fluorescence imaging for rapid monitoring of translocation behaviour of systemic markers in snap beans for automated crop/weed discrimination. Biosyst Eng 186:156167 CrossRefGoogle Scholar
Subeesh, A, Bhole, S, Singh, K, Chandel, NS, Rajwade, YA, Rao, KVR, Kumar, SP, Jat, D (2022) Deep convolutional neural network models for weed detection in polyhouse grown bell peppers. Artif Intell Agric 6:4754 Google Scholar
Sulaiman, N, Che’Ya, NN, Mohd-Roslim, MH, Juraimi, AS, Mohd-Noor, N, Fazlil-Ilahi, WF (2022) The application of Hyperspectral Remote Sensing Imagery (HRSI) for weed detection analysis in rice fields: a review. Appl Sci 12:2570 CrossRefGoogle Scholar
Sunil, GC, Koparan, C, Ahmed, MR, Zhang, Y, Howatt, K, Sun, X (2022) A study on deep learning algorithm performance on weed and crop species identification under different image background. Artif Intell Agric 6:242256 Google Scholar
Symonds, P, Paap, A, Alameh, K, Rowe, J, Miller, C (2015) A real-time plant discrimination system utilising discrete reflectance spectroscopy. Comput Electron Agric 117:5769 CrossRefGoogle Scholar
Talaviya, T, Shah, D, Patel, N, Yagnik, H, Shah, M (2020) Implementation of artificial intelligence in agriculture for optimisation of irrigation and application of pesticides and herbicides. Artif Intell Agric 4:5873 Google Scholar
Tao, T, Wei, X (2022) A hybrid CNN–SVM classifier for weed recognition in winter rape field. Plant Methods 18:29 CrossRefGoogle ScholarPubMed
Türker-Kaya, S, Huck, CW (2017) A review of mid-infrared and near-infrared imaging: principles, concepts and applications in plant tissue analysis. Molecules 22:168 CrossRefGoogle Scholar
Ullah, S, Schlerf, M, Skidmore, AK, Hecker, C (2012) Identifying plant species using mid-wave infrared (2.5–6 μm) and thermal infrared (8–14 μm) emissivity spectra. Remote Sens Environ 118:95102 CrossRefGoogle Scholar
Vaiphasa, C, Skidmore, AK, de Boer, WF, Vaiphasa, T (2007) A hyperspectral band selector for plant species discrimination. ISPRS J Photogramm Remote Sens 62:225235 CrossRefGoogle Scholar
Wang, J, Chen, G, Ju, J, Lin, T, Wang, R, Wang, Z (2023) Characterization and classification of urban weed species in northeast China using terrestrial hyperspectral images. Weed Sci 71:353368 CrossRefGoogle Scholar
Xi, QI, Li, YZ, Su, GY, Tian, HK, Zhang, S, Sun, ZY, Long, YA, Wan, FH, Qian, WQ (2020) MmNet: identifying Mikania micrantha Kunth in the wild via a deep Convolutional Neural Network. J Integr Agric 19:1292–300Google Scholar
Yang, W, Yang, C, Hao, Z, Xie, C, Li, M (2019) Diagnosis of plant cold damage based on hyperspectral imaging and convolutional neural network. IEEE Access 7:118239118248 CrossRefGoogle Scholar
Yu, J, Schumann, AW, Sharpe, SM, Li, X, Boyd, NS (2020) Detection of grassy weeds in bermudagrass with deep convolutional neural networks. Weed Sci 68:545552 CrossRefGoogle Scholar
Zarco-Tejada, PJ, Camino, C, Beck, PSA, Calderon, R, Hornero, A, Hernández-Clemente, R, Kattenborn, T, Montes-Borrego, M, Susca, L, Morelli, M, Gonzalez-Dugo, V (2018) Previsual symptoms of Xylella fastidiosa infection revealed in spectral plant-trait alterations. Nat Plants 4:432439 CrossRefGoogle ScholarPubMed