DOI: https://doi.org/10.14710/jtsiskom.2020.13733

Maturity classification of cacao through spectrogram and convolutional neural network

Department of Computer and Electronics Engineering, Cavite State University, Philippines

Received: 1 May 2020; Revised: 24 May 2020; Accepted: 4 Jun 2020; Available online: 8 Jun 2020; Published: 31 Jul 2020.
Open Access Copyright (c) 2020 Jurnal Teknologi dan Sistem Komputer under http://creativecommons.org/licenses/by-sa/4.0.

Citation Format:
Abstract
Cacao pod's ideal harvesting time is when it is about to be ripe. Immature harvest would result in hard cacao beans not suitable for fermentation, while overripe cacao pods lead to fungal-infected, defective, and poor-quality yields. The demand for high-quality cacao products is expected to rise due to advancing technology in the present. Pre-harvesting needs to provide optimal identification of which amongst the pods are ripened enough and ready for the next stage of the cacao process. This paper recommends a technique to determine the ripeness of cacao. Nine hundred thirty-three cacao samples were used to collect thumping audio data at five different pod's exocarp locations. Each sound file is 1 second long, creating 4665 cacao sound file datasets at 16kHz sample rate and 16-bit audio bit depth. The process of the Mel-Frequency Cepstral Coefficient Spectrogram was then applied to extract recognizable features for the training process. The deep learning method integrated was a convolutional neural network (CNN) to classify the cacao sound successfully. The experimental design model's output exhibits an accuracy of 97.50 % for the training data and 97.13 % for the validation data. While the overall accuracy mean of the classification system is 97.46 %, whether the cacao is unripe or ripe.
Fulltext View|Download Email colleagues
Keywords: cacao; CNN; deep learning; feature extraction; maturity level; spectrogram
Funding: Cavite State University

Article Metrics:

Article Info
Section: Original Research Articles
Language : EN
Related articles
Sequence-based prediction of protein-protein interaction using autocorrelation features and machine learning Neural network performance based on backpropagation and LVQ as the LoRa RSS fingerprint algorithms for positioning in an open space Perbandingan Convolutional Neural Network VGG16 dan ResNet34 pada Sistem Klasifikasi Sampah Botol Maximum Likelihood Classification with Fast Fourier Transform Feature Extraction for Car Recognition Comparison of the histogram of oriented gradient, GLCM, and shape feature extraction methods for breast cancer classification using SVM More related articles
Most cited articles
Comparative study of four indoor empirical propagation models for campus wireless network Identification of Herbal Medicinal Plants Based on Leaf Image Using Gray Level Co-occurence Matrix and K-Nearest Neighbor Algorithms Hajj and Umroh Android-Based Learning Application Aplikasi Pengolahan Citra Digital Meat Detection Dengan Metode Segmentasi K-Mean Clustering Berbasis OpenCV Dan Eclipse Rancang Bangun Sistem Informasi Kampus Hijau Berbasis Web Pada JSN (Jaringan Sensor Nirkabel) More cited articles
  1. C. H. Avendaño-Arrazate, M. Bolaños M, and A. Mendoza-López, "The cocoa (theobroma cacao l) native in Mexico," Biodiversity International Journal, vol. 2, no. 6, pp. 535-536, 2018. doi: 10.15406/bij.2018.02.00109
  2. R. C. Espino and J. V. Ramos, "Cacao production guide," Philippines Department of Agriculture Bureau of Plant Industry, 2008
  3. M. S. Fowler, Cocoa beans: from tree to factory. NJ: Wiley, 2009
  4. M. Apriyanto, "Changes in chemical properties of dried cocoa (theobroma cacao) beans during fermentation," International Journal of Fermented Foods, vol. 5, no. 1, pp. 11-16, 2016. doi: 10.5958/2321-712X.2016.00002.8
  5. E. O. Afoakwa, "Cocoa bean composition and chocolate flavor development," in Chocolate and Science Technology, pp. 80-101, 2016. doi: 10.1002/9781118913758.ch5
  6. M. J. Delwiche, T. McDonald, and S. V. Bowers, "Determination of Peach firmness by analysis of impact forces," Transactions of American Society of Agricultural and Biological Engineering, vol. 30, no. 1, pp. 249-254, 1987. doi: 10.13031/2013.30435
  7. J. R. Cooke and R. H. Rand, "A mathematical study of resonance in intact fruits and vegetables using a 3-media elastic sphere model," Journal of Agricultural Engineering Research, vol. 18, no. 2, pp. 141-157, 1973. doi: 10.1016/0021-8634(73)90023-1
  8. H. Chen and J. De Baerdemaeker, "Effect of apple shape on acoustic measurements of firmness," Journal of Agricultural Engineering Research, vol. 56, no. 3. pp. 253-266, 1993. doi: 10.1006/jaer.1993.1077
  9. N. De Belie, S. Schotte, J. Lammertyn, B. Nicolai, and J. De Baerdemaeker, "Firmness changes of pear fruit before and after harvest with the acoustic impulse response technique," Journal of Agricultural Engineering Research, vol. 77, no. 2, pp. 183-191, 2000. doi: 10.1006/jaer.2000.0592
  10. E. Macrelli, A. Romani, R. P. Paganelli, E. Sangiorgi, and M. Tartagni, "Piezoelectric transducers for real-time evaluation of fruit firmness. Part II: Statistical and sorting analysis," Sensors and Actuators: A Physical, vol. 201, pp. 497-503, 2013. doi: 10.1016/j.sna.2013.07.037
  11. A. H. Gómez, J. Wang, and A. G. Pereira, "Firmness of mandarin at different picking dates," Food Science and Technology International, vol. 12, no. 4, pp. 273-279, 2006. doi: 10.1177/1082013206067870
  12. A. H. Gómez, A. G. Pereira, W. Jun, and H. Yong, "Acoustic testing for peach fruit ripeness evaluation during peach storage stage Evaluación acústica de la madurez del melocotón Durante la fase de almacenamiento," Revista Ciencias Técnicas Agropecuarias, vol. 14, no. 2, pp. 28-34, 2005, pp. 28-34, 2005
  13. F. Khoshnam, M. Namjoo, and H. Golbakhshi, "Acoustic testing for melon fruit ripeness evaluation during different stages of ripening," Agriculturae Conspectus Scientificus, vol. 80, no. 4, pp. 197-204, 2015
  14. T. Tiplica, P. Vandewalle, S. Verron, C. Grémy-Gros, and E. Mehinagic, "Identification of apple varieties using acoustic measurements," in 3rd Conférence Internationale en Métrologie, Le Caire, Egypt, Jun. 2010, pp. 103-110
  15. J. Hongwiangjan, A. Terdwongworakul, and K. Krisanapook, "Evaluation of pomelo maturity based on acoustic response and peel properties," International Journal of Food Science Technology, vol. 50, no. 3, pp. 782-789, 2015. doi: 10.1111/ijfs.12700
  16. M. Lutfi, C. Herlaut, and N. Wahyunanto Agung, "Designing and creating acoustic ripeness tester and experimental testing on Juan Canary melon," Advances in Natural and Applied Sciences, vol. 5, no. 3, pp. 242-246, 2011
  17. A. Zakaria et al., "Improved maturity and ripeness classifications of Magnifera Indica cv. harumanis mangoes through sensor fusion of an electronic nose and acoustic sensor," Sensors, vol. 12, no. 5, pp. 6023-6048, 2012. doi: 10.3390/s120506023
  18. P. B. Bro, C. Rosenberger, H. Laurent, C. Gaete-Eastman, M. Fernández, and M. A. Moya-León, "A support vector machine as an estimator of mountain papaya ripeness using resonant frequency or frequency centroid," in IFIP International Conference on Artificial Intelligence in Theory and Practice, Santiago, Chile, Aug. 2006, pp. 335-344. doi: 10.1007/978-0-387-34747-9_35
  19. C. C. Lien, C. Ay, and C. H. Ting, "Non-destructive impact test for assessment of tomato maturity," Journal of Food Engineering, vol. 91, no. 3, pp. 402-407, 2009. doi: 10.1016/j.jfoodeng.2008.09.036
  20. D. Z. H. Arenga, J. C. Dela Cruz, and D. Z. H. Arenga, "Ripeness classification of cocoa through acoustic sensing and machine learning," in IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management, Manila, Philippines, Dec. 2017, pp. 1-6. doi: 10.1109/HNICEM.2017.8269438
  21. R. Abbaszadeh, A. Moosavian, A. Rajabipour, and G. Najafi, "An intelligent procedure for watermelon ripeness detection based on vibration signals," Journal of Food Science and Technology, vol. 52, no. 2, pp. 1075-1081, 2013. doi: 10.1007/s13197-013-1068-x
  22. K. Kangune, V. Kulkarni, and P. Kosamkar, "Grapes ripeness estimation using convolutional neural network and support vector machine," in Global Conference for Advancement in Technology, Bangaluru, India, Oct. 2019, pp. 1-5. doi: 10.1109/GCAT47503.2019.8978341
  23. Y. Zhang, J. Lian, M. Fan, and Y. Zheng, "Deep indicator for fine-grained classification of banana's ripening stages," EURASIP Journal on Image and Video Processing, vol. 2018, 46, 2018. doi: 10.1186/s13640-018-0284-8
  24. A. Chaikaew, T. Thanavanich, P. Duangtang, K. Sriwanna, and W. Jaikhang, "Convolutional neural network for pineapple ripeness classification machine," in 16th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, Pattaya, Thailand, Jul. 2019, pp. 373-376. doi: 10.1109/ECTI-CON47248.2019.8955408
  25. W. Kharamat, M. Wongsaisuwan, and N. Wattanamongkhol, "Durian ripeness classification from the knocking sound using convolutional neural network," in 8th International Electrical Engineering Congress, Chiang Mai, Thailand, Mar. 2020, pp. 1-4. doi: 10.1109/iEECON48109.2020.229571
  26. Faridah, G. O. F. Parikesit, and Ferdiansjah, "Coffee bean grade determination based on image parameter," Telkomnika, vol. 9, no. 3, pp. 547-554, 2011. doi: 10.12928/telkomnika.v9i3.747
  27. H. Vaviya,1 V. Vishwakarma, A. Yadav, and N. Shah, "Identification of artificially ripened fruits using machine learning," in 2nd International Conference on Advances in Science & Technology, Mumbai, India, Apr. 2019, pp. 1-6. doi: 10.2139/ssrn.3368903
  28. M. A. M. Fuad et al., "Training of convolutional neural network using transfer learning for Aedes Aegypti larvae," Telkomnika, vol. 16, no. 4, pp.White Paper 1894-1900, 2018. doi: 10.12928/telkomnika.v16i4.8744
  29. H. Prasetyo and B. A. Putra Akardihas, "Batik image retrieval using convolutional neural network," Telkomnika, vol. 17, no. 6, pp. 3010-3018, 2019. doi: 10.12928/telkomnika.v17i6.12701
  30. R. F. Rachmadi and I. K. E. Purnama, "Paralel spatial pyramid convolutional neural network untuk verifikasi kekerabatan berbasis citra wajah," Jurnal Teknologi dan Sistem Komputer, vol. 6, no. 4, pp. 152-157, 2018. doi: 10.14710/jtsiskom.6.4.2018.152-157
  31. N. Nurajijah and D. Riana, "Algoritma naïve bayes, decision tree, dan SVM untuk klasifikasi persetujuan pembiayaan nasabah koperasi syariah," Jurnal Teknologi dan Sistem Komputer, vol. 7, no. 2, pp. 77-82, 2019. doi: 10.14710/jtsiskom.7.2.2019.77-82
  32. I. M. G. Sunarya et al., "Deteksi arteri karotis pada citra ultrasound b-mode berbasis convolution neural network single shot multibox detector," Jurnal Teknologi dan Sistem Komputer, vol. 7, no. 2, pp. 56-63, 2019. doi: 10.14710/jtsiskom.7.2.2019.56-63
  33. MathWorks, "Deep learning for signal processing with MATLAB," White Paper, 2019

Last update:

  1. Convolutional Neural Network for the Detection of Cocoa Maturity with an Approach for the Analysis of Images Captured at Different Distances

    José Antonio Menjivar Rivera, Alicia María Reyes-Duke. International Conference on Science, Technology and Innovation (CONICIETI), 12 , 2024. doi: 10.4028/p-JM3tGd

  2. Deep Convolution Neural Network for Thai Classical Music Instruments Sound Recognition

    Apichai Huaysrijan, Sunee Pongpinigpinyo. 2021 25th International Computer Science and Engineering Conference (ICSEC), 2021. doi: 10.1109/ICSEC53205.2021.9684611

  3. Optimization of Cocoa Pods Maturity Classification Using Stacking and Voting with Ensemble Learning Methods in RGB and LAB Spaces

    Kacoutchy Jean Ayikpa, Abou Bakary Ballo, Diarra Mamadou, Pierre Gouton. Journal of Imaging, 10 (12), 2024. doi: 10.3390/jimaging10120327

  4. Classification of Cocoa Pod Maturity Using Similarity Tools on an Image Database: Comparison of Feature Extractors and Color Spaces

    Kacoutchy Jean Ayikpa, Diarra Mamadou, Pierre Gouton, Kablan Jérôme Adou. Data, 8 (6), 2023. doi: 10.3390/data8060099

  5. RipSetCocoaCNCH12: Labeled Dataset for Ripeness Stage Detection, Semantic and Instance Segmentation of Cocoa Pods

    Juan Felipe Restrepo-Arias, María Isabel Salinas-Agudelo, María Isabel Hernandez-Pérez, Alejandro Marulanda-Tobón, María Camila Giraldo-Carvajal. Data, 8 (6), 2023. doi: 10.3390/data8060112

  6. Implementation of transfer learning in convolutional neural network architecture for android-based handwriting quality detection

    Muhammad Zidni Subarkah, Winita Sulandari, Respatiwulan Respatiwulan. INTERNATIONAL CONFERENCE ON ENGINEERING AND COMPUTER SCIENCE (ICECS) 2022: The Use of Innovative Technology in Accelerating Problems Sustainable Development, 3109 , 2024. doi: 10.1063/5.0204724

Last update: 2025-06-11 19:28:09

No citation recorded.