Implementasi YOLOv11 untuk pengenalan nominal uang Rupiah dengan konversi suara otomatis

Muhamad Alvin Andriyanto; Yani Parti Astuti

doi:10.24246/aiti.v23i3.348-362

Authors

Muhamad Alvin Andriyanto Universitas Dian Nuswantoro
Yani Parti Astuti Universitas Dian Nuswantoro

DOI:

https://doi.org/10.24246/aiti.v23i3.348-362

Keywords:

YOLOv11, Indonesian Rupiah, computer vision, visually impaired, text-to-speech

Abstract

This research aims to develop a computer vision-based Indonesian rupiah currency denomination detection system that can provide automatic voice output as accessibility support for the visually impaired. The model was developed using the YOLOv11 algorithm, which was customized to recognize seven nominal classes of 2022 issue banknotes. The public dataset was used as training, validation, and test data, which was then processed thru transformations and augmentations to improve model generalization. Training was conducted using a controlled configuration with AdamW optimization and overfitting prevention strategies. Performance evaluation was conducted using the metrics of accuracy, precision, recall, F1-score, mean Average Precision, confusion matrix, and ROC-AUC. The research results show that the model achieved very high performance with an accuracy of 99.64% and mAP of 0.9935, indicating consistent identification capabilities for currency denominations across all classes. The simple OpenCV-based implementation and voice conversion using gTTS prove that the model can operate in real-time and provide direct audio feedback. This finding indicates that YOLOv11 is effective for Indonesian rupiah recognition and has the potential for further development in accessibility applications for the visually impaired.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References

B. Bahar, R. D. Yc. Raban, dan R. Arnie, “Model Pendeteksi Nominal Uang Kertas Rupiah Menggunakan Teknologi Optical Character Recognition,” J. Ticom Technol. Inf. Commun., vol. 12, no. 1, hlm. 8–13, Sep 2023, doi: 10.70309/ticom.v12i1.101. DOI: https://doi.org/10.70309/ticom.v12i1.101

D. Irfansyah, N. Ruseno, A. Yani, dan G. Santoso, “Penerapan Computer Vision dalam Sistem Keamanan Berbasis Artificial Intelligence (AI), Robotik, dan Otomatisasi,” J. PASTI J. Publ. Artik. Sist. Teknol. Inf., vol. 01, no. 01, hlm. 26–33, Nov 2025, doi: 10.9001/jurnalpasti.v1i1.921.

F. Jamaludin, A. Asriyanik, dan A. Pambudi, “Penerapan YOLO (You Onliy Look Once) untuk Deteksi Etika Berbusana di Universitas Muhammadiyah Sukabumi,” JATI J. Mhs. Tek. Inform., vol. 8, no. 5, hlm. 10623–10629, Sep 2024, doi: 10.36040/jati.v8i5.11124. DOI: https://doi.org/10.36040/jati.v8i5.11124

L. Setiawati, “Rancang Bangun Prototype Face Recognition Berbasis YOLO11 dengan Menggunakan Raspberry Pi,” J. Pendidik. VOKASIONAL Tek. Elektron. JVoTE, vol. 8, no. 1, hlm. 12–20, Jul 2025, doi: 10.21009/jvote.v8i1.59324. DOI: https://doi.org/10.21009/jvote.v8i1.59324

R. S. I. Sihombing, W. A. Harahap, dan W. K. Rahman, “Implementasi YOLO V8 untuk Mendeteksi Mata Uang Rupiah Emisi Tahun 2022 Ber-Output Audio,” JATI J. Mhs. Tek. Inform., vol. 8, no. 4, hlm. 5900–5905, Jun 2024, doi: 10.36040/jati.v8i4.10099. DOI: https://doi.org/10.36040/jati.v8i4.10099

K. M. Azhar, I. Santoso, dan Y. A. A. Soetrisno, “Implementasi Deep Learning Menggunakan Metode Convolution Neural Network dan Algoritma YOLO dalam Sistem Pendeteksi Uang Kertas Rupiah bagi Penyandang Low Vision,” Transient J. Ilm. Tek. Elektro, vol. 10, no. 3, hlm. 502–509, Sep 2021, doi: 10.14710/transient.v10i3.502-509. DOI: https://doi.org/10.14710/transient.v10i3.502-509

A. Prima, D. B. Santoso, dan L. Nurpulaela, “Deteksi Otomatis Nominal Uang Kertas Rupiah untuk Tunanetra Menggunakan Algoritma Arsitektur Ssd MobiileNetV3,” TEKNOKOM, vol. 6, no. 2, hlm. 151–159, Agu 2022, doi: 10.31943/teknokom.v6i2.166. DOI: https://doi.org/10.31943/teknokom.v6i2.166

M. A. Sabara, B. Niam, dan R. Darpono, “Alat Deteksi Nominal Uang Kertas Untuk Penyandang Tuna Netra Dengan Metode Deteksi Warna,” J. Ris. Rekayasa Elektro, vol. 5, no. 2, hlm. 129, Des 2023, doi: 10.30595/jrre.v5i2.19784. DOI: https://doi.org/10.30595/jrre.v5i2.19784

A. M. E. Antara, S. A. Sari, N. Riswanti, D. A. Amin, V. Verdila, dan A. P. A. Masa, “Deteksi Nominal Rupiah Uang Kertas Berdasarkan Citra Warna Menggunakan Segmentasi K-Means Clustering dan Klasifikasi Random Forest,” Kreat. Teknol. Dan Sist. Inf. KRETISI, vol. 1, no. 1, hlm. 34–39, Jul 2023, doi: 10.30872/kretisi.v1i1.776. DOI: https://doi.org/10.30872/kretisi.v1i1.776

S. A. Putir, Murinto, dan Sunardi, “Detecting Smoking Activity Behavior Using YOLOV8 and YOLOV11,” J. INOVTEK POLBENG, vol. 10, no. 2, hlm. 1154–1163, Nov 2025, doi: 10.35314/0q6grf14. DOI: https://doi.org/10.35314/0q6grf14

Y. Luo, A. Wu, dan Q. Fu, “MAS-YOLOv11: An Improved Underwater Object Detection Algorithm Based on YOLOv11,” Sensors, vol. 25, no. 11, hlm. 3433, Mei 2025, doi: 10.3390/s25113433. DOI: https://doi.org/10.3390/s25113433

D. A. Maulana, “Dataset Citra Uang Rupiah Emisi 2022.” [Daring]. Tersedia pada: https://www.kaggle.com/datasets/daniakhmadmaulana/citra-uang-rupiah-emisi-2022

P. B. Utomo, M. Faruqziddan, E. H. S. Aulia, dan S. D. Azzahra, “Perbandingan Skenario Balancing Oversampling dan Undersampling dalam Klasifikasi Resiko Kambuh Kanker Tiroid menggunakan Algoritma SVM Linear,” JAMI J. Ahli Muda Indones., vol. 5, no. 2, hlm. 172–182, Des 2024, doi: 10.46510/jami.v5i2.320. DOI: https://doi.org/10.46510/jami.v5i2.320

I. Istiqomah, “Determinant Factors of Revisit Intention to Museum: Integration of Technology Acceptance Model and Expectation Confirmation Theory,” J. Comput. Sci. Inform. Eng., vol. 4, no. 4, hlm. 312–323, Agu 2025, doi: 10.55537/cosie.v4i4.1202. DOI: https://doi.org/10.55537/cosie.v4i4.1202

B. A. Sadewa dan Y. Yamasari, “Implementasi Deep Transfer Learning untuk Klasifikasi Nominal Uang Kertas Rupiah,” J. Inform. Comput. Sci. JINACS, vol. 5, no. 04, hlm. 543–551, Apr 2024, doi: 10.26740/jinacs.v5n04.p543-551. DOI: https://doi.org/10.26740/jinacs.v5n04.p543-551

A. T. Khan dan S. M. Jensen, “LEAF-Net: A Unified Framework for Leaf Extraction and Analysis in Multi-Crop Phenotyping Using YOLOv11,” Agriculture, vol. 15, no. 2, hlm. 196, Jan 2025, doi: 10.3390/agriculture15020196. DOI: https://doi.org/10.3390/agriculture15020196

A. T. Khan dan S. M. Jensen, “LEAF-Net: A Unified Framework for Leaf Extraction and Analysis in Multi-Crop Phenotyping Using YOLOv11,” 6 Desember 2024, In Review. doi: 10.21203/rs.3.rs-5582314/v1. DOI: https://doi.org/10.21203/rs.3.rs-5582314/v1

I. R. Kurniawan, I. U. Fakhrizal, F. A. Cahyadewi, F. D. Saputra, M. Naufal, dan R. A. Pramunendar, “Pengaruh Penambahan Arsitektur Model dalam Klasifikasi Citra Bencana Alam Menggunakan Ensemble Learning,” J. FASILKOM, vol. 15, no. 2, hlm. 280–289, Agu 2025, doi: 10.37859/jf.v15i2.9103. DOI: https://doi.org/10.37859/jf.v15i2.9103

Y. Li, J. Wang, H. Wu, Y. Yu, H. Sun, dan H. Zhang, “Detection of powdery mildew on strawberry leaves based on DAC-YOLOv4 model,” Comput. Electron. Agric., vol. 202, hlm. 107418, Nov 2022, doi: 10.1016/j.compag.2022.107418. DOI: https://doi.org/10.1016/j.compag.2022.107418

A. F. Azmi dan A. Voutama, “PREDIKSI CHURN NASABAH BANK MENGGUNAKAN KLASIFIKASI RANDOM FOREST DAN DECISION TREE DENGAN EVALUASI CONFUSION MATRIX,” KOMPUTA J. Ilm. Komput. Dan Inform., vol. 13, no. 1, hlm. 111–119, 2024, doi: 10.34010/komputa.v13i1.12639. DOI: https://doi.org/10.34010/komputa.v13i1.12639

K. Kristiawan dan A. Widjaja, “Perbandingan Algoritma Machine Learning dalam Menilai Sebuah Lokasi Toko Ritel,” J. Tek. Inform. Dan Sist. Inf., vol. 7, no. 1, Apr 2021, doi: 10.28932/jutisi.v7i1.3182. DOI: https://doi.org/10.28932/jutisi.v7i1.3182

I. Syah, S. Sutono, dan M. Mulyanto, “Penerapan Algoritma Random Forest dalam Pencarian Pola Klaim BPJS Rumah Sakit Umum Kumala Siwi Mijen Kudus,” J. LENTERA BISNIS, vol. 14, no. 3, hlm. 3986–3995, Sep 2025, doi: 10.34127/jrlab.v14i3.1770. DOI: https://doi.org/10.34127/jrlab.v14i3.1770

P. Jiang, D. Ergu, F. Liu, Y. Cai, dan B. Ma, “A Review of Yolo Algorithm Developments,” Procedia Comput. Sci., vol. 199, hlm. 1066–1073, 2022, doi: 10.1016/j.procs.2022.01.135. DOI: https://doi.org/10.1016/j.procs.2022.01.135

J. A Ilemobayo dkk., “Hyperparameter Tuning in Machine Learning: A Comprehensive Review,” J. Eng. Res. Rep., vol. 26, no. 6, hlm. 388–395, Jun 2024, doi: 10.9734/jerr/2024/v26i61188. DOI: https://doi.org/10.9734/jerr/2024/v26i61188

C. Dewi, R.-C. Chen, Y.-C. Zhuang, X. Jiang, dan H. Yu, “Recognizing Road Surface Traffic Signs Based on Yolo Models Considering Image Flips,” Big Data Cogn. Comput., vol. 7, no. 1, hlm. 54, Mar 2023, doi: 10.3390/bdcc7010054. DOI: https://doi.org/10.3390/bdcc7010054

W. Yulita dkk., “Improved human image density detection with comparison of YOLOv8 depth level architecture and drop-out implementation,” J. Soft Comput. Explor., vol. 6, no. 1, hlm. 33–39, Mar 2025, doi: 10.52465/joscex.v6i1.556. DOI: https://doi.org/10.52465/joscex.v6i1.556