Violence and Robbery Detection System Using YOLOv5 Algorithm Based on IoT Technology

Hani'atul Khoiriyah, Fauzan Abdillah, Afris Nurfal Aziz, I Gede Wiryawan

Abstract


Violence and robbery are two common forms of crime that often cause material losses, psychological trauma, and insecurity within society. Conventional CCTV systems are limited in preventing such incidents, which highlights the need for more intelligent and responsive security solutions. The primary objective of this research is to design and evaluate SmartGuard, a real-time detection system for violence and robbery based on artificial intelligence (AI) using the YOLOv5 algorithm, integrated with Internet of Things (IoT) technology for remote monitoring. This study employed an experimental design with several stages: dataset preparation, model training, testing, model analysis, and system integration with Raspberry Pi, Firebase, and a mobile application. The dataset consisted of 6,900 labeled images across three classes: violence, robbery, and normal activity. Model evaluation was conducted using a separate test dataset and analyzed with a confusion matrix. The results show that the model achieved an overall accuracy of 70.94%. The system performed relatively well in detecting violence, with a precision of 71.13% and an F1-score of 62.47%. However, recall values for robbery (47.53%) and normal activity (48.99%) were considerably lower, indicating challenges in consistently recognizing these classes. Despite these limitations, SmartGuard allows users to view and receive notifications in emergency situations, enabling them to take quick action and monitor the situation effectively.

Keywords


Violence; Robbery; Detection; YOLOv5; IoT

Full Text:

Link Download

References


Abdillah, F., Khoiriyah, H., Aziz, A.N., Wiryawan, I.G., 2024. Sistem Deteksi Kekerasan Real-Time menggunakan YOLOv5 untuk Keamanan Publik. Seminar Nasional Teknik Elektro, Sistem Informasi, dan Teknik Informatika 198–204. https://doi.org/10.31284/p.snestik.2024.5861

Ahmed, T., Bin Nuruddin, A.T., Latif, A. Bin, Arnob, S.S., Rahman, R., 2020. A Real-Time Controlled Closed Loop IoT Based Home Surveillance System for Android using Firebase. 2020 6th International Conference on Control, Automation and Robotics, ICCAR 2020 601–606. https://doi.org/10.1109/ICCAR49639.2020.9108016

Alahdal, N.M., Abukhodair, F., Meftah, L.H., Cherif, A., 2024. Real-time Object Detection in Autonomous Vehicles with YOLO. Procedia Comput Sci 246, 2792–2801. https://doi.org/10.1016/j.procs.2024.09.392

Aziz, A.N., Khoiriyah, H., Abdillah, F., Wiryawan, I.G., 2024. Prototipe Sederhana Sistem Deteksi Kriminal Berbasis Internet of Things Menggunakan Teknologi YOLOv5. Komputika : Jurnal Sistem Komputer 13, 139–147. https://doi.org/10.34010/komputika.v13i1.12217

Badan Pusat Statistik, 2024. Statistik Kriminal Tahun 2024. Vol. 42. Jakarta: Badan Pusat Statistik. ISSN 2089-5291.

Boukabous, M., Azizi, M., 2023. Image and video-based crime prediction using object detection and deep learning. Bulletin of Electrical Engineering and Informatics 12, 1630–1638. https://doi.org/10.11591/eei.v12i3.5157

Bushra, S.N., Shobana, G., Maheswari, U.K., Subramanian, N., 2022. Smart Video Survillance Based Weapon Identification Using Yolov5, in: Proceedings of the 2022 International Conference on Electronic Systems and Intelligent Computing, ICESIC 2022. Institute of Electrical and Electronics Engineers Inc., pp. 351–357. https://doi.org/10.1109/ICESIC53714.2022.9783499

Desnanjaya, I.G.M.N., Arsana, I.N.A., 2021. Home security monitoring system with IoT-based Raspberry Pi. Indonesian Journal of Electrical Engineering and Computer Science 22, 1295–1302. https://doi.org/10.11591/ijeecs.v22.i3.pp1295-1302

Ganesan, S., Yin Ying, T., Ravi, P., Peng Lean, C., 2022. Designing an Autonomous Triggering Control System via Motion Detection for IoT Based Smart Home Surveillance CCTV Camera. Malaysian Journal of Science and Advanced Technology 2, 80–88. https://doi.org/10.56532/mjsat.v2iS1.120

Harsh, 2025. AI-Powered CCTV Surveillance with Intrusion Detection Using YOLOv5 and Raspberry Pi. International Journal of Computer Techniques 12, 209–212.

He, Z., Wang, K., Fang, T., Su, L., Chen, R., Fei, X., 2025. Comprehensive Performance Evaluation of YOLOv5 on Object Detection of Power Equipment. 2025 37th Chinese Control and Decision Conference (CCDC) 1281–1286. https://doi.org/10.1109/CCDC65474.2025.11090973

Houser, T.E., McMillan, A., Dong, B., 2024. Bridging the gap between criminology and computer vision: A multidisciplinary approach to curb gun violence. Security Journal 37, 1409–1429. https://doi.org/10.1057/s41284-024-00423-7

Jayasakthi, B.G., Varunika, S., Kinzsy Grace, R., Ezhilin Freeda, S., 2023. IoT Based Security Alert System for Children. 7th International Conference on Electronics, Communication and Aerospace Technology, ICECA 2023 - Proceedings 1632–1636. https://doi.org/10.1109/ICECA58529.2023.10395028

Kang, M., Ting, C.M., Ting, F.F., Phan, R.C.W., 2024. ASF-YOLO: A novel YOLO model with attentional scale sequence fusion for cell instance segmentation. Image Vis Comput 147, 1–9. https://doi.org/10.1016/j.imavis.2024.105057

Karthikeyan, S., Aakash Raj, R., Cruz, M.V., Chen, L., Ajay Vishal, J.L., Rohith, V.S., 2023. A Systematic Analysis on Raspberry Pi Prototyping: Uses, Challenges, Benefits, and Drawbacks. IEEE Internet Things J 10, 14397–14417. https://doi.org/10.1109/JIOT.2023.3262942

Khalfaoui, A., Badri, A., Mourabit, I. El, 2024. A lightweight you only look once for real-time dangerous weapons detection. IAES International Journal of Artificial Intelligence 13, 1836–1842. https://doi.org/10.11591/ijai.v13.i2.pp1838-1844

Kisaezehra, Farooq, M.U., Bhutto, M.A., Kazi, A.K., 2023. Real-Time Safety Helmet Detection Using Yolov5 at Construction Sites. Intelligent Automation and Soft Computing 36, 911–927. https://doi.org/10.32604/iasc.2023.031359

Kumar, P., Shih, G.L., Guo, B.L., Nagi, S.K., Manie, Y.C., Yao, C.K., Arockiyadoss, M.A., Peng, P.C., 2024. Enhancing Smart City Safety and Utilizing AI Expert Systems for Violence Detection. Future Internet 16. https://doi.org/10.3390/fi16020050

Liu, H., Sun, F., Gu, J., Deng, L., 2022. SF-YOLOv5: A Lightweight Small Object Detection Algorithm Based on Improved Feature Fusion Mode. Sensors 22, 1–14. https://doi.org/10.3390/s22155817

Murat, A.A., Kiran, M.S., 2025. A comprehensive review on YOLO versions for object detection. Engineering Science and Technology, an International Journal 70. https://doi.org/10.1016/j.jestch.2025.102161

Nnadozie, E.C., Casaseca-de-la-Higuera, P., Iloanusi, O., Ani, O., Alberola-López, C., 2024. Simplifying YOLOv5 for deployment in a real crop monitoring setting. Multimed Tools Appl 83, 50197–50223. https://doi.org/10.1007/s11042-023-17435-x

Palomino, X.P., Paredes, K.R., Tejada, J.E., 2022. Low-Cost Gas Leak Detection and Surveillance System for Single Family Homes Using Wit.ai, Raspberry Pi and Arduino. International Journal of Interactive Mobile Technologies. https://doi.org/10.3991/ijim.v16i09.30177

Prasetyawan, P., Samsugi, S., Prabowo, R., 2021. Internet of Thing Menggunakan Firebase dan Nodemcu untuk Helm Pintar. Jurnal ELTIKOM 5, 32–39. https://doi.org/10.31961/eltikom.v5i1.239

Razzaq, F.A., Chaudary, M.A., Fareed, S., Tariq, W., Waqas, M., Javaid, S., 2023. Enhancing Public Safety: Detection of Weapons and Violence in CCTV Videos with Deep Learning, in: 2023 25th International Multi Topic Conference, INMIC 2023 - Proceedings. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/INMIC60434.2023.10465800

Reswara, E., Suakanto, S., Putra, S.A., 2023. Comparison of Object Detection Algorithm using YOLO vs Faster R-CNN : A Systematic Literature Review. ICBDT ’23: Proceedings of the 2023 6th International Conference on Big Data Technologies 419–424. https://doi.org/https://doi.org/10.1145/3627377.3627443

Sung, C.S., Park, J.Y., 2021. Design of an intelligent video surveillance system for crime prevention: applying deep learning technology. Multimed Tools Appl 80, 34297–34309. https://doi.org/10.1007/s11042-021-10809-z

Varun, S., Bhuvanesh, V.M., 2023. Real Time Theft Detection Using YOLOv5 Object Detection Model, in: Proceedings - 2023 3rd International Conference on Innovative Sustainable Computational Technologies, CISCT 2023. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/CISCT57197.2023.10351223




DOI: http://dx.doi.org/10.35671/telematika.v18i2.3088

Refbacks

  • There are currently no refbacks.


 


Indexed by:

   

Telematika
ISSN: 2442-4528 (online) | ISSN: 1979-925X (print)
Published by : Universitas Amikom Purwokerto
Jl. Let. Jend. POL SUMARTO Watumas, Purwonegoro - Purwokerto, Indonesia


Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License .