Crime Activity Detection in Surveillance Videos Based on Developed Deep Learning Approach

Rasool Jamal Kolaib; Jumana Waleed

doi:10.24237/djes.2024.17307

Authors

Rasool Jamal Kolaib Department of Computer Science, College of Science, University of Diyala, Iraq
Jumana Waleed
jumanawaleed@uodiyala.edu.iq
Department of Computer Science, College of Science, University of Diyala, Iraq

Keywords:

Crime Activity Detection, Convolutional Neural Network (CNN), Developed Deep Learning Approach, Pre-trained CNN approach, Surveillance Videos

Abstract

In modern communities, lots of offenders are prone to recidivism, hence, there is a requirement to inhibit such criminals, especially from impending socioeconomically disadvantaged and high-crime areas that experience elevated levels of criminal activity, involving drug-related offenses, violence, theft, and other forms of anti-social behavior. Consequently, surveillance cameras have been installed in relevant institutions, and further personnel have been provided to monitor videos using various surveillance apparatus. However, relying solely on monitoring with the naked eye and manual video processing falls short of accurately evaluating the footage acquired via such cameras. To handle the issues of conventional systems, there is a need for a system that is able to classify acquired images while supporting surveillance personnel actively. Therefore, in this paper, a deep-learning approach is developed to build a crime detection system. This developed approach includes various layers necessary to perform feature extraction and classification processes and make the system capable of efficiently and accurately detecting crime activities from surveillance video frames. Besides the proposed crime activity detection system, two deep-learning approaches (EfficientNet-B7, and MobileNet-V2) are trained and assessed on the popular UCF Crime and DCSASS datasets. Generally, the proposed detection system encompasses dataset preparation and pre-processing, splitting the pre-processed crime activity image dataset, and implementing the proposed deep learning approach and other pre-trained approaches.

Downloads

Download data is not yet available.

References

K. Hu, L. Li, X. Tao, J. D. Velásquez, P. Delaney, "Information fusion in crime event analysis: A decade survey on data, features and models", Information Fusion, vol. 100, 2023.

F. J. Rendón-Segador, J. A. Álvarez-García, J. L. Salazar-González, T. Tommasi, "CrimeNet: Neural Structured Learning using Vision Transformer for violence detection", Neural Networks, vol. 161, pp. 318-329, 2023.

K. B. Sahay, B. Balachander, B. Jagadeesh, G. A. Kumar, R. Kumar, L. R. Parvathy, "A real time crime scene intelligent video surveillance systems in violence detection framework using deep learning techniques", Computers and Electrical Engineering, vol. 103, 2022.

F. L. Sánchez, I. Hupont, S. Tabik, F. Herrera, "Revisiting crowd behaviour analysis through deep learning: Taxonomy, anomaly detection, crowd emotions, datasets, opportunities and prospects", Information Fusion, vol. 64, pp. 318-335, 2020.

J. Waleed, A. T. Azar, S. Albawi, W. K. Al-Azzawi, I. K. Ibraheem, A. Alkhayyat, I. A. Hameed, N. A. Kamal, "An Effective Deep Learning Model to Discriminate Coronavirus Disease From Typical Pneumonia," International Journal of Service Science, Management, Engineering, and Technology (IJSSMET), vol. 13, no.1, pp. 1-16, 2022..

A. J. Yousif and M. H. Al-Jammas, “Real-time Arabic Video Captioning Using CNN and Transformer Networks Based on Parallel Implementation ”, Diyala Journal of Engineering Sciences, vol. 17, no. 1, pp. 84–93, Mar. 2024.

S. Albawi, M. H. Arif, J. Waleed, "Skin cancer classification dermatologist-level based on deep learning model", Acta Scientiarum. Technology, vol. 45, no. 1, e61531, 2022.

S. Vosta, K.-C. Yow, "A CNN-RNN Combined Structure for Real-World Violence Detection in Surveillance Cameras", Applied Sciences, vol.12, no. 3, 2022.

B. Asal, A. B. Can, "Ensemble-Based Knowledge Distillation for Video Anomaly Detection", Applied Sciences, vol. 14, no. 3, 2024.

W. Ullah, A. Ullah, T. Hussain, Z. A. Khan, S. W. Baik, "An Efficient Anomaly Recognition Framework Using an Attention Residual LSTM in Surveillance Videos", Sensors, vol. 21, no. 8, 2021.

A. Gulati, S. Pawar, P. Sheoran, C. Sali, "SUSPICIOUS BEHAVIOUR DETECTION USING CNN AND ROLLING AVERAGE", International Research Journal of Modernization in Engineering Technology and Science, vol.3, no.5, 2021.

K. V. Thakare, N. Sharma, D. P. Dogra, H. Choi, I.-J. Kim, "A multi-stream deep neural network with late fuzzy fusion for real-world anomaly detection", Expert Systems with Applications, vol. 201, 2022.

P. Khaire, P. Kumar, "A semi-supervised deep learning based video anomaly detection framework using RGB-D for surveillance of real-world critical environments", Forensic Science International: Digital Investigation, vol. 40, 2022.

M. Qasim, E. Verdu, "Video anomaly detection system using deep convolutional and recurrent models", Results in Engineering, vol. 18, 2023.

J. Park, J. Kim, B. Han, "End-to-end learning for weakly supervised video anomaly detection using Absorbing Markov Chain", Computer Vision and Image Understanding, vol. 236, 2023.

A. Patwal, M. Diwakar, V. Tripathi, P. Singh, "An investigation of videos for abnormal behavior detection", Procedia Computer Science, vol. 218, pp. 2264-2272, 2023.

M. Sandler, A. Howard, M. Zhu, A. Zhmoginov and L. -C. Chen, "MobileNetV2: Inverted Residuals and Linear Bottlenecks," 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, pp. 4510-4520, 2018.

M. Tan, Q. V. Le, "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks", International Conference on Machine Learning, 2019.

W. Sultani, C. Chen, M. Shah, "Real-World Anomaly Detection in Surveillance Videos," 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA , pp. 6479-6488, 2018.

https://www.kaggle.com/datasets/mateohervas/dcsass-dataset.

J. Waleed, S. Albawi, H. Q. Flayyih and A. Alkhayyat, "An Effective and Accurate CNN Model for Detecting Tomato Leaves Diseases," 2021 4th International Iraqi Conference on Engineering Technology and Their Applications (IICETA), Najaf, Iraq, pp. 33-37, 2021

S. Albawi, J. Waleed and A. J. Abboud, "Deep CNN-Based-Flower Species Recognition System," 2023 3rd International Scientific Conference of Engineering Sciences (ISCES), Diyala, Iraq, pp. 54-58, 2023.