A novel tree pattern-based violence detection model using audio signals
Article
Yildiz, Arif Metehan, Barua, Prabal D., Dogan, Sengul, Baygin, Mehmet, Tuncer, Turker, Ooi, Chui Ping, Fujita, Hamido and Acharya, U. Rajendra. 2023. "A novel tree pattern-based violence detection model using audio signals." Expert Systems with Applications. 224. https://doi.org/10.1016/j.eswa.2023.120031
Article Title | A novel tree pattern-based violence detection model using audio signals |
---|---|
ERA Journal ID | 17852 |
Article Category | Article |
Authors | Yildiz, Arif Metehan, Barua, Prabal D., Dogan, Sengul, Baygin, Mehmet, Tuncer, Turker, Ooi, Chui Ping, Fujita, Hamido and Acharya, U. Rajendra |
Journal Title | Expert Systems with Applications |
Journal Citation | 224 |
Article Number | 120031 |
Number of Pages | 12 |
Year | 2023 |
Publisher | Elsevier |
Place of Publication | United Kingdom |
ISSN | 0957-4174 |
1873-6793 | |
Digital Object Identifier (DOI) | https://doi.org/10.1016/j.eswa.2023.120031 |
Web Address (URL) | https://www.sciencedirect.com/science/article/pii/S095741742300533X |
Abstract | Physical violence detection using multimedia data is crucial for public safety and security. This is an important research area in information security and digital forensics. Research in video-based violence detection (VVD) has grown steadily in recent years with rapid increase in video surveillance systems worldwide. Verbal aggression detection technologies, on the other hand, are still limited due to the popularity of computer vision models. Thus, researchers have preferred to use computer vision models to detect violence using videos. We have presented a new automatic audio violence detection (AVD) model to fill this gap. Our AVD model is handcrafted and its details are as follows. This work collected a new audio dataset on verbal aggression from YouTube. A novel handcrafted model was proposed using multilevel feature extraction, feature selection, classification, and majority voting phases. A new local feature extraction function based on the binary tree was used to generate features from audio signals. We call this function tree pattern-23 (TreePat23), where 23 represents the number of wavelet bands/audio signals inputs. Wavelet bands were generated using tunable Q wavelet transform (TQWT) before being applied to our TreePat23 for feature extraction. The iterative neighborhood component analysis (INCA) and Chi2 were used to select the features. The selected features were classified using k nearest neighbors (kNN) and support vector machine (SVM) followed by iterative majority voting (IMV) method. The best-predicted vector was obtained by using a greedy algorithm. Finally, a new validation technique called leave one record out (LORO) cross-validation (CV) was used to validate the results. Our proposed TreePat23 model has attained classification accuracy of 89.68% and 89.75% with kNN and SVM, respectively. Our developed system has generated 14 results for each classifier and automatically selected the best result. Hence this model is a self-organized audio classification model which yielded over 89% classification accuracy for both classifiers using LORO CV strategy. |
Keywords | Audio forensics; Audio violence detection ; Tree pattern ; Signal processing ; Feature extraction ; Iterative feature selection |
ANZSRC Field of Research 2020 | 400306. Computational physiology |
Public Notes | Files associated with this item cannot be displayed due to copyright restrictions. |
Byline Affiliations | Firat University, Turkey |
School of Business | |
Cogninet Australia, Australia | |
University of Technology Sydney | |
Australian International Institute of Higher Education, Australia | |
University of New England | |
Taylor’s University, Malaysia | |
SRM Institute of Science and Technology, India | |
Kumamoto University, Japan | |
University of Sydney | |
Ardahan University, Turkiye | |
Singapore University of Social Sciences (SUSS), Singapore | |
HUTECH University of Technology, Vietnam | |
University of Granada, Spain | |
Iwate Prefectural University, Japan | |
School of Mathematics, Physics and Computing |
Permalink -
https://research.usq.edu.au/item/z1w4x/a-novel-tree-pattern-based-violence-detection-model-using-audio-signals
50
total views0
total downloads0
views this month0
downloads this month
Export as
Related outputs
Automated hip dysplasia detection using novel FlexiLBPHOG model with ultrasound images
Key, Sefa, Kurum, Huseyin, Esmez, Omer, Hafeez-Baig, Abdul, Hajiyeva, Rena, Dogan, Sengul and Tuncer, Turker. 2025. "Automated hip dysplasia detection using novel FlexiLBPHOG model with ultrasound images." Ain Shams Engineering Journal. 16 (1). https://doi.org/10.1016/j.asej.2024.103235Artificial Intelligence-Based Suicide Prevention and Prediction: A Systematic Review (2019-2023)
Atmakuru, Anirudh, Shahini, Alen, Chakraborty, Subrata, Seoni, Silvia, Salvi, Massimo, Hafeez-Baig, Abdul, Rashid, Sadaf, Tan, Ru San, Barua, Prabal Datta, Molinari, Filippo and Acharya, U Rajendra. 2025. "Artificial Intelligence-Based Suicide Prevention and Prediction: A Systematic Review (2019-2023)." Information Fusion. 114. https://doi.org/10.1016/j.inffus.2024.102673Explainable deeply-fused nets electricity demand prediction model: Factoring climate predictors for accuracy and deeper insights with probabilistic confidence interval and point-based forecasts
Ghimire, Sujan, AL-Musaylh, Mohanad S., Nguyen-Huy, Thong, Deo, Ravinesh C., Acharya, Rajendra, Casillas-Perez, David, Yaseen, Zaher Mundher and Salcedo-sanz, Sancho. 2025. "Explainable deeply-fused nets electricity demand prediction model: Factoring climate predictors for accuracy and deeper insights with probabilistic confidence interval and point-based forecasts." Applied Energy. 378 (Part A). https://doi.org/10.1016/j.apenergy.2024.124763AttentionPoolMobileNeXt: An automated construction damage detection model based on a new convolutional neural network and deep feature engineering models
Aydin, Mehmet, Barua, Prabal Datta, Chadalavada, Sreenivasulu, Dogan, Sengul, Tuncer, Turker, Chakraborty, Subrata and Acharya, Rajendra U.. 2025. "AttentionPoolMobileNeXt: An automated construction damage detection model based on a new convolutional neural network and deep feature engineering models." Multimedia Tools and Applications. 84 (4), pp. 1821-1843. https://doi.org/10.1007/s11042-024-19163-2Directed Lobish-based explainable feature engineering model with TTPat and CWINCA for EEG artifact classification
Tuncer, Turker, Dogan, Sengul, Baygin, Mehmet, Tasci, Irem, Mungen, Bulent, Tasci, Burak, Barua, Prabal Datta and Acharya, U.R.. 2024. "Directed Lobish-based explainable feature engineering model with TTPat and CWINCA for EEG artifact classification." Knowledge-Based Systems. 305. https://doi.org/10.1016/j.knosys.2024.112555Retinal Health Screening Using Artificial Intelligence with Digital Fundus Images: A Review of the Last Decade (2012-2023)
Islam, Saad, Deo, Ravinesh C., Barua, Prabal Datta, Soar, Jeffrey, Yu, Ping and Acharya, U. Rajendra. 2024. "Retinal Health Screening Using Artificial Intelligence with Digital Fundus Images: A Review of the Last Decade (2012-2023)." IEEE Access. 12, pp. 176630-176685. https://doi.org/10.1109/ACCESS.2024.3477420Automated EEG-based language detection using directed quantum pattern technique
Dogan, Sengul, Tuncer, Turker, Barua, Prabal Datta and Acharya, U.R.. 2024. "Automated EEG-based language detection using directed quantum pattern technique." Applied Soft Computing. 167 (Part A). https://doi.org/10.1016/j.asoc.2024.112301A Novel Hybrid Model for Automatic Non-Small Cell Lung Cancer Classification Using Histopathological Images
Katar, Oguzhan, Yildirim, Ozal, Tan, Ru-San and Acharya, U Rajendra. 2024. "A Novel Hybrid Model for Automatic Non-Small Cell Lung Cancer Classification Using Histopathological Images." Diagnostics. 14 (22). https://doi.org/10.3390/diagnostics14222497Synthetic Data Generation via Generative Adversarial Networks in Healthcare: A Systematic Review of Image- and Signal-Based Studies
Akpinar, Muhammed Halil, Sengur, Abdulkadir, Salvi, Massimo, Seoni, Silvia, Faust, Oliver, Mir, Hasan, Molinari,Filippo and Acharya, U. Rajendra. 2024. "Synthetic Data Generation via Generative Adversarial Networks in Healthcare: A Systematic Review of Image- and Signal-Based Studies." IEEE Open Journal of Engineering in Medicine and Biology. 6, pp. 183-192. https://doi.org/10.1109/OJEMB.2024.3508472RECOMED: A comprehensive pharmaceutical recommendation system
Zomorodi, Mariam, Ghodsollahee, Ismail, Martin, Jennifer H, Talley, Nicholas J, Salari, Vahid, Pławiak, Paweł, Rahimi, Kazem and Acharya, U.R.. 2024. "RECOMED: A comprehensive pharmaceutical recommendation system." Artificial Intelligence in Medicine. 157. https://doi.org/10.1016/j.artmed.2024.102981Artificial intelligence in assessing cardiovascular diseases and risk factors via retinal fundus images: A review of the last decade
Abdollahi, Mirsaeed, Jafarizadeh, Ali, Ghafouri-Asbagh, Amirhosein, Sobhi, Navid, Pourmoghtader, Keysan, Pedrammehr, Siamak, Asadi, Houshyar, Tan, Ru-San, Alizadehsani, Roohallah and Acharya, U. Rajendra. 2024. "Artificial intelligence in assessing cardiovascular diseases and risk factors via retinal fundus images: A review of the last decade." WIREs Data Mining and Knowledge Discovery. 14 (6). https://doi.org/10.1002/widm.1560Early prediction of sudden cardiac death using multimodal fusion of ECG Features extracted from Hilbert–Huang and wavelet transforms with explainable vision transformer and CNN models
Telangore, Hardik, Azad, Victor, Sharma, Manish, Bhurane, Ankit, Tan, Ru San and Acharya, U. Rajendra. 2024. "Early prediction of sudden cardiac death using multimodal fusion of ECG Features extracted from Hilbert–Huang and wavelet transforms with explainable vision transformer and CNN models." Computer Methods and Programs in Biomedicine. 257. https://doi.org/10.1016/j.cmpb.2024.108455A Pragmatic Approach to Fetal Monitoring via Cardiotocography Using Feature Elimination and Hyperparameter Optimization
Hardalac, Firat, Akmal, Haad, Ayturan, Kubilay, Acharya, U. Rajendra and Tan, Ru-San. 2024. "A Pragmatic Approach to Fetal Monitoring via Cardiotocography Using Feature Elimination and Hyperparameter Optimization." Interdisciplinary Sciences: Computational Life Sciences. 16 (4), pp. 882-906. https://doi.org/10.1007/s12539-024-00647-6Automated System for the Detection of Heart Anomalies Using Phonocardiograms: A Systematic Review
Gudigar, Anjan, Raghavendra, U., Maithri, M., Samanth, Jyothi, Inamdar, Mahesh Anil, Vidhya, V., Vicnesh, Jahmunah, Prabhu, Mukund A., Tan, Ru-San, Yeong, Chai Hong, Molinari, Filippo and Acharya, U. R.. 2024. "Automated System for the Detection of Heart Anomalies Using Phonocardiograms: A Systematic Review." IEEE Access. 12, pp. 138399-138428. https://doi.org/10.1109/ACCESS.2024.3465511