FF-BTP Model for Novel Sound-Based Community Emotion Detection
Article
Yildiz, Arif Metehan, Tanabe, Masayuki, Kobayashi, Makiko, Tuncer, Ilknur, Barua, Prabal Datta, Dogan, Sengul, Tuncer, Turker, Tan, Ru-San and Acharya, U. Rajendra. 2023. "FF-BTP Model for Novel Sound-Based Community Emotion Detection." IEEE Access. 11, pp. 108705-108715. https://doi.org/10.1109/ACCESS.2023.3318751
| Article Title | FF-BTP Model for Novel Sound-Based Community Emotion Detection |
|---|---|
| ERA Journal ID | 210567 |
| Article Category | Article |
| Authors | Yildiz, Arif Metehan, Tanabe, Masayuki, Kobayashi, Makiko, Tuncer, Ilknur, Barua, Prabal Datta, Dogan, Sengul, Tuncer, Turker, Tan, Ru-San and Acharya, U. Rajendra |
| Journal Title | IEEE Access |
| Journal Citation | 11, pp. 108705-108715 |
| Number of Pages | 11 |
| Year | 2023 |
| Publisher | IEEE (Institute of Electrical and Electronics Engineers) |
| Place of Publication | United States |
| ISSN | 2169-3536 |
| Digital Object Identifier (DOI) | https://doi.org/10.1109/ACCESS.2023.3318751 |
| Web Address (URL) | https://ieeexplore.ieee.org/abstract/document/10262006 |
| Abstract | Most emotion classification schemes to date have concentrated on individual inputs rather than crowd-level signals. In addressing this gap, we introduce Sound-based Community Emotion Recognition (SCED) as a fresh challenge in the machine learning domain. In this pursuit, we crafted the FF-BTP-based feature engineering model inspired by deep learning principles, specifically designed for discerning crowd sentiments. Our unique dataset was derived from 187 YouTube videos, summing up to 2733 segments each of 3 seconds (sampled at 44.1 KHz). These segments, capturing overlapping speech, ambient sounds, and more, were meticulously categorized into negative, neutral, and positive emotional content. Our architectural design fuses the BTP, a textural feature extractor, and an innovative handcrafted feature selector inspired by Hinton's FF algorithm. This combination identifies the most salient feature vector using calculated mean square error. Further enhancements include the incorporation of a multilevel discrete wavelet transform for spatial and frequency domain feature extraction, and a sophisticated iterative neighborhood component analysis for feature selection, eventually employing a support vector machine for classification. On testing, our FF-BTP model showcased an impressive 97.22% classification accuracy across three categories using the SCED dataset. This handcrafted approach, although inspired by deep learning's feature analysis depth, requires significantly lower computational resources and still delivers outstanding results. It holds promise for future SCED-centric applications. © 2013 IEEE. |
| Keywords | FF-BTP; sound community emotion classification; sound processing; textural feature extraction |
| ANZSRC Field of Research 2020 | 400306. Computational physiology |
| Byline Affiliations | Firat University, Turkey |
| Kumamoto University, Japan | |
| School of Business | |
| Duke-NUS Medical School, Singapore | |
| School of Mathematics, Physics and Computing |
Permalink -
https://research.usq.edu.au/item/z2736/ff-btp-model-for-novel-sound-based-community-emotion-detection
Download files
Published Version
| FF-BTP_Model_for_Novel_Sound-Based_Community_Emotion_Detection.pdf | ||
| License: CC BY 4.0 | ||
| File access level: Anyone | ||
62
total views37
total downloads2
views this month3
downloads this month
Export as
Related outputs
Automated hip dysplasia detection using novel FlexiLBPHOG model with ultrasound images
Key, Sefa, Kurum, Huseyin, Esmez, Omer, Hafeez-Baig, Abdul, Hajiyeva, Rena, Dogan, Sengul and Tuncer, Turker. 2025. "Automated hip dysplasia detection using novel FlexiLBPHOG model with ultrasound images." Ain Shams Engineering Journal. 16 (1). https://doi.org/10.1016/j.asej.2024.103235Artificial Intelligence-Based Suicide Prevention and Prediction: A Systematic Review (2019-2023)
Atmakuru, Anirudh, Shahini, Alen, Chakraborty, Subrata, Seoni, Silvia, Salvi, Massimo, Hafeez-Baig, Abdul, Rashid, Sadaf, Tan, Ru San, Barua, Prabal Datta, Molinari, Filippo and Acharya, U Rajendra. 2025. "Artificial Intelligence-Based Suicide Prevention and Prediction: A Systematic Review (2019-2023)." Information Fusion. 114. https://doi.org/10.1016/j.inffus.2024.102673Explainable deeply-fused nets electricity demand prediction model: Factoring climate predictors for accuracy and deeper insights with probabilistic confidence interval and point-based forecasts
Ghimire, Sujan, AL-Musaylh, Mohanad S., Nguyen-Huy, Thong, Deo, Ravinesh C., Acharya, Rajendra, Casillas-Perez, David, Yaseen, Zaher Mundher and Salcedo-sanz, Sancho. 2025. "Explainable deeply-fused nets electricity demand prediction model: Factoring climate predictors for accuracy and deeper insights with probabilistic confidence interval and point-based forecasts." Applied Energy. 378 (Part A). https://doi.org/10.1016/j.apenergy.2024.124763AttentionPoolMobileNeXt: An automated construction damage detection model based on a new convolutional neural network and deep feature engineering models
Aydin, Mehmet, Barua, Prabal Datta, Chadalavada, Sreenivasulu, Dogan, Sengul, Tuncer, Turker, Chakraborty, Subrata and Acharya, Rajendra U.. 2025. "AttentionPoolMobileNeXt: An automated construction damage detection model based on a new convolutional neural network and deep feature engineering models." Multimedia Tools and Applications. 84 (4), pp. 1821-1843. https://doi.org/10.1007/s11042-024-19163-2Directed Lobish-based explainable feature engineering model with TTPat and CWINCA for EEG artifact classification
Tuncer, Turker, Dogan, Sengul, Baygin, Mehmet, Tasci, Irem, Mungen, Bulent, Tasci, Burak, Barua, Prabal Datta and Acharya, U.R.. 2024. "Directed Lobish-based explainable feature engineering model with TTPat and CWINCA for EEG artifact classification." Knowledge-Based Systems. 305. https://doi.org/10.1016/j.knosys.2024.112555Retinal Health Screening Using Artificial Intelligence with Digital Fundus Images: A Review of the Last Decade (2012-2023)
Islam, Saad, Deo, Ravinesh C., Barua, Prabal Datta, Soar, Jeffrey, Yu, Ping and Acharya, U. Rajendra. 2024. "Retinal Health Screening Using Artificial Intelligence with Digital Fundus Images: A Review of the Last Decade (2012-2023)." IEEE Access. 12, pp. 176630-176685. https://doi.org/10.1109/ACCESS.2024.3477420Automated EEG-based language detection using directed quantum pattern technique
Dogan, Sengul, Tuncer, Turker, Barua, Prabal Datta and Acharya, U.R.. 2024. "Automated EEG-based language detection using directed quantum pattern technique." Applied Soft Computing. 167 (Part A). https://doi.org/10.1016/j.asoc.2024.112301A Novel Hybrid Model for Automatic Non-Small Cell Lung Cancer Classification Using Histopathological Images
Katar, Oguzhan, Yildirim, Ozal, Tan, Ru-San and Acharya, U Rajendra. 2024. "A Novel Hybrid Model for Automatic Non-Small Cell Lung Cancer Classification Using Histopathological Images." Diagnostics. 14 (22). https://doi.org/10.3390/diagnostics14222497Synthetic Data Generation via Generative Adversarial Networks in Healthcare: A Systematic Review of Image- and Signal-Based Studies
Akpinar, Muhammed Halil, Sengur, Abdulkadir, Salvi, Massimo, Seoni, Silvia, Faust, Oliver, Mir, Hasan, Molinari,Filippo and Acharya, U. Rajendra. 2024. "Synthetic Data Generation via Generative Adversarial Networks in Healthcare: A Systematic Review of Image- and Signal-Based Studies." IEEE Open Journal of Engineering in Medicine and Biology. 6, pp. 183-192. https://doi.org/10.1109/OJEMB.2024.3508472RECOMED: A comprehensive pharmaceutical recommendation system
Zomorodi, Mariam, Ghodsollahee, Ismail, Martin, Jennifer H, Talley, Nicholas J, Salari, Vahid, Pławiak, Paweł, Rahimi, Kazem and Acharya, U.R.. 2024. "RECOMED: A comprehensive pharmaceutical recommendation system." Artificial Intelligence in Medicine. 157. https://doi.org/10.1016/j.artmed.2024.102981Artificial intelligence in assessing cardiovascular diseases and risk factors via retinal fundus images: A review of the last decade
Abdollahi, Mirsaeed, Jafarizadeh, Ali, Ghafouri-Asbagh, Amirhosein, Sobhi, Navid, Pourmoghtader, Keysan, Pedrammehr, Siamak, Asadi, Houshyar, Tan, Ru-San, Alizadehsani, Roohallah and Acharya, U. Rajendra. 2024. "Artificial intelligence in assessing cardiovascular diseases and risk factors via retinal fundus images: A review of the last decade." WIREs Data Mining and Knowledge Discovery. 14 (6). https://doi.org/10.1002/widm.1560Early prediction of sudden cardiac death using multimodal fusion of ECG Features extracted from Hilbert–Huang and wavelet transforms with explainable vision transformer and CNN models
Telangore, Hardik, Azad, Victor, Sharma, Manish, Bhurane, Ankit, Tan, Ru San and Acharya, U. Rajendra. 2024. "Early prediction of sudden cardiac death using multimodal fusion of ECG Features extracted from Hilbert–Huang and wavelet transforms with explainable vision transformer and CNN models." Computer Methods and Programs in Biomedicine. 257. https://doi.org/10.1016/j.cmpb.2024.108455A Pragmatic Approach to Fetal Monitoring via Cardiotocography Using Feature Elimination and Hyperparameter Optimization
Hardalac, Firat, Akmal, Haad, Ayturan, Kubilay, Acharya, U. Rajendra and Tan, Ru-San. 2024. "A Pragmatic Approach to Fetal Monitoring via Cardiotocography Using Feature Elimination and Hyperparameter Optimization." Interdisciplinary Sciences: Computational Life Sciences. 16 (4), pp. 882-906. https://doi.org/10.1007/s12539-024-00647-6Automated System for the Detection of Heart Anomalies Using Phonocardiograms: A Systematic Review
Gudigar, Anjan, Raghavendra, U., Maithri, M., Samanth, Jyothi, Inamdar, Mahesh Anil, Vidhya, V., Vicnesh, Jahmunah, Prabhu, Mukund A., Tan, Ru-San, Yeong, Chai Hong, Molinari, Filippo and Acharya, U. R.. 2024. "Automated System for the Detection of Heart Anomalies Using Phonocardiograms: A Systematic Review." IEEE Access. 12, pp. 138399-138428. https://doi.org/10.1109/ACCESS.2024.3465511