Multimodal Emotion Recognition System Using Machine Learning Classifier
Main Article Content
Abstract
Multi-modal emotion recognition refers to the process of identifying human emotions using information from multiple sources, such as facial expressions, voice intonation, EEG signals etc. Ultimately, emotion recognition is poised to play a pivotal role in healthcare, education, customer service etc. As we progress, it is imperative to address privacy concerns associated with this technology in a responsible manner. Challenges in multi-modal emotion recognition include aligning data from different modalities in time, dealing with noisy or incomplete information. In this paper, we aim to address this issue by employing the SVM as our machine learning classifier. Here we use IEMOCAP for speech and video and DEAP dataset for EEG signals. After applying SVM we got 76.22 % accuracy for IEMOCAP and 68.89 % accuracy for DEAP dataset.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
A. Tripathi and P. Rani, “PCA-Based Feature Selection and Hybrid Classification Model for Speech Emotion Recognition,” Lecture notes in networks and systems, pp. 347–353, Jan. 2023, doi: https://doi.org/10.1007/978-981-99-3315-0_26.
N. Ahmed, Z. A. Aghbari, and S. Girija, “A systematic survey on multimodal emotion recognition using learning algorithms,” Intelligent Systems with Applications, vol. 17, p. 200171, Feb. 2023, doi: https://doi.org/10.1016/j.iswa.2022.200171.
S. M. A. Abdullah, S. Y. A. Ameen, M. A. M. Sadeeq, and S. Zeebaree, “Multimodal Emotion Recognition using Deep Learning”, JASTT, vol. 2, no. 02, pp. 52-58, Apr. 2021.
Ying Y, Tu Y, Zhou H (2021) Unsupervised feature learning for speech emotion recognition
based on auto encoder. MDPI
Sultana S (2021) SUST Bangla emotional speech corpus. PLOS One
Prasanth S, Roshni Thanka M, Bijolin Edwin E, Nagaraj V (2021) Speech emotion recognition based on machine learning tactics and algorithms. Mater Today Proc