International Scientific Journal of Engineering and Management

An International Scholarly || Multidisciplinary || Open Access || Indexing in all major Database & Metadata
ISSN: 2583-6129

Impact Factor: 6.674

Real-Time Multimodal Emotion Recognition

  • Version
  • Download 71
  • File Size 806.48 KB
  • File Count 1
  • Create Date 17 April 2024
  • Last Updated 22 April 2024

Real-Time Multimodal Emotion Recognition

 

                          1.Mrs.S. Bhargavi, 2.Mrs.B.Siva Kumari 3.Ms. M.Swathi, 4.Ms. K.Kalyani, 5.Ms.Ch.Rajasri

  1. Faculty of Electronics and Communication Engineering, Bapatla women’s Engineering College, Bapatla, Andhra Pradesh, India.
  2. Faculty of Electronics and Communication Engineering, Bapatla women’s Engineering College, Bapatla, Andhra Pradesh, India.
  3. Student of Electronics and Communication Engineering, Bapatla Women’s Engineering College, Bapatla, Andhra Pradesh, India.
  4. Student of Electronics and Communication Engineering, Bapatla Women’s Engineering College, Bapatla, Andhra Pradesh, India.
  5. Student of Electronics and Communication Engineering, Bapatla Women’s Engineering College, Bapatla, Andhra Pradesh, India.

ABSTRACT:

                 Safeguarding the well-being of women and children presents a challenging research endeavor. Multimodal emotion recognition poses a formidable task within this domain. The field of Human-Computer Interaction (HCI) heavily relies on multimodal data, encompassing audio, video, text, facial expressions, body motions, bio-signals, and physiological data, to predict the safety of women and children. Substantial research efforts have been dedicated to this cause. To develop an optimal multimodal model for emotion recognition, which integrates visual, textual, auditory, and video modalities, a novel deep learning framework is proposed. This framework involves a comprehensive analysis of data, feature extraction, and model-level fusion. Innovative feature extractor networks are tailored specifically for processing visual, textual, auditory, and video data. At the model level, an effective multimodal emotion recognition model is devised, synthesizing information from images, text, voice, and video. The proposed models exhibit impressive performance on three benchmark multimodal datasets, namely IEMOCAP, Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS), and Surrey Audio-Visual Expressed Emotion (SAVEE), achieving high predicted accuracies of 96%, 97%, and 97%, respectively. Comparative analysis with existing emotion recognition models further validates the efficacy and optimality of the proposed approach. The application of multimodal enhanced emotion recognition holds promise in predicting women and children's safety.

Index Terms: Facial Expression Recognition, Deep Learning, Multimodal, Women's Safety, Audio-Visual Media, Fusion.


Download

Author's Blog

What is the difference between a Research Paper and a Review Paper?

A research paper and a review paper are both scholarly documents, but they serve different purposes and have different characteristics.research...
Read More
Author's Blog

What is DOI?

A Digital Object Identifier (DOI) is a unique alphanumeric string that is used to identify and provide a persistent link...
Read More
Author's Blog

What do you need to do during production of your Research Paper?

During the production of a research paper, the following steps need to be taken: conducting research, organizing and analyzing data,...
Read More
Author's Blog

What are the advantages of publishing a research paper?

Publishing a research paper can have many advantages for researchers, including: Career advancement, professional recognition, opportunities for collaboration, increased visibility,...
Read More
Author's Blog

Ways to Support your Academic Wellbeing which preparing the Research Paper/Article

To support your academic wellbeing while publishing a research paper, it's important to set realistic goals, manage your time effectively,...
Read More
Author's Blog

How to improve your Research Paper writing Skills?

Read extensively: One of the best ways to improve your research paper skills is to read extensively in your field...
Read More
Author's Blog

Is DOI compulsory to publish a research paper in a Journal?

DOI is not strictly required to publish a research paper, but it is highly recommended. Basically, the International Scientific Journal...
Read More
Author's Blog

In what ways does research paper give weight to career development?

Publishing a research paper can give weight to a researcher's career development in several ways, such as: establishing oneself as...
Read More
Author's Blog

How to develop a Research Paper from Scratch

Developing a research paper involves several steps including: choosing a topic, conducting background research, formulating a research question or hypothesis,...
Read More
Author's Blog

How Plagiarism report plays crucial role in Research Paper Publication?

Plagiarism is a major concern in the academic and research community, as it undermines the integrity of the research and...
Read More