Multi-modal Emotion Analysis for Chatbots

Gijoo Yang, Jeonggeun Jin, Dongho Kim, Hae Jong Joo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Developing chatbots that can recognize the emotions of users is a challenging problem of artificial intelligence. In order to build such a system, we need to define the emotion taxonomy to cover human-like feelings. Consequently, we need to prepare a large scale training data by using the defined emotion taxonomy. In this paper, we investigate methods of representing emotions and applying them in a deep neural network model that classifies the user’s emotion into many dimensions. We also take into account auditory signals of spoken language in addition to contextual information for classifying the emotions of users. Furthermore, we tackle the compositional negation of utterances which may cause misinterpretation of the emotion in the opposite direction. Our experiment shows that our model improves the performance of baseline models significantly.

Original languageEnglish
Title of host publicationHigh-Performance Computing and Big Data Analysis- 2nd International Congress, TopHPC 2019, Revised Selected Papers
EditorsLucio Grandinetti, Reza Shahbazian, Seyedeh Leili Mirtaheri
PublisherSpringer Science and Business Media Deutschland GmbH
Pages331-338
Number of pages8
ISBN (Print)9783030334949
DOIs
StatePublished - 2019
Event2nd International Congress on High-Performance Computing and Big Data Analysis, TopHPC 2019 - Tehran, Iran, Islamic Republic of
Duration: 23 Apr 201925 Apr 2019

Publication series

NameCommunications in Computer and Information Science
Volume891
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference2nd International Congress on High-Performance Computing and Big Data Analysis, TopHPC 2019
Country/TerritoryIran, Islamic Republic of
CityTehran
Period23/04/1925/04/19

Keywords

  • Audio analysis
  • Chatbot
  • Emotion analysis
  • Recursive neural network

Fingerprint

Dive into the research topics of 'Multi-modal Emotion Analysis for Chatbots'. Together they form a unique fingerprint.

Cite this