Semantic-Emotion Neural Network for Emotion Recognition From Text

Emotion detection and recognition from text is a recent essential research area in Natural Language Processing (NLP) which may reveal some valuable input to a variety of purposes. Nowadays, writings take many forms of social media posts, micro-blogs, news articles, customer review, etc., and the con...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2019, Vol.7, p.111866-111878
Hauptverfasser: Batbaatar, Erdenebileg, Li, Meijing, Ryu, Keun Ho
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 111878
container_issue
container_start_page 111866
container_title IEEE access
container_volume 7
creator Batbaatar, Erdenebileg
Li, Meijing
Ryu, Keun Ho
description Emotion detection and recognition from text is a recent essential research area in Natural Language Processing (NLP) which may reveal some valuable input to a variety of purposes. Nowadays, writings take many forms of social media posts, micro-blogs, news articles, customer review, etc., and the content of these short-texts can be a useful resource for text mining to discover an unhide various aspects, including emotions. The previously presented models mainly adopted word embedding vectors that represent rich semantic/syntactic information and those models cannot capture the emotional relationship between words. Recently, some emotional word embeddings are proposed but it requires semantic and syntactic information vice versa. To address this issue, we proposed a novel neural network architecture, called SENN (Semantic-Emotion Neural Network) which can utilize both semantic/syntactic and emotional information by adopting pre-trained word representations. SENN model has mainly two sub-networks, the first sub-network uses bidirectional Long-Short Term Memory (BiLSTM) to capture contextual information and focuses on semantic relationship, the second sub-network uses the convolutional neural network (CNN) to extract emotional features and focuses on the emotional relationship between words from the text. We conducted a comprehensive performance evaluation for the proposed model using standard real-world datasets. We adopted the notion of Ekman's six basic emotions. The experimental results show that the proposed model achieves a significantly superior quality of emotion recognition with various state-of-the-art approaches and further can be improved by other emotional word embeddings.
doi_str_mv 10.1109/ACCESS.2019.2934529
format Article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_8794541</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8794541</ieee_id><doaj_id>oai_doaj_org_article_ce69c8db7ddc427cb45224881c3b03a1</doaj_id><sourcerecordid>2455611463</sourcerecordid><originalsourceid>FETCH-LOGICAL-c474t-6c224a61f0d036f62d377c25590fae364cf8f599894f560c52d80ef577a405c13</originalsourceid><addsrcrecordid>eNpNkE1PAjEQhhujiUT5BVw28bzY748j2YCSEE0Ez03ptmSR3WJ3ifrvLSwS5zKTmXnfaR8ARgiOEYLqcVIU0-VyjCFSY6wIZVhdgQFGXOWEEX79r74Fw7bdwhQytZgYgMnS1abpKptP69BVocle3CGaXUrdV4gfmQ8x-xu9ORs2TXWqZzHU2cp9d_fgxptd64bnfAfeZ9NV8ZwvXp_mxWSRWypol3OLMTUceVhCwj3HJRHCYsYU9MYRTq2XniklFfWMQ8twKaHzTAhDIbOI3IF571sGs9X7WNUm_uhgKn1qhLjRJqaP7Jy2jisry7UoS0uxsOvEBFMpkSVrSMzR66H32sfweXBtp7fhEJv0fI0pYxwhyknaIv2WjaFto_OXqwjqI3rdo9dH9PqMPqlGvapyzl0UUijKKCK_6ax9xg</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2455611463</pqid></control><display><type>article</type><title>Semantic-Emotion Neural Network for Emotion Recognition From Text</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><creator>Batbaatar, Erdenebileg ; Li, Meijing ; Ryu, Keun Ho</creator><creatorcontrib>Batbaatar, Erdenebileg ; Li, Meijing ; Ryu, Keun Ho</creatorcontrib><description>Emotion detection and recognition from text is a recent essential research area in Natural Language Processing (NLP) which may reveal some valuable input to a variety of purposes. Nowadays, writings take many forms of social media posts, micro-blogs, news articles, customer review, etc., and the content of these short-texts can be a useful resource for text mining to discover an unhide various aspects, including emotions. The previously presented models mainly adopted word embedding vectors that represent rich semantic/syntactic information and those models cannot capture the emotional relationship between words. Recently, some emotional word embeddings are proposed but it requires semantic and syntactic information vice versa. To address this issue, we proposed a novel neural network architecture, called SENN (Semantic-Emotion Neural Network) which can utilize both semantic/syntactic and emotional information by adopting pre-trained word representations. SENN model has mainly two sub-networks, the first sub-network uses bidirectional Long-Short Term Memory (BiLSTM) to capture contextual information and focuses on semantic relationship, the second sub-network uses the convolutional neural network (CNN) to extract emotional features and focuses on the emotional relationship between words from the text. We conducted a comprehensive performance evaluation for the proposed model using standard real-world datasets. We adopted the notion of Ekman's six basic emotions. The experimental results show that the proposed model achieves a significantly superior quality of emotion recognition with various state-of-the-art approaches and further can be improved by other emotional word embeddings.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2019.2934529</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Artificial neural networks ; Computer architecture ; Data mining ; Deep learning ; Dictionaries ; Digital media ; Emotion recognition ; Emotions ; Feature extraction ; Natural language processing ; Neural networks ; Performance evaluation ; Semantics ; Social networks ; Task analysis ; Words (language)</subject><ispartof>IEEE access, 2019, Vol.7, p.111866-111878</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c474t-6c224a61f0d036f62d377c25590fae364cf8f599894f560c52d80ef577a405c13</citedby><cites>FETCH-LOGICAL-c474t-6c224a61f0d036f62d377c25590fae364cf8f599894f560c52d80ef577a405c13</cites><orcidid>0000-0002-9724-8955 ; 0000-0003-0394-9054</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8794541$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,860,2096,4010,27610,27900,27901,27902,54908</link.rule.ids></links><search><creatorcontrib>Batbaatar, Erdenebileg</creatorcontrib><creatorcontrib>Li, Meijing</creatorcontrib><creatorcontrib>Ryu, Keun Ho</creatorcontrib><title>Semantic-Emotion Neural Network for Emotion Recognition From Text</title><title>IEEE access</title><addtitle>Access</addtitle><description>Emotion detection and recognition from text is a recent essential research area in Natural Language Processing (NLP) which may reveal some valuable input to a variety of purposes. Nowadays, writings take many forms of social media posts, micro-blogs, news articles, customer review, etc., and the content of these short-texts can be a useful resource for text mining to discover an unhide various aspects, including emotions. The previously presented models mainly adopted word embedding vectors that represent rich semantic/syntactic information and those models cannot capture the emotional relationship between words. Recently, some emotional word embeddings are proposed but it requires semantic and syntactic information vice versa. To address this issue, we proposed a novel neural network architecture, called SENN (Semantic-Emotion Neural Network) which can utilize both semantic/syntactic and emotional information by adopting pre-trained word representations. SENN model has mainly two sub-networks, the first sub-network uses bidirectional Long-Short Term Memory (BiLSTM) to capture contextual information and focuses on semantic relationship, the second sub-network uses the convolutional neural network (CNN) to extract emotional features and focuses on the emotional relationship between words from the text. We conducted a comprehensive performance evaluation for the proposed model using standard real-world datasets. We adopted the notion of Ekman's six basic emotions. The experimental results show that the proposed model achieves a significantly superior quality of emotion recognition with various state-of-the-art approaches and further can be improved by other emotional word embeddings.</description><subject>Artificial neural networks</subject><subject>Computer architecture</subject><subject>Data mining</subject><subject>Deep learning</subject><subject>Dictionaries</subject><subject>Digital media</subject><subject>Emotion recognition</subject><subject>Emotions</subject><subject>Feature extraction</subject><subject>Natural language processing</subject><subject>Neural networks</subject><subject>Performance evaluation</subject><subject>Semantics</subject><subject>Social networks</subject><subject>Task analysis</subject><subject>Words (language)</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNkE1PAjEQhhujiUT5BVw28bzY748j2YCSEE0Ez03ptmSR3WJ3ifrvLSwS5zKTmXnfaR8ARgiOEYLqcVIU0-VyjCFSY6wIZVhdgQFGXOWEEX79r74Fw7bdwhQytZgYgMnS1abpKptP69BVocle3CGaXUrdV4gfmQ8x-xu9ORs2TXWqZzHU2cp9d_fgxptd64bnfAfeZ9NV8ZwvXp_mxWSRWypol3OLMTUceVhCwj3HJRHCYsYU9MYRTq2XniklFfWMQ8twKaHzTAhDIbOI3IF571sGs9X7WNUm_uhgKn1qhLjRJqaP7Jy2jisry7UoS0uxsOvEBFMpkSVrSMzR66H32sfweXBtp7fhEJv0fI0pYxwhyknaIv2WjaFto_OXqwjqI3rdo9dH9PqMPqlGvapyzl0UUijKKCK_6ax9xg</recordid><startdate>2019</startdate><enddate>2019</enddate><creator>Batbaatar, Erdenebileg</creator><creator>Li, Meijing</creator><creator>Ryu, Keun Ho</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-9724-8955</orcidid><orcidid>https://orcid.org/0000-0003-0394-9054</orcidid></search><sort><creationdate>2019</creationdate><title>Semantic-Emotion Neural Network for Emotion Recognition From Text</title><author>Batbaatar, Erdenebileg ; Li, Meijing ; Ryu, Keun Ho</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c474t-6c224a61f0d036f62d377c25590fae364cf8f599894f560c52d80ef577a405c13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Artificial neural networks</topic><topic>Computer architecture</topic><topic>Data mining</topic><topic>Deep learning</topic><topic>Dictionaries</topic><topic>Digital media</topic><topic>Emotion recognition</topic><topic>Emotions</topic><topic>Feature extraction</topic><topic>Natural language processing</topic><topic>Neural networks</topic><topic>Performance evaluation</topic><topic>Semantics</topic><topic>Social networks</topic><topic>Task analysis</topic><topic>Words (language)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Batbaatar, Erdenebileg</creatorcontrib><creatorcontrib>Li, Meijing</creatorcontrib><creatorcontrib>Ryu, Keun Ho</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Batbaatar, Erdenebileg</au><au>Li, Meijing</au><au>Ryu, Keun Ho</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Semantic-Emotion Neural Network for Emotion Recognition From Text</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2019</date><risdate>2019</risdate><volume>7</volume><spage>111866</spage><epage>111878</epage><pages>111866-111878</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>Emotion detection and recognition from text is a recent essential research area in Natural Language Processing (NLP) which may reveal some valuable input to a variety of purposes. Nowadays, writings take many forms of social media posts, micro-blogs, news articles, customer review, etc., and the content of these short-texts can be a useful resource for text mining to discover an unhide various aspects, including emotions. The previously presented models mainly adopted word embedding vectors that represent rich semantic/syntactic information and those models cannot capture the emotional relationship between words. Recently, some emotional word embeddings are proposed but it requires semantic and syntactic information vice versa. To address this issue, we proposed a novel neural network architecture, called SENN (Semantic-Emotion Neural Network) which can utilize both semantic/syntactic and emotional information by adopting pre-trained word representations. SENN model has mainly two sub-networks, the first sub-network uses bidirectional Long-Short Term Memory (BiLSTM) to capture contextual information and focuses on semantic relationship, the second sub-network uses the convolutional neural network (CNN) to extract emotional features and focuses on the emotional relationship between words from the text. We conducted a comprehensive performance evaluation for the proposed model using standard real-world datasets. We adopted the notion of Ekman's six basic emotions. The experimental results show that the proposed model achieves a significantly superior quality of emotion recognition with various state-of-the-art approaches and further can be improved by other emotional word embeddings.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2019.2934529</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0002-9724-8955</orcidid><orcidid>https://orcid.org/0000-0003-0394-9054</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2019, Vol.7, p.111866-111878
issn 2169-3536
2169-3536
language eng
recordid cdi_ieee_primary_8794541
source IEEE Open Access Journals; DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals
subjects Artificial neural networks
Computer architecture
Data mining
Deep learning
Dictionaries
Digital media
Emotion recognition
Emotions
Feature extraction
Natural language processing
Neural networks
Performance evaluation
Semantics
Social networks
Task analysis
Words (language)
title Semantic-Emotion Neural Network for Emotion Recognition From Text
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-30T20%3A36%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Semantic-Emotion%20Neural%20Network%20for%20Emotion%20Recognition%20From%20Text&rft.jtitle=IEEE%20access&rft.au=Batbaatar,%20Erdenebileg&rft.date=2019&rft.volume=7&rft.spage=111866&rft.epage=111878&rft.pages=111866-111878&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2019.2934529&rft_dat=%3Cproquest_ieee_%3E2455611463%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2455611463&rft_id=info:pmid/&rft_ieee_id=8794541&rft_doaj_id=oai_doaj_org_article_ce69c8db7ddc427cb45224881c3b03a1&rfr_iscdi=true