Direct Classification of Emotional Intensity

In this paper, we present a model that can directly predict emotion intensity score from video inputs, instead of deriving from action units. Using a 3d DNN incorporated with dynamic emotion information, we train a model using videos of different people smiling that outputs an intensity score from 0...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ouyang, Jacob, Galatzer-Levy, Isaac R, Koesmahargyo, Vidya, Zhang, Li
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Ouyang, Jacob
Galatzer-Levy, Isaac R
Koesmahargyo, Vidya
Zhang, Li
description In this paper, we present a model that can directly predict emotion intensity score from video inputs, instead of deriving from action units. Using a 3d DNN incorporated with dynamic emotion information, we train a model using videos of different people smiling that outputs an intensity score from 0-10. Each video is labeled framewise using a normalized action-unit based intensity score. Our model then employs an adaptive learning technique to improve performance when dealing with new subjects. Compared to other models, our model excels in generalization between different people as well as provides a new framework to directly classify emotional intensity.
doi_str_mv 10.48550/arxiv.2011.07460
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2011_07460</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2011_07460</sourcerecordid><originalsourceid>FETCH-LOGICAL-a670-fc4edebeb5439257d9ae2e93c48e1a24d70d73d654aca7d4837da167fd2e66eb3</originalsourceid><addsrcrecordid>eNotzrkKwkAUheFpLER9ACvzACbOPkkpcYWAjX24mbkDA1kkCWLeXlyq81eHj5A1o4lMlaI76F_hmXDKWEKN1HROtofQox2jvIZhCD5YGEPXRp2Pjk33SaijaztiO4RxWpKZh3rA1X8X5H463vNLXNzO13xfxKANjb2V6LDCSkmRcWVcBsgxE1amyIBLZ6gzwmklwYJxMhXGAdPGO45aYyUWZPO7_XLLRx8a6Kfywy6_bPEGWXk9ZA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Direct Classification of Emotional Intensity</title><source>arXiv.org</source><creator>Ouyang, Jacob ; Galatzer-Levy, Isaac R ; Koesmahargyo, Vidya ; Zhang, Li</creator><creatorcontrib>Ouyang, Jacob ; Galatzer-Levy, Isaac R ; Koesmahargyo, Vidya ; Zhang, Li</creatorcontrib><description>In this paper, we present a model that can directly predict emotion intensity score from video inputs, instead of deriving from action units. Using a 3d DNN incorporated with dynamic emotion information, we train a model using videos of different people smiling that outputs an intensity score from 0-10. Each video is labeled framewise using a normalized action-unit based intensity score. Our model then employs an adaptive learning technique to improve performance when dealing with new subjects. Compared to other models, our model excels in generalization between different people as well as provides a new framework to directly classify emotional intensity.</description><identifier>DOI: 10.48550/arxiv.2011.07460</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computer Vision and Pattern Recognition ; Computer Science - Learning</subject><creationdate>2020-11</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2011.07460$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2011.07460$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Ouyang, Jacob</creatorcontrib><creatorcontrib>Galatzer-Levy, Isaac R</creatorcontrib><creatorcontrib>Koesmahargyo, Vidya</creatorcontrib><creatorcontrib>Zhang, Li</creatorcontrib><title>Direct Classification of Emotional Intensity</title><description>In this paper, we present a model that can directly predict emotion intensity score from video inputs, instead of deriving from action units. Using a 3d DNN incorporated with dynamic emotion information, we train a model using videos of different people smiling that outputs an intensity score from 0-10. Each video is labeled framewise using a normalized action-unit based intensity score. Our model then employs an adaptive learning technique to improve performance when dealing with new subjects. Compared to other models, our model excels in generalization between different people as well as provides a new framework to directly classify emotional intensity.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzrkKwkAUheFpLER9ACvzACbOPkkpcYWAjX24mbkDA1kkCWLeXlyq81eHj5A1o4lMlaI76F_hmXDKWEKN1HROtofQox2jvIZhCD5YGEPXRp2Pjk33SaijaztiO4RxWpKZh3rA1X8X5H463vNLXNzO13xfxKANjb2V6LDCSkmRcWVcBsgxE1amyIBLZ6gzwmklwYJxMhXGAdPGO45aYyUWZPO7_XLLRx8a6Kfywy6_bPEGWXk9ZA</recordid><startdate>20201115</startdate><enddate>20201115</enddate><creator>Ouyang, Jacob</creator><creator>Galatzer-Levy, Isaac R</creator><creator>Koesmahargyo, Vidya</creator><creator>Zhang, Li</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20201115</creationdate><title>Direct Classification of Emotional Intensity</title><author>Ouyang, Jacob ; Galatzer-Levy, Isaac R ; Koesmahargyo, Vidya ; Zhang, Li</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a670-fc4edebeb5439257d9ae2e93c48e1a24d70d73d654aca7d4837da167fd2e66eb3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Ouyang, Jacob</creatorcontrib><creatorcontrib>Galatzer-Levy, Isaac R</creatorcontrib><creatorcontrib>Koesmahargyo, Vidya</creatorcontrib><creatorcontrib>Zhang, Li</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Ouyang, Jacob</au><au>Galatzer-Levy, Isaac R</au><au>Koesmahargyo, Vidya</au><au>Zhang, Li</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Direct Classification of Emotional Intensity</atitle><date>2020-11-15</date><risdate>2020</risdate><abstract>In this paper, we present a model that can directly predict emotion intensity score from video inputs, instead of deriving from action units. Using a 3d DNN incorporated with dynamic emotion information, we train a model using videos of different people smiling that outputs an intensity score from 0-10. Each video is labeled framewise using a normalized action-unit based intensity score. Our model then employs an adaptive learning technique to improve performance when dealing with new subjects. Compared to other models, our model excels in generalization between different people as well as provides a new framework to directly classify emotional intensity.</abstract><doi>10.48550/arxiv.2011.07460</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2011.07460
ispartof
issn
language eng
recordid cdi_arxiv_primary_2011_07460
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Computer Vision and Pattern Recognition
Computer Science - Learning
title Direct Classification of Emotional Intensity
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T01%3A59%3A06IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Direct%20Classification%20of%20Emotional%20Intensity&rft.au=Ouyang,%20Jacob&rft.date=2020-11-15&rft_id=info:doi/10.48550/arxiv.2011.07460&rft_dat=%3Carxiv_GOX%3E2011_07460%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true