Explainable Facial Expression Recognition for People with Intellectual Disabilities

Explainable Facial Expression Recognition for People with Intellectual Disabilities

Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques available to make them more transparent. In this work, we propose...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2024-05
Hauptverfasser: Silvia Ramis Guarinos, Cristina Manresa Yee, Buades Rubio, Jose Maria, Gaya-Morey, Francesc Xavier
Format: Artikel
Sprache:eng
Schlagworte:
Computer Science - Human-Computer Interaction
Face recognition
Neural networks
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Silvia Ramis Guarinos
Cristina Manresa Yee
Buades Rubio, Jose Maria
Gaya-Morey, Francesc Xavier
description Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques available to make them more transparent. In this work, we propose a facial expression recognition study for people with intellectual disabilities that would be integrated into a social robot. We train two well-known neural networks with five databases of facial expressions and test them with two databases containing people with and without intellectual disabilities. Finally, we study in which regions the models focus to perceive a particular expression using two different explainability techniques: LIME and RISE, assessing the differences when used on images containing disabled and non-disabled people.
doi_str_mv 10.48550/arxiv.2405.11482
format Article
fullrecord <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2405_11482</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3057514788</sourcerecordid><originalsourceid>FETCH-LOGICAL-a528-f84ff2b27f4ab90921826082f2cde59dedb195e330a2b5143adea69bdca9edfa3</originalsourceid><addsrcrecordid>eNotj8FKAzEQhoMgWGofwJMLnrcmk6SbPUpttVBQtPdlsptoStxdk63Wt2_aepph-P6f-Qi5YXQqlJT0HsPe_UxBUDllTCi4ICPgnOVKAFyRSYxbSinMCpCSj8j7Yt97dC1qb7Il1g59lk7BxOi6NnszdffRuuG42y5kr6brE_jrhs9s1Q7Ge1MPu5R5dBG184k08ZpcWvTRTP7nmGyWi838OV-_PK3mD-scJajcKmEtaCisQF3SEpiCGVVgoW6MLBvTaFZKwzlF0JIJjo3BWambGkvTWORjcnuuPRlXfXBfGP6qo3l1Mk_E3ZnoQ_e9M3Gott0utOmnilNZpNJCKX4AZi9dUg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3057514788</pqid></control><display><type>article</type><title>Explainable Facial Expression Recognition for People with Intellectual Disabilities</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Silvia Ramis Guarinos ; Cristina Manresa Yee ; Buades Rubio, Jose Maria ; Gaya-Morey, Francesc Xavier</creator><creatorcontrib>Silvia Ramis Guarinos ; Cristina Manresa Yee ; Buades Rubio, Jose Maria ; Gaya-Morey, Francesc Xavier</creatorcontrib><description>Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques available to make them more transparent. In this work, we propose a facial expression recognition study for people with intellectual disabilities that would be integrated into a social robot. We train two well-known neural networks with five databases of facial expressions and test them with two databases containing people with and without intellectual disabilities. Finally, we study in which regions the models focus to perceive a particular expression using two different explainability techniques: LIME and RISE, assessing the differences when used on images containing disabled and non-disabled people.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2405.11482</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Computer Science - Human-Computer Interaction ; Face recognition ; Neural networks</subject><ispartof>arXiv.org, 2024-05</ispartof><rights>2024. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,781,785,886,27930</link.rule.ids><backlink>$$Uhttps://doi.org/10.48550/arXiv.2405.11482$$DView paper in arXiv$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.1145/3612783.3612789$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink></links><search><creatorcontrib>Silvia Ramis Guarinos</creatorcontrib><creatorcontrib>Cristina Manresa Yee</creatorcontrib><creatorcontrib>Buades Rubio, Jose Maria</creatorcontrib><creatorcontrib>Gaya-Morey, Francesc Xavier</creatorcontrib><title>Explainable Facial Expression Recognition for People with Intellectual Disabilities</title><title>arXiv.org</title><description>Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques available to make them more transparent. In this work, we propose a facial expression recognition study for people with intellectual disabilities that would be integrated into a social robot. We train two well-known neural networks with five databases of facial expressions and test them with two databases containing people with and without intellectual disabilities. Finally, we study in which regions the models focus to perceive a particular expression using two different explainability techniques: LIME and RISE, assessing the differences when used on images containing disabled and non-disabled people.</description><subject>Computer Science - Human-Computer Interaction</subject><subject>Face recognition</subject><subject>Neural networks</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GOX</sourceid><recordid>eNotj8FKAzEQhoMgWGofwJMLnrcmk6SbPUpttVBQtPdlsptoStxdk63Wt2_aepph-P6f-Qi5YXQqlJT0HsPe_UxBUDllTCi4ICPgnOVKAFyRSYxbSinMCpCSj8j7Yt97dC1qb7Il1g59lk7BxOi6NnszdffRuuG42y5kr6brE_jrhs9s1Q7Ge1MPu5R5dBG184k08ZpcWvTRTP7nmGyWi838OV-_PK3mD-scJajcKmEtaCisQF3SEpiCGVVgoW6MLBvTaFZKwzlF0JIJjo3BWambGkvTWORjcnuuPRlXfXBfGP6qo3l1Mk_E3ZnoQ_e9M3Gott0utOmnilNZpNJCKX4AZi9dUg</recordid><startdate>20240519</startdate><enddate>20240519</enddate><creator>Silvia Ramis Guarinos</creator><creator>Cristina Manresa Yee</creator><creator>Buades Rubio, Jose Maria</creator><creator>Gaya-Morey, Francesc Xavier</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240519</creationdate><title>Explainable Facial Expression Recognition for People with Intellectual Disabilities</title><author>Silvia Ramis Guarinos ; Cristina Manresa Yee ; Buades Rubio, Jose Maria ; Gaya-Morey, Francesc Xavier</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a528-f84ff2b27f4ab90921826082f2cde59dedb195e330a2b5143adea69bdca9edfa3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Human-Computer Interaction</topic><topic>Face recognition</topic><topic>Neural networks</topic><toplevel>online_resources</toplevel><creatorcontrib>Silvia Ramis Guarinos</creatorcontrib><creatorcontrib>Cristina Manresa Yee</creatorcontrib><creatorcontrib>Buades Rubio, Jose Maria</creatorcontrib><creatorcontrib>Gaya-Morey, Francesc Xavier</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Access via ProQuest (Open Access)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv Computer Science</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Silvia Ramis Guarinos</au><au>Cristina Manresa Yee</au><au>Buades Rubio, Jose Maria</au><au>Gaya-Morey, Francesc Xavier</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Explainable Facial Expression Recognition for People with Intellectual Disabilities</atitle><jtitle>arXiv.org</jtitle><date>2024-05-19</date><risdate>2024</risdate><eissn>2331-8422</eissn><abstract>Facial expression recognition plays an important role in human behaviour, communication, and interaction. Recent neural networks have demonstrated to perform well at its automatic recognition, with different explainability techniques available to make them more transparent. In this work, we propose a facial expression recognition study for people with intellectual disabilities that would be integrated into a social robot. We train two well-known neural networks with five databases of facial expressions and test them with two databases containing people with and without intellectual disabilities. Finally, we study in which regions the models focus to perceive a particular expression using two different explainability techniques: LIME and RISE, assessing the differences when used on images containing disabled and non-disabled people.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2405.11482</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2024-05
issn 2331-8422
language eng
recordid cdi_arxiv_primary_2405_11482
source arXiv.org; Free E- Journals
subjects Computer Science - Human-Computer Interaction
Face recognition
Neural networks
title Explainable Facial Expression Recognition for People with Intellectual Disabilities
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-11T21%3A06%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Explainable%20Facial%20Expression%20Recognition%20for%20People%20with%20Intellectual%20Disabilities&rft.jtitle=arXiv.org&rft.au=Silvia%20Ramis%20Guarinos&rft.date=2024-05-19&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2405.11482&rft_dat=%3Cproquest_arxiv%3E3057514788%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3057514788&rft_id=info:pmid/&rfr_iscdi=true