Extending the Evaluation of Social Assistive Robots With Accessibility Indicators: The AUSUS Evaluation Framework
The introduction of robots in the real world requires previous evaluation of the envisaged performance. Factors like usability, user experience, social acceptance, or societal impact, among others, have been taken into account in evaluation frameworks defined during the last years. However, one of t...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on human-machine systems 2021-12, Vol.51 (6), p.601-612 |
|---|---|
| Hauptverfasser: | , , , , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 612 |
|---|---|
| container_issue | 6 |
| container_start_page | 601 |
| container_title | IEEE transactions on human-machine systems |
| container_volume | 51 |
| creator | Iglesias, Ana Garcia, Javier Garcia-Olaya, Angel Fuentetaja, Raquel Fernandez, Fernando Romero-Garces, Adrian Marfil, Rebeca Bandera, Antonio Ting, Karine Lan Hing Voilmy, Dimitri Duenas, Alvaro Suarez-Mejias, Cristina |
| description | The introduction of robots in the real world requires previous evaluation of the envisaged performance. Factors like usability, user experience, social acceptance, or societal impact, among others, have been taken into account in evaluation frameworks defined during the last years. However, one of the most important factors that need to be evaluated in any kind of interaction is whether all the users are able to work with the system with the same opportunities and easiness, and none of the current human-robot interaction (HRI) evaluation frameworks include this factor yet. This article proposes an extension of a popular HRI evaluation framework, including accessibility as a new evaluation factor. The proposed approach, named AUSUS, considers Accessibility, Usability, Social acceptance, User experience, and Societal impact. This article presents a use case of the framework, which is evaluated through a socially assistive robotic platform created to perform comprehensive geriatric assessment: the CLARC system. The details of the evaluation process in a hospital and a retirement home are reported, and the main difficulties and recommendations of using AUSUS are discussed. |
| doi_str_mv | 10.1109/THMS.2021.3112976 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_9576895</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9576895</ieee_id><sourcerecordid>2598255898</sourcerecordid><originalsourceid>FETCH-LOGICAL-c336t-3f549689939efd3c6122bc5972e3884fad85b4ee988ac05c2ece3a2f6650fc323</originalsourceid><addsrcrecordid>eNpNkN9PwjAQxxejiUT5A4wvTXwe9gcdrW8LASHBmDiIj0tXblIcK7QF5b93C2i8l7vkvve5u28U3RHcIwTLx_nkJetRTEmPEULlILmIOpQkIqYM88vfmkpyHXW9X-MmBOWci060G30HqJem_kBhBWh0UNVeBWNrZEuUWW1UhVLvjQ_mAOjNFjZ49G7CCqVaQ9MoTGXCEU0bhlbBOv-E5g0oXWSL7D9u7NQGvqz7vI2uSlV56J7zTbQYj-bDSTx7fZ4O01msGUtCzErel4mQkkkol0wnhNJCczmgwITol2opeNEHkEIojbmmoIEpWiYJx6VmlN1EDyfu1tndHnzI13bv6mZlTrls_xdSNCpyUmlnvXdQ5ltnNsodc4Lz1ty8NTdvzc3P5jYz96cZAwB_eskHzbmc_QDVMnZH</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2598255898</pqid></control><display><type>article</type><title>Extending the Evaluation of Social Assistive Robots With Accessibility Indicators: The AUSUS Evaluation Framework</title><source>IEEE Electronic Library (IEL)</source><creator>Iglesias, Ana ; Garcia, Javier ; Garcia-Olaya, Angel ; Fuentetaja, Raquel ; Fernandez, Fernando ; Romero-Garces, Adrian ; Marfil, Rebeca ; Bandera, Antonio ; Ting, Karine Lan Hing ; Voilmy, Dimitri ; Duenas, Alvaro ; Suarez-Mejias, Cristina</creator><creatorcontrib>Iglesias, Ana ; Garcia, Javier ; Garcia-Olaya, Angel ; Fuentetaja, Raquel ; Fernandez, Fernando ; Romero-Garces, Adrian ; Marfil, Rebeca ; Bandera, Antonio ; Ting, Karine Lan Hing ; Voilmy, Dimitri ; Duenas, Alvaro ; Suarez-Mejias, Cristina</creatorcontrib><description>The introduction of robots in the real world requires previous evaluation of the envisaged performance. Factors like usability, user experience, social acceptance, or societal impact, among others, have been taken into account in evaluation frameworks defined during the last years. However, one of the most important factors that need to be evaluated in any kind of interaction is whether all the users are able to work with the system with the same opportunities and easiness, and none of the current human-robot interaction (HRI) evaluation frameworks include this factor yet. This article proposes an extension of a popular HRI evaluation framework, including accessibility as a new evaluation factor. The proposed approach, named AUSUS, considers Accessibility, Usability, Social acceptance, User experience, and Societal impact. This article presents a use case of the framework, which is evaluated through a socially assistive robotic platform created to perform comprehensive geriatric assessment: the CLARC system. The details of the evaluation process in a hospital and a retirement home are reported, and the main difficulties and recommendations of using AUSUS are discussed.</description><identifier>ISSN: 2168-2291</identifier><identifier>EISSN: 2168-2305</identifier><identifier>DOI: 10.1109/THMS.2021.3112976</identifier><identifier>CODEN: ITHSA6</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Accessibility ; and cybernetics ; Human-robot interaction ; man ; Retirement ; robotics and automation ; Robots ; Service robots ; systems ; Usability ; User experience</subject><ispartof>IEEE transactions on human-machine systems, 2021-12, Vol.51 (6), p.601-612</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c336t-3f549689939efd3c6122bc5972e3884fad85b4ee988ac05c2ece3a2f6650fc323</citedby><cites>FETCH-LOGICAL-c336t-3f549689939efd3c6122bc5972e3884fad85b4ee988ac05c2ece3a2f6650fc323</cites><orcidid>0000-0002-4685-5034 ; 0000-0002-4531-5896 ; 0000-0002-6570-5859 ; 0000-0003-3801-6801 ; 0000-0002-3856-2629 ; 0000-0003-3147-0307</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9576895$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54736</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9576895$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Iglesias, Ana</creatorcontrib><creatorcontrib>Garcia, Javier</creatorcontrib><creatorcontrib>Garcia-Olaya, Angel</creatorcontrib><creatorcontrib>Fuentetaja, Raquel</creatorcontrib><creatorcontrib>Fernandez, Fernando</creatorcontrib><creatorcontrib>Romero-Garces, Adrian</creatorcontrib><creatorcontrib>Marfil, Rebeca</creatorcontrib><creatorcontrib>Bandera, Antonio</creatorcontrib><creatorcontrib>Ting, Karine Lan Hing</creatorcontrib><creatorcontrib>Voilmy, Dimitri</creatorcontrib><creatorcontrib>Duenas, Alvaro</creatorcontrib><creatorcontrib>Suarez-Mejias, Cristina</creatorcontrib><title>Extending the Evaluation of Social Assistive Robots With Accessibility Indicators: The AUSUS Evaluation Framework</title><title>IEEE transactions on human-machine systems</title><addtitle>THMS</addtitle><description>The introduction of robots in the real world requires previous evaluation of the envisaged performance. Factors like usability, user experience, social acceptance, or societal impact, among others, have been taken into account in evaluation frameworks defined during the last years. However, one of the most important factors that need to be evaluated in any kind of interaction is whether all the users are able to work with the system with the same opportunities and easiness, and none of the current human-robot interaction (HRI) evaluation frameworks include this factor yet. This article proposes an extension of a popular HRI evaluation framework, including accessibility as a new evaluation factor. The proposed approach, named AUSUS, considers Accessibility, Usability, Social acceptance, User experience, and Societal impact. This article presents a use case of the framework, which is evaluated through a socially assistive robotic platform created to perform comprehensive geriatric assessment: the CLARC system. The details of the evaluation process in a hospital and a retirement home are reported, and the main difficulties and recommendations of using AUSUS are discussed.</description><subject>Accessibility</subject><subject>and cybernetics</subject><subject>Human-robot interaction</subject><subject>man</subject><subject>Retirement</subject><subject>robotics and automation</subject><subject>Robots</subject><subject>Service robots</subject><subject>systems</subject><subject>Usability</subject><subject>User experience</subject><issn>2168-2291</issn><issn>2168-2305</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkN9PwjAQxxejiUT5A4wvTXwe9gcdrW8LASHBmDiIj0tXblIcK7QF5b93C2i8l7vkvve5u28U3RHcIwTLx_nkJetRTEmPEULlILmIOpQkIqYM88vfmkpyHXW9X-MmBOWci060G30HqJem_kBhBWh0UNVeBWNrZEuUWW1UhVLvjQ_mAOjNFjZ49G7CCqVaQ9MoTGXCEU0bhlbBOv-E5g0oXWSL7D9u7NQGvqz7vI2uSlV56J7zTbQYj-bDSTx7fZ4O01msGUtCzErel4mQkkkol0wnhNJCczmgwITol2opeNEHkEIojbmmoIEpWiYJx6VmlN1EDyfu1tndHnzI13bv6mZlTrls_xdSNCpyUmlnvXdQ5ltnNsodc4Lz1ty8NTdvzc3P5jYz96cZAwB_eskHzbmc_QDVMnZH</recordid><startdate>202112</startdate><enddate>202112</enddate><creator>Iglesias, Ana</creator><creator>Garcia, Javier</creator><creator>Garcia-Olaya, Angel</creator><creator>Fuentetaja, Raquel</creator><creator>Fernandez, Fernando</creator><creator>Romero-Garces, Adrian</creator><creator>Marfil, Rebeca</creator><creator>Bandera, Antonio</creator><creator>Ting, Karine Lan Hing</creator><creator>Voilmy, Dimitri</creator><creator>Duenas, Alvaro</creator><creator>Suarez-Mejias, Cristina</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7TB</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-4685-5034</orcidid><orcidid>https://orcid.org/0000-0002-4531-5896</orcidid><orcidid>https://orcid.org/0000-0002-6570-5859</orcidid><orcidid>https://orcid.org/0000-0003-3801-6801</orcidid><orcidid>https://orcid.org/0000-0002-3856-2629</orcidid><orcidid>https://orcid.org/0000-0003-3147-0307</orcidid></search><sort><creationdate>202112</creationdate><title>Extending the Evaluation of Social Assistive Robots With Accessibility Indicators: The AUSUS Evaluation Framework</title><author>Iglesias, Ana ; Garcia, Javier ; Garcia-Olaya, Angel ; Fuentetaja, Raquel ; Fernandez, Fernando ; Romero-Garces, Adrian ; Marfil, Rebeca ; Bandera, Antonio ; Ting, Karine Lan Hing ; Voilmy, Dimitri ; Duenas, Alvaro ; Suarez-Mejias, Cristina</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c336t-3f549689939efd3c6122bc5972e3884fad85b4ee988ac05c2ece3a2f6650fc323</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Accessibility</topic><topic>and cybernetics</topic><topic>Human-robot interaction</topic><topic>man</topic><topic>Retirement</topic><topic>robotics and automation</topic><topic>Robots</topic><topic>Service robots</topic><topic>systems</topic><topic>Usability</topic><topic>User experience</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Iglesias, Ana</creatorcontrib><creatorcontrib>Garcia, Javier</creatorcontrib><creatorcontrib>Garcia-Olaya, Angel</creatorcontrib><creatorcontrib>Fuentetaja, Raquel</creatorcontrib><creatorcontrib>Fernandez, Fernando</creatorcontrib><creatorcontrib>Romero-Garces, Adrian</creatorcontrib><creatorcontrib>Marfil, Rebeca</creatorcontrib><creatorcontrib>Bandera, Antonio</creatorcontrib><creatorcontrib>Ting, Karine Lan Hing</creatorcontrib><creatorcontrib>Voilmy, Dimitri</creatorcontrib><creatorcontrib>Duenas, Alvaro</creatorcontrib><creatorcontrib>Suarez-Mejias, Cristina</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on human-machine systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Iglesias, Ana</au><au>Garcia, Javier</au><au>Garcia-Olaya, Angel</au><au>Fuentetaja, Raquel</au><au>Fernandez, Fernando</au><au>Romero-Garces, Adrian</au><au>Marfil, Rebeca</au><au>Bandera, Antonio</au><au>Ting, Karine Lan Hing</au><au>Voilmy, Dimitri</au><au>Duenas, Alvaro</au><au>Suarez-Mejias, Cristina</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Extending the Evaluation of Social Assistive Robots With Accessibility Indicators: The AUSUS Evaluation Framework</atitle><jtitle>IEEE transactions on human-machine systems</jtitle><stitle>THMS</stitle><date>2021-12</date><risdate>2021</risdate><volume>51</volume><issue>6</issue><spage>601</spage><epage>612</epage><pages>601-612</pages><issn>2168-2291</issn><eissn>2168-2305</eissn><coden>ITHSA6</coden><abstract>The introduction of robots in the real world requires previous evaluation of the envisaged performance. Factors like usability, user experience, social acceptance, or societal impact, among others, have been taken into account in evaluation frameworks defined during the last years. However, one of the most important factors that need to be evaluated in any kind of interaction is whether all the users are able to work with the system with the same opportunities and easiness, and none of the current human-robot interaction (HRI) evaluation frameworks include this factor yet. This article proposes an extension of a popular HRI evaluation framework, including accessibility as a new evaluation factor. The proposed approach, named AUSUS, considers Accessibility, Usability, Social acceptance, User experience, and Societal impact. This article presents a use case of the framework, which is evaluated through a socially assistive robotic platform created to perform comprehensive geriatric assessment: the CLARC system. The details of the evaluation process in a hospital and a retirement home are reported, and the main difficulties and recommendations of using AUSUS are discussed.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/THMS.2021.3112976</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0002-4685-5034</orcidid><orcidid>https://orcid.org/0000-0002-4531-5896</orcidid><orcidid>https://orcid.org/0000-0002-6570-5859</orcidid><orcidid>https://orcid.org/0000-0003-3801-6801</orcidid><orcidid>https://orcid.org/0000-0002-3856-2629</orcidid><orcidid>https://orcid.org/0000-0003-3147-0307</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 2168-2291 |
| ispartof | IEEE transactions on human-machine systems, 2021-12, Vol.51 (6), p.601-612 |
| issn | 2168-2291 2168-2305 |
| language | eng |
| recordid | cdi_ieee_primary_9576895 |
| source | IEEE Electronic Library (IEL) |
| subjects | Accessibility and cybernetics Human-robot interaction man Retirement robotics and automation Robots Service robots systems Usability User experience |
| title | Extending the Evaluation of Social Assistive Robots With Accessibility Indicators: The AUSUS Evaluation Framework |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-27T12%3A07%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Extending%20the%20Evaluation%20of%20Social%20Assistive%20Robots%20With%20Accessibility%20Indicators:%20The%20AUSUS%20Evaluation%20Framework&rft.jtitle=IEEE%20transactions%20on%20human-machine%20systems&rft.au=Iglesias,%20Ana&rft.date=2021-12&rft.volume=51&rft.issue=6&rft.spage=601&rft.epage=612&rft.pages=601-612&rft.issn=2168-2291&rft.eissn=2168-2305&rft.coden=ITHSA6&rft_id=info:doi/10.1109/THMS.2021.3112976&rft_dat=%3Cproquest_RIE%3E2598255898%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2598255898&rft_id=info:pmid/&rft_ieee_id=9576895&rfr_iscdi=true |