SonifyIt: Towards Transformative Sound for All Robots
Transformative robot sound yields perceptual, functional, and social benefits in human-robot interactions, but broader research and implementation related to this topic is impeded by the lack of a common sound generation system for robots. Such a system could enable a wide array of situated robot so...
Gespeichert in:
| Veröffentlicht in: | IEEE robotics and automation letters 2022-10, Vol.7 (4), p.10566-10572 |
|---|---|
| Hauptverfasser: | , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 10572 |
|---|---|
| container_issue | 4 |
| container_start_page | 10566 |
| container_title | IEEE robotics and automation letters |
| container_volume | 7 |
| creator | Zhang, Brian J. Sigafoos, Noel Moffit, Rabecka Syed, Ibrahim Adams, Lili S. Fick, Jason Fitter, Naomi T. |
| description | Transformative robot sound yields perceptual, functional, and social benefits in human-robot interactions, but broader research and implementation related to this topic is impeded by the lack of a common sound generation system for robots. Such a system could enable a wide array of situated robot sound studies, smoother collaborations with sound designers than current state of the art methods, and broader adoption of transformative robot sound. Based on other successful open-source projects in the robotics community, we integrated Robot Operating System, a popular robotics middleware, and Pure Data, a visual programming language for multimedia, to enable live sound synthesis and sample playback for robots. This sound generation system synthesized sound in an in-the-wild pilot study with positive qualitative results. Furthermore, an online within-subjects survey study with N=96 showed that the proposed sound system made the robot seem warmer, happier, and more energetic. This work benefits robotics researchers by providing the current sound system as a validated artifact and demonstrating its potential impact on broader robotics applications. We plan to develop this software into an open-source package: SonifyIt. |
| doi_str_mv | 10.1109/LRA.2022.3193228 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_9837424</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9837424</ieee_id><sourcerecordid>2700416854</sourcerecordid><originalsourceid>FETCH-LOGICAL-c291t-5a956cb5c592cd7b32139c774bbe81348652127506c3a99ce00c1d0320b5588e3</originalsourceid><addsrcrecordid>eNpNkF1LwzAUhoMoOObuBW8KXneenDRN4t0YfgwKwjavQ5qm0NE1M-mU_Xs7OsSr8x543nPgIeSewpxSUE_FejFHQJwzqhiivCITZEKkTOT59b98S2Yx7gCAchRM8QnhG9819WnVPydb_2NCFZNtMF2sfdibvvl2ycYfuyoZ9mTRtsnal76Pd-SmNm10s8ucks_Xl-3yPS0-3lbLRZFaVLRPuVE8tyW3XKGtRMmQMmWFyMrSScoymXOkKDjklhmlrAOwtAKGUHIupWNT8jjePQT_dXSx1zt_DN3wUqMAyGgueTZQMFI2-BiDq_UhNHsTTpqCPvvRgx999qMvfobKw1hpnHN_uJJMZJixX9MBXk0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2700416854</pqid></control><display><type>article</type><title>SonifyIt: Towards Transformative Sound for All Robots</title><source>IEEE Electronic Library (IEL)</source><creator>Zhang, Brian J. ; Sigafoos, Noel ; Moffit, Rabecka ; Syed, Ibrahim ; Adams, Lili S. ; Fick, Jason ; Fitter, Naomi T.</creator><creatorcontrib>Zhang, Brian J. ; Sigafoos, Noel ; Moffit, Rabecka ; Syed, Ibrahim ; Adams, Lili S. ; Fick, Jason ; Fitter, Naomi T.</creatorcontrib><description>Transformative robot sound yields perceptual, functional, and social benefits in human-robot interactions, but broader research and implementation related to this topic is impeded by the lack of a common sound generation system for robots. Such a system could enable a wide array of situated robot sound studies, smoother collaborations with sound designers than current state of the art methods, and broader adoption of transformative robot sound. Based on other successful open-source projects in the robotics community, we integrated Robot Operating System, a popular robotics middleware, and Pure Data, a visual programming language for multimedia, to enable live sound synthesis and sample playback for robots. This sound generation system synthesized sound in an in-the-wild pilot study with positive qualitative results. Furthermore, an online within-subjects survey study with <inline-formula><tex-math notation="LaTeX">N=96</tex-math></inline-formula> showed that the proposed sound system made the robot seem warmer, happier, and more energetic. This work benefits robotics researchers by providing the current sound system as a validated artifact and demonstrating its potential impact on broader robotics applications. We plan to develop this software into an open-source package: SonifyIt.</description><identifier>ISSN: 2377-3766</identifier><identifier>EISSN: 2377-3766</identifier><identifier>DOI: 10.1109/LRA.2022.3193228</identifier><identifier>CODEN: IRALC6</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Audio user interfaces ; Computer languages ; human-robot interaction ; Middleware ; Multimedia ; Music ; Open source software ; Programming ; Robotics ; Robots ; Sonification ; Sound generation ; Visual programming languages ; Visualization</subject><ispartof>IEEE robotics and automation letters, 2022-10, Vol.7 (4), p.10566-10572</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c291t-5a956cb5c592cd7b32139c774bbe81348652127506c3a99ce00c1d0320b5588e3</citedby><cites>FETCH-LOGICAL-c291t-5a956cb5c592cd7b32139c774bbe81348652127506c3a99ce00c1d0320b5588e3</cites><orcidid>0000-0002-0727-7841 ; 0000-0002-6759-5948</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9837424$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9837424$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Zhang, Brian J.</creatorcontrib><creatorcontrib>Sigafoos, Noel</creatorcontrib><creatorcontrib>Moffit, Rabecka</creatorcontrib><creatorcontrib>Syed, Ibrahim</creatorcontrib><creatorcontrib>Adams, Lili S.</creatorcontrib><creatorcontrib>Fick, Jason</creatorcontrib><creatorcontrib>Fitter, Naomi T.</creatorcontrib><title>SonifyIt: Towards Transformative Sound for All Robots</title><title>IEEE robotics and automation letters</title><addtitle>LRA</addtitle><description>Transformative robot sound yields perceptual, functional, and social benefits in human-robot interactions, but broader research and implementation related to this topic is impeded by the lack of a common sound generation system for robots. Such a system could enable a wide array of situated robot sound studies, smoother collaborations with sound designers than current state of the art methods, and broader adoption of transformative robot sound. Based on other successful open-source projects in the robotics community, we integrated Robot Operating System, a popular robotics middleware, and Pure Data, a visual programming language for multimedia, to enable live sound synthesis and sample playback for robots. This sound generation system synthesized sound in an in-the-wild pilot study with positive qualitative results. Furthermore, an online within-subjects survey study with <inline-formula><tex-math notation="LaTeX">N=96</tex-math></inline-formula> showed that the proposed sound system made the robot seem warmer, happier, and more energetic. This work benefits robotics researchers by providing the current sound system as a validated artifact and demonstrating its potential impact on broader robotics applications. We plan to develop this software into an open-source package: SonifyIt.</description><subject>Audio user interfaces</subject><subject>Computer languages</subject><subject>human-robot interaction</subject><subject>Middleware</subject><subject>Multimedia</subject><subject>Music</subject><subject>Open source software</subject><subject>Programming</subject><subject>Robotics</subject><subject>Robots</subject><subject>Sonification</subject><subject>Sound generation</subject><subject>Visual programming languages</subject><subject>Visualization</subject><issn>2377-3766</issn><issn>2377-3766</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkF1LwzAUhoMoOObuBW8KXneenDRN4t0YfgwKwjavQ5qm0NE1M-mU_Xs7OsSr8x543nPgIeSewpxSUE_FejFHQJwzqhiivCITZEKkTOT59b98S2Yx7gCAchRM8QnhG9819WnVPydb_2NCFZNtMF2sfdibvvl2ycYfuyoZ9mTRtsnal76Pd-SmNm10s8ucks_Xl-3yPS0-3lbLRZFaVLRPuVE8tyW3XKGtRMmQMmWFyMrSScoymXOkKDjklhmlrAOwtAKGUHIupWNT8jjePQT_dXSx1zt_DN3wUqMAyGgueTZQMFI2-BiDq_UhNHsTTpqCPvvRgx999qMvfobKw1hpnHN_uJJMZJixX9MBXk0</recordid><startdate>20221001</startdate><enddate>20221001</enddate><creator>Zhang, Brian J.</creator><creator>Sigafoos, Noel</creator><creator>Moffit, Rabecka</creator><creator>Syed, Ibrahim</creator><creator>Adams, Lili S.</creator><creator>Fick, Jason</creator><creator>Fitter, Naomi T.</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-0727-7841</orcidid><orcidid>https://orcid.org/0000-0002-6759-5948</orcidid></search><sort><creationdate>20221001</creationdate><title>SonifyIt: Towards Transformative Sound for All Robots</title><author>Zhang, Brian J. ; Sigafoos, Noel ; Moffit, Rabecka ; Syed, Ibrahim ; Adams, Lili S. ; Fick, Jason ; Fitter, Naomi T.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c291t-5a956cb5c592cd7b32139c774bbe81348652127506c3a99ce00c1d0320b5588e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Audio user interfaces</topic><topic>Computer languages</topic><topic>human-robot interaction</topic><topic>Middleware</topic><topic>Multimedia</topic><topic>Music</topic><topic>Open source software</topic><topic>Programming</topic><topic>Robotics</topic><topic>Robots</topic><topic>Sonification</topic><topic>Sound generation</topic><topic>Visual programming languages</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Brian J.</creatorcontrib><creatorcontrib>Sigafoos, Noel</creatorcontrib><creatorcontrib>Moffit, Rabecka</creatorcontrib><creatorcontrib>Syed, Ibrahim</creatorcontrib><creatorcontrib>Adams, Lili S.</creatorcontrib><creatorcontrib>Fick, Jason</creatorcontrib><creatorcontrib>Fitter, Naomi T.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE robotics and automation letters</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhang, Brian J.</au><au>Sigafoos, Noel</au><au>Moffit, Rabecka</au><au>Syed, Ibrahim</au><au>Adams, Lili S.</au><au>Fick, Jason</au><au>Fitter, Naomi T.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>SonifyIt: Towards Transformative Sound for All Robots</atitle><jtitle>IEEE robotics and automation letters</jtitle><stitle>LRA</stitle><date>2022-10-01</date><risdate>2022</risdate><volume>7</volume><issue>4</issue><spage>10566</spage><epage>10572</epage><pages>10566-10572</pages><issn>2377-3766</issn><eissn>2377-3766</eissn><coden>IRALC6</coden><abstract>Transformative robot sound yields perceptual, functional, and social benefits in human-robot interactions, but broader research and implementation related to this topic is impeded by the lack of a common sound generation system for robots. Such a system could enable a wide array of situated robot sound studies, smoother collaborations with sound designers than current state of the art methods, and broader adoption of transformative robot sound. Based on other successful open-source projects in the robotics community, we integrated Robot Operating System, a popular robotics middleware, and Pure Data, a visual programming language for multimedia, to enable live sound synthesis and sample playback for robots. This sound generation system synthesized sound in an in-the-wild pilot study with positive qualitative results. Furthermore, an online within-subjects survey study with <inline-formula><tex-math notation="LaTeX">N=96</tex-math></inline-formula> showed that the proposed sound system made the robot seem warmer, happier, and more energetic. This work benefits robotics researchers by providing the current sound system as a validated artifact and demonstrating its potential impact on broader robotics applications. We plan to develop this software into an open-source package: SonifyIt.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/LRA.2022.3193228</doi><tpages>7</tpages><orcidid>https://orcid.org/0000-0002-0727-7841</orcidid><orcidid>https://orcid.org/0000-0002-6759-5948</orcidid></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 2377-3766 |
| ispartof | IEEE robotics and automation letters, 2022-10, Vol.7 (4), p.10566-10572 |
| issn | 2377-3766 2377-3766 |
| language | eng |
| recordid | cdi_ieee_primary_9837424 |
| source | IEEE Electronic Library (IEL) |
| subjects | Audio user interfaces Computer languages human-robot interaction Middleware Multimedia Music Open source software Programming Robotics Robots Sonification Sound generation Visual programming languages Visualization |
| title | SonifyIt: Towards Transformative Sound for All Robots |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T01%3A56%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=SonifyIt:%20Towards%20Transformative%20Sound%20for%20All%20Robots&rft.jtitle=IEEE%20robotics%20and%20automation%20letters&rft.au=Zhang,%20Brian%20J.&rft.date=2022-10-01&rft.volume=7&rft.issue=4&rft.spage=10566&rft.epage=10572&rft.pages=10566-10572&rft.issn=2377-3766&rft.eissn=2377-3766&rft.coden=IRALC6&rft_id=info:doi/10.1109/LRA.2022.3193228&rft_dat=%3Cproquest_RIE%3E2700416854%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2700416854&rft_id=info:pmid/&rft_ieee_id=9837424&rfr_iscdi=true |