Speech rhythm analysis with decomposition of the amplitude envelope: characterizing rhythmic patterns within and across languages
This study presents a method for analyzing speech rhythm using empirical mode decomposition of the speech amplitude envelope, which allows for extraction and quantification of syllabic- and supra-syllabic time-scale components of the envelope. The method of empirical mode decomposition of a vocalic...
Gespeichert in:
Veröffentlicht in: | The Journal of the Acoustical Society of America 2013-07, Vol.134 (1), p.628-639 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 639 |
---|---|
container_issue | 1 |
container_start_page | 628 |
container_title | The Journal of the Acoustical Society of America |
container_volume | 134 |
creator | Tilsen, Sam Arvaniti, Amalia |
description | This study presents a method for analyzing speech rhythm using empirical mode decomposition of the speech amplitude envelope, which allows for extraction and quantification of syllabic- and supra-syllabic time-scale components of the envelope. The method of empirical mode decomposition of a vocalic energy amplitude envelope is illustrated in detail, and several types of rhythm metrics derived from this method are presented. Spontaneous speech extracted from the Buckeye Corpus is used to assess the effect of utterance length on metrics, and it is shown how metrics representing variability in the supra-syllabic time-scale components of the envelope can be used to identify stretches of speech with targeted rhythmic characteristics. Furthermore, the envelope-based metrics are used to characterize cross-linguistic differences in speech rhythm in the UC San Diego Speech Lab corpus of English, German, Greek, Italian, Korean, and Spanish speech elicited in read sentences, read passages, and spontaneous speech. The envelope-based metrics exhibit significant effects of language and elicitation method that argue for a nuanced view of cross-linguistic rhythm patterns. |
doi_str_mv | 10.1121/1.4807565 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1406175810</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1406175810</sourcerecordid><originalsourceid>FETCH-LOGICAL-c320t-c9bb657e16608ab23fcadb616d5393db494ad3283381d9c84d8ca2ca604df9703</originalsourceid><addsrcrecordid>eNo9kMtOwzAQRS0EoqWw4AeQl7AI-BE7DjtU8ZIqsQDWkWNPGqO8iB1Q2fHnpDSwGs3o6OjOReiUkktKGb2il7EiiZBiD82pYCRSgsX7aE4IoVGcSjlDR96_jatQPD1EM8aVZIonc_T93AGYEvflJpQ11o2uNt55_OlCiS2Ytu5a74JrG9wWOJSAdd1VLgwWMDQfULUdXGNT6l6bAL37cs16kjmDOx3GY7PTuWbUW6xN33qPK92sB70Gf4wOCl15OJnmAr3e3b4sH6LV0_3j8mYVGc5IiEya51IkQKUkSueMF0bbXFJpBU-5zeM01paPT3FFbWpUbJXRzGhJYlukCeELdL7zdn37PoAPWe28gWoMAu3gMxoTSROh6Ba92KG_UXsosq53te43GSXZtvGMZlPjI3s2aYe8BvtP_lXMfwDAVn4h</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1406175810</pqid></control><display><type>article</type><title>Speech rhythm analysis with decomposition of the amplitude envelope: characterizing rhythmic patterns within and across languages</title><source>MEDLINE</source><source>AIP Journals Complete</source><source>Acoustical Society of America (AIP)</source><source>Alma/SFX Local Collection</source><creator>Tilsen, Sam ; Arvaniti, Amalia</creator><creatorcontrib>Tilsen, Sam ; Arvaniti, Amalia</creatorcontrib><description>This study presents a method for analyzing speech rhythm using empirical mode decomposition of the speech amplitude envelope, which allows for extraction and quantification of syllabic- and supra-syllabic time-scale components of the envelope. The method of empirical mode decomposition of a vocalic energy amplitude envelope is illustrated in detail, and several types of rhythm metrics derived from this method are presented. Spontaneous speech extracted from the Buckeye Corpus is used to assess the effect of utterance length on metrics, and it is shown how metrics representing variability in the supra-syllabic time-scale components of the envelope can be used to identify stretches of speech with targeted rhythmic characteristics. Furthermore, the envelope-based metrics are used to characterize cross-linguistic differences in speech rhythm in the UC San Diego Speech Lab corpus of English, German, Greek, Italian, Korean, and Spanish speech elicited in read sentences, read passages, and spontaneous speech. The envelope-based metrics exhibit significant effects of language and elicitation method that argue for a nuanced view of cross-linguistic rhythm patterns.</description><identifier>ISSN: 0001-4966</identifier><identifier>EISSN: 1520-8524</identifier><identifier>DOI: 10.1121/1.4807565</identifier><identifier>PMID: 23862837</identifier><language>eng</language><publisher>United States</publisher><subject>Humans ; Language ; Phonation ; Semantics ; Signal Processing, Computer-Assisted ; Sound Spectrography - methods ; Speech Acoustics</subject><ispartof>The Journal of the Acoustical Society of America, 2013-07, Vol.134 (1), p.628-639</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c320t-c9bb657e16608ab23fcadb616d5393db494ad3283381d9c84d8ca2ca604df9703</citedby><cites>FETCH-LOGICAL-c320t-c9bb657e16608ab23fcadb616d5393db494ad3283381d9c84d8ca2ca604df9703</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>207,208,314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/23862837$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Tilsen, Sam</creatorcontrib><creatorcontrib>Arvaniti, Amalia</creatorcontrib><title>Speech rhythm analysis with decomposition of the amplitude envelope: characterizing rhythmic patterns within and across languages</title><title>The Journal of the Acoustical Society of America</title><addtitle>J Acoust Soc Am</addtitle><description>This study presents a method for analyzing speech rhythm using empirical mode decomposition of the speech amplitude envelope, which allows for extraction and quantification of syllabic- and supra-syllabic time-scale components of the envelope. The method of empirical mode decomposition of a vocalic energy amplitude envelope is illustrated in detail, and several types of rhythm metrics derived from this method are presented. Spontaneous speech extracted from the Buckeye Corpus is used to assess the effect of utterance length on metrics, and it is shown how metrics representing variability in the supra-syllabic time-scale components of the envelope can be used to identify stretches of speech with targeted rhythmic characteristics. Furthermore, the envelope-based metrics are used to characterize cross-linguistic differences in speech rhythm in the UC San Diego Speech Lab corpus of English, German, Greek, Italian, Korean, and Spanish speech elicited in read sentences, read passages, and spontaneous speech. The envelope-based metrics exhibit significant effects of language and elicitation method that argue for a nuanced view of cross-linguistic rhythm patterns.</description><subject>Humans</subject><subject>Language</subject><subject>Phonation</subject><subject>Semantics</subject><subject>Signal Processing, Computer-Assisted</subject><subject>Sound Spectrography - methods</subject><subject>Speech Acoustics</subject><issn>0001-4966</issn><issn>1520-8524</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNo9kMtOwzAQRS0EoqWw4AeQl7AI-BE7DjtU8ZIqsQDWkWNPGqO8iB1Q2fHnpDSwGs3o6OjOReiUkktKGb2il7EiiZBiD82pYCRSgsX7aE4IoVGcSjlDR96_jatQPD1EM8aVZIonc_T93AGYEvflJpQ11o2uNt55_OlCiS2Ytu5a74JrG9wWOJSAdd1VLgwWMDQfULUdXGNT6l6bAL37cs16kjmDOx3GY7PTuWbUW6xN33qPK92sB70Gf4wOCl15OJnmAr3e3b4sH6LV0_3j8mYVGc5IiEya51IkQKUkSueMF0bbXFJpBU-5zeM01paPT3FFbWpUbJXRzGhJYlukCeELdL7zdn37PoAPWe28gWoMAu3gMxoTSROh6Ba92KG_UXsosq53te43GSXZtvGMZlPjI3s2aYe8BvtP_lXMfwDAVn4h</recordid><startdate>201307</startdate><enddate>201307</enddate><creator>Tilsen, Sam</creator><creator>Arvaniti, Amalia</creator><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>201307</creationdate><title>Speech rhythm analysis with decomposition of the amplitude envelope: characterizing rhythmic patterns within and across languages</title><author>Tilsen, Sam ; Arvaniti, Amalia</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c320t-c9bb657e16608ab23fcadb616d5393db494ad3283381d9c84d8ca2ca604df9703</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Humans</topic><topic>Language</topic><topic>Phonation</topic><topic>Semantics</topic><topic>Signal Processing, Computer-Assisted</topic><topic>Sound Spectrography - methods</topic><topic>Speech Acoustics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Tilsen, Sam</creatorcontrib><creatorcontrib>Arvaniti, Amalia</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>The Journal of the Acoustical Society of America</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Tilsen, Sam</au><au>Arvaniti, Amalia</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Speech rhythm analysis with decomposition of the amplitude envelope: characterizing rhythmic patterns within and across languages</atitle><jtitle>The Journal of the Acoustical Society of America</jtitle><addtitle>J Acoust Soc Am</addtitle><date>2013-07</date><risdate>2013</risdate><volume>134</volume><issue>1</issue><spage>628</spage><epage>639</epage><pages>628-639</pages><issn>0001-4966</issn><eissn>1520-8524</eissn><abstract>This study presents a method for analyzing speech rhythm using empirical mode decomposition of the speech amplitude envelope, which allows for extraction and quantification of syllabic- and supra-syllabic time-scale components of the envelope. The method of empirical mode decomposition of a vocalic energy amplitude envelope is illustrated in detail, and several types of rhythm metrics derived from this method are presented. Spontaneous speech extracted from the Buckeye Corpus is used to assess the effect of utterance length on metrics, and it is shown how metrics representing variability in the supra-syllabic time-scale components of the envelope can be used to identify stretches of speech with targeted rhythmic characteristics. Furthermore, the envelope-based metrics are used to characterize cross-linguistic differences in speech rhythm in the UC San Diego Speech Lab corpus of English, German, Greek, Italian, Korean, and Spanish speech elicited in read sentences, read passages, and spontaneous speech. The envelope-based metrics exhibit significant effects of language and elicitation method that argue for a nuanced view of cross-linguistic rhythm patterns.</abstract><cop>United States</cop><pmid>23862837</pmid><doi>10.1121/1.4807565</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0001-4966 |
ispartof | The Journal of the Acoustical Society of America, 2013-07, Vol.134 (1), p.628-639 |
issn | 0001-4966 1520-8524 |
language | eng |
recordid | cdi_proquest_miscellaneous_1406175810 |
source | MEDLINE; AIP Journals Complete; Acoustical Society of America (AIP); Alma/SFX Local Collection |
subjects | Humans Language Phonation Semantics Signal Processing, Computer-Assisted Sound Spectrography - methods Speech Acoustics |
title | Speech rhythm analysis with decomposition of the amplitude envelope: characterizing rhythmic patterns within and across languages |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-24T03%3A35%3A40IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Speech%20rhythm%20analysis%20with%20decomposition%20of%20the%20amplitude%20envelope:%20characterizing%20rhythmic%20patterns%20within%20and%20across%20languages&rft.jtitle=The%20Journal%20of%20the%20Acoustical%20Society%20of%20America&rft.au=Tilsen,%20Sam&rft.date=2013-07&rft.volume=134&rft.issue=1&rft.spage=628&rft.epage=639&rft.pages=628-639&rft.issn=0001-4966&rft.eissn=1520-8524&rft_id=info:doi/10.1121/1.4807565&rft_dat=%3Cproquest_cross%3E1406175810%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1406175810&rft_id=info:pmid/23862837&rfr_iscdi=true |