Transcending Controlled Environments Assessing the Transferability of ASRRobust NLU Models to Real-World Applications

This research investigates the transferability of Automatic Speech Recognition (ASR)-robust Natural Language Understanding (NLU) models from controlled experimental conditions to practical, real-world applications. Focused on smart home automation commands in Urdu, the study assesses model performan...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Khan, Hania, Khalid, Aleena Fatima, Hassan, Zaryab
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Khan, Hania
Khalid, Aleena Fatima
Hassan, Zaryab
description This research investigates the transferability of Automatic Speech Recognition (ASR)-robust Natural Language Understanding (NLU) models from controlled experimental conditions to practical, real-world applications. Focused on smart home automation commands in Urdu, the study assesses model performance under diverse noise profiles, linguistic variations, and ASR error scenarios. Leveraging the UrduBERT model, the research employs a systematic methodology involving real-world data collection, cross-validation, transfer learning, noise variation studies, and domain adaptation. Evaluation metrics encompass task-specific accuracy, latency, user satisfaction, and robustness to ASR errors. The findings contribute insights into the challenges and adaptability of ASR-robust NLU models in transcending controlled environments.
doi_str_mv 10.48550/arxiv.2401.09354
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2401_09354</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2401_09354</sourcerecordid><originalsourceid>FETCH-LOGICAL-a674-a9c2c9c219f4d856eeab3c4223d68b21962d5a33c1c2bd9af58eb5f8cfd7a8333</originalsourceid><addsrcrecordid>eNotj81KxDAcxHPxIKsP4Mm8QGvbJN30WMr6AesKteKx_JsPDWSTkmQX9-3drR6GgWFm4IfQXVnklDNWPED4Mce8okWZFw1h9BodhgAuCuWkcV-48y4Fb62SeOOOJni3Vy5F3MaoYrw00rfCy0SrAJOxJp2w17h973s_HWLCu-0HfvVS2YiTx70Cm336YCVu59kaAcl4F2_QlQYb1e2_r9DwuBm652z79vTStdsM6jXNoBGVOKtsNJWc1UrBRAStKiJrPp3jupIMCBGlqCbZgGZcTUxzoeUaOCFkhe7_bhfucQ5mD-E0XvjHhZ_8AopyWG4</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Transcending Controlled Environments Assessing the Transferability of ASRRobust NLU Models to Real-World Applications</title><source>arXiv.org</source><creator>Khan, Hania ; Khalid, Aleena Fatima ; Hassan, Zaryab</creator><creatorcontrib>Khan, Hania ; Khalid, Aleena Fatima ; Hassan, Zaryab</creatorcontrib><description>This research investigates the transferability of Automatic Speech Recognition (ASR)-robust Natural Language Understanding (NLU) models from controlled experimental conditions to practical, real-world applications. Focused on smart home automation commands in Urdu, the study assesses model performance under diverse noise profiles, linguistic variations, and ASR error scenarios. Leveraging the UrduBERT model, the research employs a systematic methodology involving real-world data collection, cross-validation, transfer learning, noise variation studies, and domain adaptation. Evaluation metrics encompass task-specific accuracy, latency, user satisfaction, and robustness to ASR errors. The findings contribute insights into the challenges and adaptability of ASR-robust NLU models in transcending controlled environments.</description><identifier>DOI: 10.48550/arxiv.2401.09354</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Sound</subject><creationdate>2024-01</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2401.09354$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2401.09354$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Khan, Hania</creatorcontrib><creatorcontrib>Khalid, Aleena Fatima</creatorcontrib><creatorcontrib>Hassan, Zaryab</creatorcontrib><title>Transcending Controlled Environments Assessing the Transferability of ASRRobust NLU Models to Real-World Applications</title><description>This research investigates the transferability of Automatic Speech Recognition (ASR)-robust Natural Language Understanding (NLU) models from controlled experimental conditions to practical, real-world applications. Focused on smart home automation commands in Urdu, the study assesses model performance under diverse noise profiles, linguistic variations, and ASR error scenarios. Leveraging the UrduBERT model, the research employs a systematic methodology involving real-world data collection, cross-validation, transfer learning, noise variation studies, and domain adaptation. Evaluation metrics encompass task-specific accuracy, latency, user satisfaction, and robustness to ASR errors. The findings contribute insights into the challenges and adaptability of ASR-robust NLU models in transcending controlled environments.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Sound</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj81KxDAcxHPxIKsP4Mm8QGvbJN30WMr6AesKteKx_JsPDWSTkmQX9-3drR6GgWFm4IfQXVnklDNWPED4Mce8okWZFw1h9BodhgAuCuWkcV-48y4Fb62SeOOOJni3Vy5F3MaoYrw00rfCy0SrAJOxJp2w17h973s_HWLCu-0HfvVS2YiTx70Cm336YCVu59kaAcl4F2_QlQYb1e2_r9DwuBm652z79vTStdsM6jXNoBGVOKtsNJWc1UrBRAStKiJrPp3jupIMCBGlqCbZgGZcTUxzoeUaOCFkhe7_bhfucQ5mD-E0XvjHhZ_8AopyWG4</recordid><startdate>20240112</startdate><enddate>20240112</enddate><creator>Khan, Hania</creator><creator>Khalid, Aleena Fatima</creator><creator>Hassan, Zaryab</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240112</creationdate><title>Transcending Controlled Environments Assessing the Transferability of ASRRobust NLU Models to Real-World Applications</title><author>Khan, Hania ; Khalid, Aleena Fatima ; Hassan, Zaryab</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a674-a9c2c9c219f4d856eeab3c4223d68b21962d5a33c1c2bd9af58eb5f8cfd7a8333</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Sound</topic><toplevel>online_resources</toplevel><creatorcontrib>Khan, Hania</creatorcontrib><creatorcontrib>Khalid, Aleena Fatima</creatorcontrib><creatorcontrib>Hassan, Zaryab</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Khan, Hania</au><au>Khalid, Aleena Fatima</au><au>Hassan, Zaryab</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Transcending Controlled Environments Assessing the Transferability of ASRRobust NLU Models to Real-World Applications</atitle><date>2024-01-12</date><risdate>2024</risdate><abstract>This research investigates the transferability of Automatic Speech Recognition (ASR)-robust Natural Language Understanding (NLU) models from controlled experimental conditions to practical, real-world applications. Focused on smart home automation commands in Urdu, the study assesses model performance under diverse noise profiles, linguistic variations, and ASR error scenarios. Leveraging the UrduBERT model, the research employs a systematic methodology involving real-world data collection, cross-validation, transfer learning, noise variation studies, and domain adaptation. Evaluation metrics encompass task-specific accuracy, latency, user satisfaction, and robustness to ASR errors. The findings contribute insights into the challenges and adaptability of ASR-robust NLU models in transcending controlled environments.</abstract><doi>10.48550/arxiv.2401.09354</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2401.09354
ispartof
issn
language eng
recordid cdi_arxiv_primary_2401_09354
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Sound
title Transcending Controlled Environments Assessing the Transferability of ASRRobust NLU Models to Real-World Applications
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-14T14%3A16%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Transcending%20Controlled%20Environments%20Assessing%20the%20Transferability%20of%20ASRRobust%20NLU%20Models%20to%20Real-World%20Applications&rft.au=Khan,%20Hania&rft.date=2024-01-12&rft_id=info:doi/10.48550/arxiv.2401.09354&rft_dat=%3Carxiv_GOX%3E2401_09354%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true