Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences

Since 2022 we have been exploring application areas and technologies in which Artificial Intelligence (AI) and modern Natural Language Processing (NLP), such as Large Language Models (LLMs), can be employed to foster the usage and facilitate the documentation of Indigenous languages which are in dan...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Pinhanez, Claudio, Cavalin, Paulo, Storto, Luciana, Finbow, Thomas, Cobbinah, Alexander, Nogima, Julio, Vasconcelos, Marisa, Domingues, Pedro, Mizukami, Priscila de Souza, Grell, Nicole, Gongora, Majoí, Gonçalves, Isabel
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Pinhanez, Claudio
Cavalin, Paulo
Storto, Luciana
Finbow, Thomas
Cobbinah, Alexander
Nogima, Julio
Vasconcelos, Marisa
Domingues, Pedro
Mizukami, Priscila de Souza
Grell, Nicole
Gongora, Majoí
Gonçalves, Isabel
description Since 2022 we have been exploring application areas and technologies in which Artificial Intelligence (AI) and modern Natural Language Processing (NLP), such as Large Language Models (LLMs), can be employed to foster the usage and facilitate the documentation of Indigenous languages which are in danger of disappearing. We start by discussing the decreasing diversity of languages in the world and how working with Indigenous languages poses unique ethical challenges for AI and NLP. To address those challenges, we propose an alternative development AI cycle based on community engagement and usage. Then, we report encouraging results in the development of high-quality machine learning translators for Indigenous languages by fine-tuning state-of-the-art (SOTA) translators with tiny amounts of data and discuss how to avoid some common pitfalls in the process. We also present prototypes we have built in projects done in 2023 and 2024 with Indigenous communities in Brazil, aimed at facilitating writing, and discuss the development of Indigenous Language Models (ILMs) as a replicable and scalable way to create spell-checkers, next-word predictors, and similar tools. Finally, we discuss how we envision a future for language documentation where dying languages are preserved as interactive language models.
doi_str_mv 10.48550/arxiv.2407.12620
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2407_12620</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2407_12620</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2407_126203</originalsourceid><addsrcrecordid>eNqFjr0KwjAURrM4iPoATt4XsNb6i5tIpYKDg7iWS3ubXohJSVJtfXqtuDt98HE4HCHG8zBYblercIa24UcQLcNNMI_WUdgXbYJWk3OsJfiS4GKeZMEUsLeeC84YFZy0J6VYks4IvIEbe1T8Ioh1jlqSpfzD5B1gagfnz1ejJLeDK2WlNspIJgeoc4ibiix3IjcUvQKVo9FvB2JyjK-HZPqNTCvLd7Rt2sWm39jFf-INOZdMJQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences</title><source>arXiv.org</source><creator>Pinhanez, Claudio ; Cavalin, Paulo ; Storto, Luciana ; Finbow, Thomas ; Cobbinah, Alexander ; Nogima, Julio ; Vasconcelos, Marisa ; Domingues, Pedro ; Mizukami, Priscila de Souza ; Grell, Nicole ; Gongora, Majoí ; Gonçalves, Isabel</creator><creatorcontrib>Pinhanez, Claudio ; Cavalin, Paulo ; Storto, Luciana ; Finbow, Thomas ; Cobbinah, Alexander ; Nogima, Julio ; Vasconcelos, Marisa ; Domingues, Pedro ; Mizukami, Priscila de Souza ; Grell, Nicole ; Gongora, Majoí ; Gonçalves, Isabel</creatorcontrib><description>Since 2022 we have been exploring application areas and technologies in which Artificial Intelligence (AI) and modern Natural Language Processing (NLP), such as Large Language Models (LLMs), can be employed to foster the usage and facilitate the documentation of Indigenous languages which are in danger of disappearing. We start by discussing the decreasing diversity of languages in the world and how working with Indigenous languages poses unique ethical challenges for AI and NLP. To address those challenges, we propose an alternative development AI cycle based on community engagement and usage. Then, we report encouraging results in the development of high-quality machine learning translators for Indigenous languages by fine-tuning state-of-the-art (SOTA) translators with tiny amounts of data and discuss how to avoid some common pitfalls in the process. We also present prototypes we have built in projects done in 2023 and 2024 with Indigenous communities in Brazil, aimed at facilitating writing, and discuss the development of Indigenous Language Models (ILMs) as a replicable and scalable way to create spell-checkers, next-word predictors, and similar tools. Finally, we discuss how we envision a future for language documentation where dying languages are preserved as interactive language models.</description><identifier>DOI: 10.48550/arxiv.2407.12620</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computation and Language</subject><creationdate>2024-07</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,781,886</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2407.12620$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2407.12620$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Pinhanez, Claudio</creatorcontrib><creatorcontrib>Cavalin, Paulo</creatorcontrib><creatorcontrib>Storto, Luciana</creatorcontrib><creatorcontrib>Finbow, Thomas</creatorcontrib><creatorcontrib>Cobbinah, Alexander</creatorcontrib><creatorcontrib>Nogima, Julio</creatorcontrib><creatorcontrib>Vasconcelos, Marisa</creatorcontrib><creatorcontrib>Domingues, Pedro</creatorcontrib><creatorcontrib>Mizukami, Priscila de Souza</creatorcontrib><creatorcontrib>Grell, Nicole</creatorcontrib><creatorcontrib>Gongora, Majoí</creatorcontrib><creatorcontrib>Gonçalves, Isabel</creatorcontrib><title>Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences</title><description>Since 2022 we have been exploring application areas and technologies in which Artificial Intelligence (AI) and modern Natural Language Processing (NLP), such as Large Language Models (LLMs), can be employed to foster the usage and facilitate the documentation of Indigenous languages which are in danger of disappearing. We start by discussing the decreasing diversity of languages in the world and how working with Indigenous languages poses unique ethical challenges for AI and NLP. To address those challenges, we propose an alternative development AI cycle based on community engagement and usage. Then, we report encouraging results in the development of high-quality machine learning translators for Indigenous languages by fine-tuning state-of-the-art (SOTA) translators with tiny amounts of data and discuss how to avoid some common pitfalls in the process. We also present prototypes we have built in projects done in 2023 and 2024 with Indigenous communities in Brazil, aimed at facilitating writing, and discuss the development of Indigenous Language Models (ILMs) as a replicable and scalable way to create spell-checkers, next-word predictors, and similar tools. Finally, we discuss how we envision a future for language documentation where dying languages are preserved as interactive language models.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computation and Language</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFjr0KwjAURrM4iPoATt4XsNb6i5tIpYKDg7iWS3ubXohJSVJtfXqtuDt98HE4HCHG8zBYblercIa24UcQLcNNMI_WUdgXbYJWk3OsJfiS4GKeZMEUsLeeC84YFZy0J6VYks4IvIEbe1T8Ioh1jlqSpfzD5B1gagfnz1ejJLeDK2WlNspIJgeoc4ibiix3IjcUvQKVo9FvB2JyjK-HZPqNTCvLd7Rt2sWm39jFf-INOZdMJQ</recordid><startdate>20240717</startdate><enddate>20240717</enddate><creator>Pinhanez, Claudio</creator><creator>Cavalin, Paulo</creator><creator>Storto, Luciana</creator><creator>Finbow, Thomas</creator><creator>Cobbinah, Alexander</creator><creator>Nogima, Julio</creator><creator>Vasconcelos, Marisa</creator><creator>Domingues, Pedro</creator><creator>Mizukami, Priscila de Souza</creator><creator>Grell, Nicole</creator><creator>Gongora, Majoí</creator><creator>Gonçalves, Isabel</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240717</creationdate><title>Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences</title><author>Pinhanez, Claudio ; Cavalin, Paulo ; Storto, Luciana ; Finbow, Thomas ; Cobbinah, Alexander ; Nogima, Julio ; Vasconcelos, Marisa ; Domingues, Pedro ; Mizukami, Priscila de Souza ; Grell, Nicole ; Gongora, Majoí ; Gonçalves, Isabel</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2407_126203</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computation and Language</topic><toplevel>online_resources</toplevel><creatorcontrib>Pinhanez, Claudio</creatorcontrib><creatorcontrib>Cavalin, Paulo</creatorcontrib><creatorcontrib>Storto, Luciana</creatorcontrib><creatorcontrib>Finbow, Thomas</creatorcontrib><creatorcontrib>Cobbinah, Alexander</creatorcontrib><creatorcontrib>Nogima, Julio</creatorcontrib><creatorcontrib>Vasconcelos, Marisa</creatorcontrib><creatorcontrib>Domingues, Pedro</creatorcontrib><creatorcontrib>Mizukami, Priscila de Souza</creatorcontrib><creatorcontrib>Grell, Nicole</creatorcontrib><creatorcontrib>Gongora, Majoí</creatorcontrib><creatorcontrib>Gonçalves, Isabel</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Pinhanez, Claudio</au><au>Cavalin, Paulo</au><au>Storto, Luciana</au><au>Finbow, Thomas</au><au>Cobbinah, Alexander</au><au>Nogima, Julio</au><au>Vasconcelos, Marisa</au><au>Domingues, Pedro</au><au>Mizukami, Priscila de Souza</au><au>Grell, Nicole</au><au>Gongora, Majoí</au><au>Gonçalves, Isabel</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences</atitle><date>2024-07-17</date><risdate>2024</risdate><abstract>Since 2022 we have been exploring application areas and technologies in which Artificial Intelligence (AI) and modern Natural Language Processing (NLP), such as Large Language Models (LLMs), can be employed to foster the usage and facilitate the documentation of Indigenous languages which are in danger of disappearing. We start by discussing the decreasing diversity of languages in the world and how working with Indigenous languages poses unique ethical challenges for AI and NLP. To address those challenges, we propose an alternative development AI cycle based on community engagement and usage. Then, we report encouraging results in the development of high-quality machine learning translators for Indigenous languages by fine-tuning state-of-the-art (SOTA) translators with tiny amounts of data and discuss how to avoid some common pitfalls in the process. We also present prototypes we have built in projects done in 2023 and 2024 with Indigenous communities in Brazil, aimed at facilitating writing, and discuss the development of Indigenous Language Models (ILMs) as a replicable and scalable way to create spell-checkers, next-word predictors, and similar tools. Finally, we discuss how we envision a future for language documentation where dying languages are preserved as interactive language models.</abstract><doi>10.48550/arxiv.2407.12620</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2407.12620
ispartof
issn
language eng
recordid cdi_arxiv_primary_2407_12620
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Computation and Language
title Harnessing the Power of Artificial Intelligence to Vitalize Endangered Indigenous Languages: Technologies and Experiences
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-13T16%3A40%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Harnessing%20the%20Power%20of%20Artificial%20Intelligence%20to%20Vitalize%20Endangered%20Indigenous%20Languages:%20Technologies%20and%20Experiences&rft.au=Pinhanez,%20Claudio&rft.date=2024-07-17&rft_id=info:doi/10.48550/arxiv.2407.12620&rft_dat=%3Carxiv_GOX%3E2407_12620%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true