BanglaQuAD: A Bengali Open-domain Question Answering Dataset
Bengali is the seventh most spoken language on earth, yet considered a low-resource language in the field of natural language processing (NLP). Question answering over unstructured text is a challenging NLP task as it requires understanding both question and passage. Very few researchers attempted t...
Gespeichert in:
Hauptverfasser: | , , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Bengali is the seventh most spoken language on earth, yet considered a
low-resource language in the field of natural language processing (NLP).
Question answering over unstructured text is a challenging NLP task as it
requires understanding both question and passage. Very few researchers
attempted to perform question answering over Bengali (natively pronounced as
Bangla) text. Typically, existing approaches construct the dataset by directly
translating them from English to Bengali, which produces noisy and improper
sentence structures. Furthermore, they lack topics and terminologies related to
the Bengali language and people. This paper introduces BanglaQuAD, a Bengali
question answering dataset, containing 30,808 question-answer pairs constructed
from Bengali Wikipedia articles by native speakers. Additionally, we propose an
annotation tool that facilitates question-answering dataset construction on a
local machine. A qualitative analysis demonstrates the quality of our proposed
dataset. |
---|---|
DOI: | 10.48550/arxiv.2410.10229 |