Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard
This paper presents a performance comparison of three large language models (LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat (BingChat), and Google Bard, on the VNHSGE English dataset. The performance of BingChat, Bard, and ChatGPT (GPT-3.5) is 92.4\%, 86\%, and 79.2\%, respectively. The results s...
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | |
|---|---|
| container_issue | |
| container_start_page | |
| container_title | |
| container_volume | |
| creator | Dao, Xuan-Quy |
| description | This paper presents a performance comparison of three large language models
(LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat (BingChat), and Google Bard,
on the VNHSGE English dataset. The performance of BingChat, Bard, and ChatGPT
(GPT-3.5) is 92.4\%, 86\%, and 79.2\%, respectively. The results show that
BingChat is better than ChatGPT and Bard. Therefore, BingChat and Bard can
replace ChatGPT while ChatGPT is not yet officially available in Vietnam. The
results also indicate that BingChat, Bard and ChatGPT outperform Vietnamese
students in English language proficiency. The findings of this study contribute
to the understanding of the potential of LLMs in English language education.
The remarkable performance of ChatGPT, BingChat, and Bard demonstrates their
potential as effective tools for teaching and learning English at the high
school level. |
| doi_str_mv | 10.48550/arxiv.2307.02288 |
| format | Article |
| fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2307_02288</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2307_02288</sourcerecordid><originalsourceid>FETCH-LOGICAL-a1158-b7e773dcae6b360051e8c65b3000e91cb2df2653719b810991a172c1823ad1163</originalsourceid><addsrcrecordid>eNotkM9Og0AYxLl4MNUH8OT3AAX3j8su3lpE2oTaJlav5AMWSgK7ZEGjJ1_dil5mJjPJHH6ed0NJcK-EIHfoPtuPgHEiA8KYUpfe90G72roeTakhtv2Arh2tAVtDhq7RZzXNO57Dzla6G-G8vT1vXtIEEtN07XiCR5xw1NMD7AdtVluITzilh-MSdm3p7GjrCdataeZ-CWgqSK1tOg1rdNWVd1FjN-rrf194r0_JMd742T7dxqvMR0qF8guppeRViToseEiIoFqVoSg4IURHtCxYVbNQcEmjQlESRRSpZCVVjGNFacgX3u3f74wgH1zbo_vKf1HkMwr-AwpsV2M</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard</title><source>arXiv.org</source><creator>Dao, Xuan-Quy</creator><creatorcontrib>Dao, Xuan-Quy</creatorcontrib><description>This paper presents a performance comparison of three large language models
(LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat (BingChat), and Google Bard,
on the VNHSGE English dataset. The performance of BingChat, Bard, and ChatGPT
(GPT-3.5) is 92.4\%, 86\%, and 79.2\%, respectively. The results show that
BingChat is better than ChatGPT and Bard. Therefore, BingChat and Bard can
replace ChatGPT while ChatGPT is not yet officially available in Vietnam. The
results also indicate that BingChat, Bard and ChatGPT outperform Vietnamese
students in English language proficiency. The findings of this study contribute
to the understanding of the potential of LLMs in English language education.
The remarkable performance of ChatGPT, BingChat, and Bard demonstrates their
potential as effective tools for teaching and learning English at the high
school level.</description><identifier>DOI: 10.48550/arxiv.2307.02288</identifier><language>eng</language><subject>Computer Science - Computation and Language ; Computer Science - Human-Computer Interaction</subject><creationdate>2023-07</creationdate><rights>http://creativecommons.org/licenses/by-nc-sa/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a1158-b7e773dcae6b360051e8c65b3000e91cb2df2653719b810991a172c1823ad1163</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2307.02288$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2307.02288$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Dao, Xuan-Quy</creatorcontrib><title>Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard</title><description>This paper presents a performance comparison of three large language models
(LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat (BingChat), and Google Bard,
on the VNHSGE English dataset. The performance of BingChat, Bard, and ChatGPT
(GPT-3.5) is 92.4\%, 86\%, and 79.2\%, respectively. The results show that
BingChat is better than ChatGPT and Bard. Therefore, BingChat and Bard can
replace ChatGPT while ChatGPT is not yet officially available in Vietnam. The
results also indicate that BingChat, Bard and ChatGPT outperform Vietnamese
students in English language proficiency. The findings of this study contribute
to the understanding of the potential of LLMs in English language education.
The remarkable performance of ChatGPT, BingChat, and Bard demonstrates their
potential as effective tools for teaching and learning English at the high
school level.</description><subject>Computer Science - Computation and Language</subject><subject>Computer Science - Human-Computer Interaction</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotkM9Og0AYxLl4MNUH8OT3AAX3j8su3lpE2oTaJlav5AMWSgK7ZEGjJ1_dil5mJjPJHH6ed0NJcK-EIHfoPtuPgHEiA8KYUpfe90G72roeTakhtv2Arh2tAVtDhq7RZzXNO57Dzla6G-G8vT1vXtIEEtN07XiCR5xw1NMD7AdtVluITzilh-MSdm3p7GjrCdataeZ-CWgqSK1tOg1rdNWVd1FjN-rrf194r0_JMd742T7dxqvMR0qF8guppeRViToseEiIoFqVoSg4IURHtCxYVbNQcEmjQlESRRSpZCVVjGNFacgX3u3f74wgH1zbo_vKf1HkMwr-AwpsV2M</recordid><startdate>20230705</startdate><enddate>20230705</enddate><creator>Dao, Xuan-Quy</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20230705</creationdate><title>Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard</title><author>Dao, Xuan-Quy</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a1158-b7e773dcae6b360051e8c65b3000e91cb2df2653719b810991a172c1823ad1163</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Computation and Language</topic><topic>Computer Science - Human-Computer Interaction</topic><toplevel>online_resources</toplevel><creatorcontrib>Dao, Xuan-Quy</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Dao, Xuan-Quy</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard</atitle><date>2023-07-05</date><risdate>2023</risdate><abstract>This paper presents a performance comparison of three large language models
(LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat (BingChat), and Google Bard,
on the VNHSGE English dataset. The performance of BingChat, Bard, and ChatGPT
(GPT-3.5) is 92.4\%, 86\%, and 79.2\%, respectively. The results show that
BingChat is better than ChatGPT and Bard. Therefore, BingChat and Bard can
replace ChatGPT while ChatGPT is not yet officially available in Vietnam. The
results also indicate that BingChat, Bard and ChatGPT outperform Vietnamese
students in English language proficiency. The findings of this study contribute
to the understanding of the potential of LLMs in English language education.
The remarkable performance of ChatGPT, BingChat, and Bard demonstrates their
potential as effective tools for teaching and learning English at the high
school level.</abstract><doi>10.48550/arxiv.2307.02288</doi><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | DOI: 10.48550/arxiv.2307.02288 |
| ispartof | |
| issn | |
| language | eng |
| recordid | cdi_arxiv_primary_2307_02288 |
| source | arXiv.org |
| subjects | Computer Science - Computation and Language Computer Science - Human-Computer Interaction |
| title | Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T06%3A59%3A07IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Performance%20Comparison%20of%20Large%20Language%20Models%20on%20VNHSGE%20English%20Dataset:%20OpenAI%20ChatGPT,%20Microsoft%20Bing%20Chat,%20and%20Google%20Bard&rft.au=Dao,%20Xuan-Quy&rft.date=2023-07-05&rft_id=info:doi/10.48550/arxiv.2307.02288&rft_dat=%3Carxiv_GOX%3E2307_02288%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |