Statistical patterns of word frequency suggesting the probabilistic nature of human languages

Statistical patterns of word frequency suggesting the probabilistic nature of human languages

Traditional linguistic theories have largely regard language as a formal system composed of rigid rules. However, their failures in processing real language, the recent successes in statistical natural language processing, and the findings of many psychological experiments have suggested that langua...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yu, Shuiyuan, Xu, Chunshan, Liu, Haitao
Format: Artikel
Sprache:eng
Schlagworte:
Computer Science - Computation and Language
Physics - Computational Physics
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Yu, Shuiyuan
Xu, Chunshan
Liu, Haitao
description Traditional linguistic theories have largely regard language as a formal system composed of rigid rules. However, their failures in processing real language, the recent successes in statistical natural language processing, and the findings of many psychological experiments have suggested that language may be more a probabilistic system than a formal system, and thus cannot be faithfully modeled with the either/or rules of formal linguistic theory. The present study, based on authentic language data, confirmed that those important linguistic issues, such as linguistic universal, diachronic drift, and language variations can be translated into probability and frequency patterns in parole. These findings suggest that human language may well be probabilistic systems by nature, and that statistical may well make inherent properties of human languages.
doi_str_mv 10.48550/arxiv.2012.00187
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2012_00187</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2012_00187</sourcerecordid><originalsourceid>FETCH-LOGICAL-a677-b9fa2ed994b32fcb2dab630cc15b1020f00d5848cdb6c062eb06a93b49a51a093</originalsourceid><addsrcrecordid>eNotj71OwzAURr10QC0PwIRfIOHaSZx4RBV_UiUGuqLo2rFTS6kTHBvo29OGTt9yzicdQu4Y5GVTVfCA4dd95xwYzwFYU9-Qz4-I0c3RaRzohDGa4Gc6Wvozho7aYL6S8fpE59T35oz5nsaDoVMYFSo3LCb1GFMwF-uQjujpgL5PeOY3ZGVxmM3tdddk__y0375mu_eXt-3jLkNR15mSFrnppCxVwa1WvEMlCtCaVYoBBwvQVU3Z6E4JDYIbBQJloUqJFUOQxZrc_98ufe0U3BHDqb10tktn8Qf-AVAT</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Statistical patterns of word frequency suggesting the probabilistic nature of human languages</title><source>arXiv.org</source><creator>Yu, Shuiyuan ; Xu, Chunshan ; Liu, Haitao</creator><creatorcontrib>Yu, Shuiyuan ; Xu, Chunshan ; Liu, Haitao</creatorcontrib><description>Traditional linguistic theories have largely regard language as a formal system composed of rigid rules. However, their failures in processing real language, the recent successes in statistical natural language processing, and the findings of many psychological experiments have suggested that language may be more a probabilistic system than a formal system, and thus cannot be faithfully modeled with the either/or rules of formal linguistic theory. The present study, based on authentic language data, confirmed that those important linguistic issues, such as linguistic universal, diachronic drift, and language variations can be translated into probability and frequency patterns in parole. These findings suggest that human language may well be probabilistic systems by nature, and that statistical may well make inherent properties of human languages.</description><identifier>DOI: 10.48550/arxiv.2012.00187</identifier><language>eng</language><subject>Computer Science - Computation and Language ; Physics - Computational Physics</subject><creationdate>2020-11</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2012.00187$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2012.00187$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Yu, Shuiyuan</creatorcontrib><creatorcontrib>Xu, Chunshan</creatorcontrib><creatorcontrib>Liu, Haitao</creatorcontrib><title>Statistical patterns of word frequency suggesting the probabilistic nature of human languages</title><description>Traditional linguistic theories have largely regard language as a formal system composed of rigid rules. However, their failures in processing real language, the recent successes in statistical natural language processing, and the findings of many psychological experiments have suggested that language may be more a probabilistic system than a formal system, and thus cannot be faithfully modeled with the either/or rules of formal linguistic theory. The present study, based on authentic language data, confirmed that those important linguistic issues, such as linguistic universal, diachronic drift, and language variations can be translated into probability and frequency patterns in parole. These findings suggest that human language may well be probabilistic systems by nature, and that statistical may well make inherent properties of human languages.</description><subject>Computer Science - Computation and Language</subject><subject>Physics - Computational Physics</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj71OwzAURr10QC0PwIRfIOHaSZx4RBV_UiUGuqLo2rFTS6kTHBvo29OGTt9yzicdQu4Y5GVTVfCA4dd95xwYzwFYU9-Qz4-I0c3RaRzohDGa4Gc6Wvozho7aYL6S8fpE59T35oz5nsaDoVMYFSo3LCb1GFMwF-uQjujpgL5PeOY3ZGVxmM3tdddk__y0375mu_eXt-3jLkNR15mSFrnppCxVwa1WvEMlCtCaVYoBBwvQVU3Z6E4JDYIbBQJloUqJFUOQxZrc_98ufe0U3BHDqb10tktn8Qf-AVAT</recordid><startdate>20201130</startdate><enddate>20201130</enddate><creator>Yu, Shuiyuan</creator><creator>Xu, Chunshan</creator><creator>Liu, Haitao</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20201130</creationdate><title>Statistical patterns of word frequency suggesting the probabilistic nature of human languages</title><author>Yu, Shuiyuan ; Xu, Chunshan ; Liu, Haitao</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a677-b9fa2ed994b32fcb2dab630cc15b1020f00d5848cdb6c062eb06a93b49a51a093</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Computer Science - Computation and Language</topic><topic>Physics - Computational Physics</topic><toplevel>online_resources</toplevel><creatorcontrib>Yu, Shuiyuan</creatorcontrib><creatorcontrib>Xu, Chunshan</creatorcontrib><creatorcontrib>Liu, Haitao</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Yu, Shuiyuan</au><au>Xu, Chunshan</au><au>Liu, Haitao</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Statistical patterns of word frequency suggesting the probabilistic nature of human languages</atitle><date>2020-11-30</date><risdate>2020</risdate><abstract>Traditional linguistic theories have largely regard language as a formal system composed of rigid rules. However, their failures in processing real language, the recent successes in statistical natural language processing, and the findings of many psychological experiments have suggested that language may be more a probabilistic system than a formal system, and thus cannot be faithfully modeled with the either/or rules of formal linguistic theory. The present study, based on authentic language data, confirmed that those important linguistic issues, such as linguistic universal, diachronic drift, and language variations can be translated into probability and frequency patterns in parole. These findings suggest that human language may well be probabilistic systems by nature, and that statistical may well make inherent properties of human languages.</abstract><doi>10.48550/arxiv.2012.00187</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2012.00187
ispartof
issn
language eng
recordid cdi_arxiv_primary_2012_00187
source arXiv.org
subjects Computer Science - Computation and Language
Physics - Computational Physics
title Statistical patterns of word frequency suggesting the probabilistic nature of human languages
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-13T03%3A26%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Statistical%20patterns%20of%20word%20frequency%20suggesting%20the%20probabilistic%20nature%20of%20human%20languages&rft.au=Yu,%20Shuiyuan&rft.date=2020-11-30&rft_id=info:doi/10.48550/arxiv.2012.00187&rft_dat=%3Carxiv_GOX%3E2012_00187%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true