Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian
Benford's Law states that, in many real-world data sets, the frequency of numbers' first digits is predicted by the formula log(1 + (1/d)). Numbers beginning with a 1 occur roughly 30% of the time, and are six times more common than numbers beginning with a 9. We show that Benford's L...
Gespeichert in:
| Veröffentlicht in: | PloS one 2023-09, Vol.18 (9), p.e0291337 |
|---|---|
| 1. Verfasser: | |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | |
|---|---|
| container_issue | 9 |
| container_start_page | e0291337 |
| container_title | PloS one |
| container_volume | 18 |
| creator | Golbeck, Jennifer |
| description | Benford's Law states that, in many real-world data sets, the frequency of numbers' first digits is predicted by the formula log(1 + (1/d)). Numbers beginning with a 1 occur roughly 30% of the time, and are six times more common than numbers beginning with a 9. We show that Benford's Law applies to the the frequency rank of words in English, German, French, Spanish, and Italian. We calculated the frequency rank of words in the Google Ngram Viewer corpora. Then, using the first significant digit of the frequency rank, we found the FSD distribution adhered to the expected Benford's Law distribution. Over a series of additional corpora from sources ranging from news to books to social media and across the languages studied, we consistently found adherence to Benford's Law. Furthermore, at the user-level on social media, we found Benford's Law holds for the vast majority of users' collected posts and significant deviations from Benford's Law tends to be a mark of spam bots. |
| doi_str_mv | 10.1371/journal.pone.0291337 |
| format | Article |
| fullrecord | <record><control><sourceid>gale_plos_</sourceid><recordid>TN_cdi_plos_journals_2864887743</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A765314785</galeid><doaj_id>oai_doaj_org_article_d7a7bef2ad5a4c1faafeedcee820065c</doaj_id><sourcerecordid>A765314785</sourcerecordid><originalsourceid>FETCH-LOGICAL-c619t-eea6c854cddf02750dc5731647c04206c6f4528150f49091bb296d075f16a1163</originalsourceid><addsrcrecordid>eNqNklFrFDEQxxdRsFa_geCCIAq9M8lukt0nqaWtBweFVn0Nc9nkLmcu2Sa71r75Nfx6fhJzd2vpSh8kD0lmfvOfyWSy7CVGU1xw_H7t--DATlvv1BSRGhcFf5Qd4LogE0ZQ8fje-Wn2LMY1QrSoGDvIxEfltA_N75-_Yj6Hmxza1hoV887nN8me66Cue-XkbR7AfcuNy0_d0pq4OsrPVdiAO8rPQvKn-1ULbucA1-SzDqwB9zx7osFG9WLYD7MvZ6efTz5N5hfns5Pj-UQyXHcTpYDJipayaTQinKJGUl5gVnKJSoKYZLqkpMIU6bJGNV4sSM0axKnGDDBmxWH2aq_bWh_F0JAoSMXKquK8LBIx2xONh7Vog9lAuBUejNgZfFgKCJ2RVomGA18oTaChUEqsAbRSjVSqIggxKpPWhyFbv9hsPa4LYEeiY48zK7H03wVGFGFGSFJ4OygEn_obO7ExUSprwSnf7wqnvCKEbgt__Q_68PMGagnpBSZ9akost6LimDNa4JJXNFHTB6i0GrUxMo2PNsk-Cng3CkhMp350S-hjFLOry_9nL76O2Tf32JUC262it31nvItjsNyDMvgYg9J3XcZIbKf_bzfEdvrFMP3FH1jF9yc</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2864887743</pqid></control><display><type>article</type><title>Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian</title><source>DOAJ Directory of Open Access Journals</source><source>Public Library of Science (PLoS) Journals Open Access</source><source>EZB-FREE-00999 freely available EZB journals</source><source>PubMed Central</source><source>Free Full-Text Journals in Chemistry</source><creator>Golbeck, Jennifer</creator><contributor>De Benedictis, Luca</contributor><creatorcontrib>Golbeck, Jennifer ; De Benedictis, Luca</creatorcontrib><description>Benford's Law states that, in many real-world data sets, the frequency of numbers' first digits is predicted by the formula log(1 + (1/d)). Numbers beginning with a 1 occur roughly 30% of the time, and are six times more common than numbers beginning with a 9. We show that Benford's Law applies to the the frequency rank of words in English, German, French, Spanish, and Italian. We calculated the frequency rank of words in the Google Ngram Viewer corpora. Then, using the first significant digit of the frequency rank, we found the FSD distribution adhered to the expected Benford's Law distribution. Over a series of additional corpora from sources ranging from news to books to social media and across the languages studied, we consistently found adherence to Benford's Law. Furthermore, at the user-level on social media, we found Benford's Law holds for the vast majority of users' collected posts and significant deviations from Benford's Law tends to be a mark of spam bots.</description><identifier>ISSN: 1932-6203</identifier><identifier>EISSN: 1932-6203</identifier><identifier>DOI: 10.1371/journal.pone.0291337</identifier><language>eng</language><publisher>San Francisco: Public Library of Science</publisher><subject>Analysis ; Biology and Life Sciences ; Computer and Information Sciences ; Data mining ; Datasets ; Digital media ; Evaluation ; Fraud ; Language ; Laws, regulations and rules ; People and Places ; Physical Sciences ; Social networks ; Social Sciences ; Word (Linguistics)</subject><ispartof>PloS one, 2023-09, Vol.18 (9), p.e0291337</ispartof><rights>COPYRIGHT 2023 Public Library of Science</rights><rights>2023 Jennifer Golbeck. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>Copyright: © 2023 Jennifer Golbeck. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</rights><rights>2023 Jennifer Golbeck 2023 Jennifer Golbeck</rights><rights>2023 Jennifer Golbeck. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c619t-eea6c854cddf02750dc5731647c04206c6f4528150f49091bb296d075f16a1163</cites><orcidid>0000-0003-3684-307X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC10501622/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC10501622/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,864,885,2102,2928,23866,27924,27925,53791,53793,79600,79601</link.rule.ids></links><search><contributor>De Benedictis, Luca</contributor><creatorcontrib>Golbeck, Jennifer</creatorcontrib><title>Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian</title><title>PloS one</title><description>Benford's Law states that, in many real-world data sets, the frequency of numbers' first digits is predicted by the formula log(1 + (1/d)). Numbers beginning with a 1 occur roughly 30% of the time, and are six times more common than numbers beginning with a 9. We show that Benford's Law applies to the the frequency rank of words in English, German, French, Spanish, and Italian. We calculated the frequency rank of words in the Google Ngram Viewer corpora. Then, using the first significant digit of the frequency rank, we found the FSD distribution adhered to the expected Benford's Law distribution. Over a series of additional corpora from sources ranging from news to books to social media and across the languages studied, we consistently found adherence to Benford's Law. Furthermore, at the user-level on social media, we found Benford's Law holds for the vast majority of users' collected posts and significant deviations from Benford's Law tends to be a mark of spam bots.</description><subject>Analysis</subject><subject>Biology and Life Sciences</subject><subject>Computer and Information Sciences</subject><subject>Data mining</subject><subject>Datasets</subject><subject>Digital media</subject><subject>Evaluation</subject><subject>Fraud</subject><subject>Language</subject><subject>Laws, regulations and rules</subject><subject>People and Places</subject><subject>Physical Sciences</subject><subject>Social networks</subject><subject>Social Sciences</subject><subject>Word (Linguistics)</subject><issn>1932-6203</issn><issn>1932-6203</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>DOA</sourceid><recordid>eNqNklFrFDEQxxdRsFa_geCCIAq9M8lukt0nqaWtBweFVn0Nc9nkLmcu2Sa71r75Nfx6fhJzd2vpSh8kD0lmfvOfyWSy7CVGU1xw_H7t--DATlvv1BSRGhcFf5Qd4LogE0ZQ8fje-Wn2LMY1QrSoGDvIxEfltA_N75-_Yj6Hmxza1hoV887nN8me66Cue-XkbR7AfcuNy0_d0pq4OsrPVdiAO8rPQvKn-1ULbucA1-SzDqwB9zx7osFG9WLYD7MvZ6efTz5N5hfns5Pj-UQyXHcTpYDJipayaTQinKJGUl5gVnKJSoKYZLqkpMIU6bJGNV4sSM0axKnGDDBmxWH2aq_bWh_F0JAoSMXKquK8LBIx2xONh7Vog9lAuBUejNgZfFgKCJ2RVomGA18oTaChUEqsAbRSjVSqIggxKpPWhyFbv9hsPa4LYEeiY48zK7H03wVGFGFGSFJ4OygEn_obO7ExUSprwSnf7wqnvCKEbgt__Q_68PMGagnpBSZ9akost6LimDNa4JJXNFHTB6i0GrUxMo2PNsk-Cng3CkhMp350S-hjFLOry_9nL76O2Tf32JUC262it31nvItjsNyDMvgYg9J3XcZIbKf_bzfEdvrFMP3FH1jF9yc</recordid><startdate>20230914</startdate><enddate>20230914</enddate><creator>Golbeck, Jennifer</creator><general>Public Library of Science</general><general>Public Library of Science (PLoS)</general><scope>AAYXX</scope><scope>CITATION</scope><scope>IOV</scope><scope>ISR</scope><scope>3V.</scope><scope>7QG</scope><scope>7QL</scope><scope>7QO</scope><scope>7RV</scope><scope>7SN</scope><scope>7SS</scope><scope>7T5</scope><scope>7TG</scope><scope>7TM</scope><scope>7U9</scope><scope>7X2</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>C1K</scope><scope>CCPQU</scope><scope>COVID</scope><scope>D1I</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>H94</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB.</scope><scope>KB0</scope><scope>KL.</scope><scope>L6V</scope><scope>LK8</scope><scope>M0K</scope><scope>M0S</scope><scope>M1P</scope><scope>M7N</scope><scope>M7P</scope><scope>M7S</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PATMY</scope><scope>PDBOC</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>RC3</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-3684-307X</orcidid></search><sort><creationdate>20230914</creationdate><title>Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian</title><author>Golbeck, Jennifer</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c619t-eea6c854cddf02750dc5731647c04206c6f4528150f49091bb296d075f16a1163</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Analysis</topic><topic>Biology and Life Sciences</topic><topic>Computer and Information Sciences</topic><topic>Data mining</topic><topic>Datasets</topic><topic>Digital media</topic><topic>Evaluation</topic><topic>Fraud</topic><topic>Language</topic><topic>Laws, regulations and rules</topic><topic>People and Places</topic><topic>Physical Sciences</topic><topic>Social networks</topic><topic>Social Sciences</topic><topic>Word (Linguistics)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Golbeck, Jennifer</creatorcontrib><collection>CrossRef</collection><collection>Gale In Context: Opposing Viewpoints</collection><collection>Gale In Context: Science</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Biotechnology Research Abstracts</collection><collection>Nursing & Allied Health Database</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Immunology Abstracts</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Agricultural Science Collection</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>Agricultural & Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>Coronavirus Research Database</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Materials Science Database</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Agricultural Science Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Biological Science Database</collection><collection>Engineering Database</collection><collection>Nursing & Allied Health Premium</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environmental Science Database</collection><collection>Materials Science Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection><collection>Environmental Science Collection</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>PloS one</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Golbeck, Jennifer</au><au>De Benedictis, Luca</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian</atitle><jtitle>PloS one</jtitle><date>2023-09-14</date><risdate>2023</risdate><volume>18</volume><issue>9</issue><spage>e0291337</spage><pages>e0291337-</pages><issn>1932-6203</issn><eissn>1932-6203</eissn><abstract>Benford's Law states that, in many real-world data sets, the frequency of numbers' first digits is predicted by the formula log(1 + (1/d)). Numbers beginning with a 1 occur roughly 30% of the time, and are six times more common than numbers beginning with a 9. We show that Benford's Law applies to the the frequency rank of words in English, German, French, Spanish, and Italian. We calculated the frequency rank of words in the Google Ngram Viewer corpora. Then, using the first significant digit of the frequency rank, we found the FSD distribution adhered to the expected Benford's Law distribution. Over a series of additional corpora from sources ranging from news to books to social media and across the languages studied, we consistently found adherence to Benford's Law. Furthermore, at the user-level on social media, we found Benford's Law holds for the vast majority of users' collected posts and significant deviations from Benford's Law tends to be a mark of spam bots.</abstract><cop>San Francisco</cop><pub>Public Library of Science</pub><doi>10.1371/journal.pone.0291337</doi><tpages>e0291337</tpages><orcidid>https://orcid.org/0000-0003-3684-307X</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1932-6203 |
| ispartof | PloS one, 2023-09, Vol.18 (9), p.e0291337 |
| issn | 1932-6203 1932-6203 |
| language | eng |
| recordid | cdi_plos_journals_2864887743 |
| source | DOAJ Directory of Open Access Journals; Public Library of Science (PLoS) Journals Open Access; EZB-FREE-00999 freely available EZB journals; PubMed Central; Free Full-Text Journals in Chemistry |
| subjects | Analysis Biology and Life Sciences Computer and Information Sciences Data mining Datasets Digital media Evaluation Fraud Language Laws, regulations and rules People and Places Physical Sciences Social networks Social Sciences Word (Linguistics) |
| title | Benford’s Law applies to word frequency rank in English, German, French, Spanish, and Italian |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T21%3A56%3A40IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_plos_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Benford%E2%80%99s%20Law%20applies%20to%20word%20frequency%20rank%20in%20English,%20German,%20French,%20Spanish,%20and%20Italian&rft.jtitle=PloS%20one&rft.au=Golbeck,%20Jennifer&rft.date=2023-09-14&rft.volume=18&rft.issue=9&rft.spage=e0291337&rft.pages=e0291337-&rft.issn=1932-6203&rft.eissn=1932-6203&rft_id=info:doi/10.1371/journal.pone.0291337&rft_dat=%3Cgale_plos_%3EA765314785%3C/gale_plos_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2864887743&rft_id=info:pmid/&rft_galeid=A765314785&rft_doaj_id=oai_doaj_org_article_d7a7bef2ad5a4c1faafeedcee820065c&rfr_iscdi=true |