Information-Theoretic Properties of Languages and Their Grammars
This document describes means for computing a number of information-theoretic properties of languages and their grammars. For example, the entropy of a system of symbols is widely recognized as a measure of that system's complexity and organization. It is shown how the entropy of a language can...
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Format: | Report |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | |
|---|---|
| container_issue | |
| container_start_page | |
| container_title | |
| container_volume | |
| creator | MacLennan,B J |
| description | This document describes means for computing a number of information-theoretic properties of languages and their grammars. For example, the entropy of a system of symbols is widely recognized as a measure of that system's complexity and organization. It is shown how the entropy of a language can be computed in a simple way from a grammar annotated with production probabilities. The author then develops means for statistically estimating these production probabilities from measureable properties of strings in the language. He also considers the computation of other information theoretic properties of language and grammars, such as the average information born by a symbol in a language and the average information used by the productions of a grammar. (Author) |
| format | Report |
| fullrecord | <record><control><sourceid>dtic_1RU</sourceid><recordid>TN_cdi_dtic_stinet_ADA146688</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>ADA146688</sourcerecordid><originalsourceid>FETCH-dtic_stinet_ADA1466883</originalsourceid><addsrcrecordid>eNrjZHDwzEvLL8pNLMnMz9MNyUjNL0otyUxWCCjKL0gtKslMLVbIT1PwScxLL01MB3IS81IUgKoyixTcixJzcxOLinkYWNMSc4pTeaE0N4OMm2uIs4duCtCc-OKSzLzUknhHF0dDEzMzCwtjAtIA7agugQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>report</recordtype></control><display><type>report</type><title>Information-Theoretic Properties of Languages and Their Grammars</title><source>DTIC Technical Reports</source><creator>MacLennan,B J</creator><creatorcontrib>MacLennan,B J ; NAVAL POSTGRADUATE SCHOOL MONTEREY CA</creatorcontrib><description>This document describes means for computing a number of information-theoretic properties of languages and their grammars. For example, the entropy of a system of symbols is widely recognized as a measure of that system's complexity and organization. It is shown how the entropy of a language can be computed in a simple way from a grammar annotated with production probabilities. The author then develops means for statistically estimating these production probabilities from measureable properties of strings in the language. He also considers the computation of other information theoretic properties of language and grammars, such as the average information born by a symbol in a language and the average information used by the productions of a grammar. (Author)</description><language>eng</language><subject>COMPUTATIONS ; CONTEXT FREE GRAMMARS ; Cybernetics ; ENTROPY ; ESTIMATES ; GRAMMARS ; INFORMATION THEORY ; LANGUAGE ; Linguistics ; NAVAL RESEARCH ; STATISTICAL ANALYSIS ; Statistics and Probability ; Strings ; SYMBOLS</subject><creationdate>1984</creationdate><rights>APPROVED FOR PUBLIC RELEASE</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,781,886,27572,27573</link.rule.ids><linktorsrc>$$Uhttps://apps.dtic.mil/sti/citations/ADA146688$$EView_record_in_DTIC$$FView_record_in_$$GDTIC$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>MacLennan,B J</creatorcontrib><creatorcontrib>NAVAL POSTGRADUATE SCHOOL MONTEREY CA</creatorcontrib><title>Information-Theoretic Properties of Languages and Their Grammars</title><description>This document describes means for computing a number of information-theoretic properties of languages and their grammars. For example, the entropy of a system of symbols is widely recognized as a measure of that system's complexity and organization. It is shown how the entropy of a language can be computed in a simple way from a grammar annotated with production probabilities. The author then develops means for statistically estimating these production probabilities from measureable properties of strings in the language. He also considers the computation of other information theoretic properties of language and grammars, such as the average information born by a symbol in a language and the average information used by the productions of a grammar. (Author)</description><subject>COMPUTATIONS</subject><subject>CONTEXT FREE GRAMMARS</subject><subject>Cybernetics</subject><subject>ENTROPY</subject><subject>ESTIMATES</subject><subject>GRAMMARS</subject><subject>INFORMATION THEORY</subject><subject>LANGUAGE</subject><subject>Linguistics</subject><subject>NAVAL RESEARCH</subject><subject>STATISTICAL ANALYSIS</subject><subject>Statistics and Probability</subject><subject>Strings</subject><subject>SYMBOLS</subject><fulltext>true</fulltext><rsrctype>report</rsrctype><creationdate>1984</creationdate><recordtype>report</recordtype><sourceid>1RU</sourceid><recordid>eNrjZHDwzEvLL8pNLMnMz9MNyUjNL0otyUxWCCjKL0gtKslMLVbIT1PwScxLL01MB3IS81IUgKoyixTcixJzcxOLinkYWNMSc4pTeaE0N4OMm2uIs4duCtCc-OKSzLzUknhHF0dDEzMzCwtjAtIA7agugQ</recordid><startdate>198408</startdate><enddate>198408</enddate><creator>MacLennan,B J</creator><scope>1RU</scope><scope>BHM</scope></search><sort><creationdate>198408</creationdate><title>Information-Theoretic Properties of Languages and Their Grammars</title><author>MacLennan,B J</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-dtic_stinet_ADA1466883</frbrgroupid><rsrctype>reports</rsrctype><prefilter>reports</prefilter><language>eng</language><creationdate>1984</creationdate><topic>COMPUTATIONS</topic><topic>CONTEXT FREE GRAMMARS</topic><topic>Cybernetics</topic><topic>ENTROPY</topic><topic>ESTIMATES</topic><topic>GRAMMARS</topic><topic>INFORMATION THEORY</topic><topic>LANGUAGE</topic><topic>Linguistics</topic><topic>NAVAL RESEARCH</topic><topic>STATISTICAL ANALYSIS</topic><topic>Statistics and Probability</topic><topic>Strings</topic><topic>SYMBOLS</topic><toplevel>online_resources</toplevel><creatorcontrib>MacLennan,B J</creatorcontrib><creatorcontrib>NAVAL POSTGRADUATE SCHOOL MONTEREY CA</creatorcontrib><collection>DTIC Technical Reports</collection><collection>DTIC STINET</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>MacLennan,B J</au><aucorp>NAVAL POSTGRADUATE SCHOOL MONTEREY CA</aucorp><format>book</format><genre>unknown</genre><ristype>RPRT</ristype><btitle>Information-Theoretic Properties of Languages and Their Grammars</btitle><date>1984-08</date><risdate>1984</risdate><abstract>This document describes means for computing a number of information-theoretic properties of languages and their grammars. For example, the entropy of a system of symbols is widely recognized as a measure of that system's complexity and organization. It is shown how the entropy of a language can be computed in a simple way from a grammar annotated with production probabilities. The author then develops means for statistically estimating these production probabilities from measureable properties of strings in the language. He also considers the computation of other information theoretic properties of language and grammars, such as the average information born by a symbol in a language and the average information used by the productions of a grammar. (Author)</abstract><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | |
| ispartof | |
| issn | |
| language | eng |
| recordid | cdi_dtic_stinet_ADA146688 |
| source | DTIC Technical Reports |
| subjects | COMPUTATIONS CONTEXT FREE GRAMMARS Cybernetics ENTROPY ESTIMATES GRAMMARS INFORMATION THEORY LANGUAGE Linguistics NAVAL RESEARCH STATISTICAL ANALYSIS Statistics and Probability Strings SYMBOLS |
| title | Information-Theoretic Properties of Languages and Their Grammars |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-14T21%3A51%3A02IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-dtic_1RU&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=unknown&rft.btitle=Information-Theoretic%20Properties%20of%20Languages%20and%20Their%20Grammars&rft.au=MacLennan,B%20J&rft.aucorp=NAVAL%20POSTGRADUATE%20SCHOOL%20MONTEREY%20CA&rft.date=1984-08&rft_id=info:doi/&rft_dat=%3Cdtic_1RU%3EADA146688%3C/dtic_1RU%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |