Entropy analysis of estimating systems
A study of the use of entropy as a criterion function for analyzing the performance of sampled-data estimating systems is presented, and performance bounds are obtained for a broad class of such systems. The general result is that the difference between the entropy of the signal to be estimated and...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on information theory 1970-05, Vol.16 (3), p.264-270 |
|---|---|
| Hauptverfasser: | , |
| Format: | Artikel |
| Sprache: | eng |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 270 |
|---|---|
| container_issue | 3 |
| container_start_page | 264 |
| container_title | IEEE transactions on information theory |
| container_volume | 16 |
| creator | Weidemann, H. Stear, E. |
| description | A study of the use of entropy as a criterion function for analyzing the performance of sampled-data estimating systems is presented, and performance bounds are obtained for a broad class of such systems. The general result is that the difference between the entropy of the signal to be estimated and the entropy of its estimate based on the output of a noisy sensor can never be larger than the mutual information between the sensor input and output. An interesting, but not totally satisfactory, sufficient condition for attainment of the bound is developed. |
| doi_str_mv | 10.1109/TIT.1970.1054444 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_1054444</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>1054444</ieee_id><sourcerecordid>28476511</sourcerecordid><originalsourceid>FETCH-LOGICAL-c292t-35381fb672ba65276deeafc154699d53827b4e6d674e577cbf60c6221e41023c3</originalsourceid><addsrcrecordid>eNpNkM1Lw0AQxRdRsFbvgpecekvd2exH9iil1kLBSz0vm-1EIvkykx7y37slPTiXYXjvDY8fY8_A1wDcvh73xzVYEy-uZJwbtgClTGq1krdswTnkqZUyv2cPRD_xlArEgq227Th0_ZT41tcTVZR0ZYI0Vo0fq_Y7oYlGbOiR3ZW-Jny67iX7et8eNx_p4XO337wd0iCsGNNMZTmUhTai8FoJo0-IvgygpLb2FEVhCon6pI1EZUwoSs2DFgJQAhdZyJZsNf_th-73HHu4pqKAde1b7M7kRC6NVgDRyGdjGDqiAUvXD7HzMDng7gLERSDuAsRdgcTIyxypEPGffVb_ALxSWvM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>28476511</pqid></control><display><type>article</type><title>Entropy analysis of estimating systems</title><source>IEEE Electronic Library (IEL)</source><creator>Weidemann, H. ; Stear, E.</creator><creatorcontrib>Weidemann, H. ; Stear, E.</creatorcontrib><description>A study of the use of entropy as a criterion function for analyzing the performance of sampled-data estimating systems is presented, and performance bounds are obtained for a broad class of such systems. The general result is that the difference between the entropy of the signal to be estimated and the entropy of its estimate based on the output of a noisy sensor can never be larger than the mutual information between the sensor input and output. An interesting, but not totally satisfactory, sufficient condition for attainment of the bound is developed.</description><identifier>ISSN: 0018-9448</identifier><identifier>EISSN: 1557-9654</identifier><identifier>DOI: 10.1109/TIT.1970.1054444</identifier><identifier>CODEN: IETTAW</identifier><language>eng</language><publisher>IEEE</publisher><ispartof>IEEE transactions on information theory, 1970-05, Vol.16 (3), p.264-270</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c292t-35381fb672ba65276deeafc154699d53827b4e6d674e577cbf60c6221e41023c3</citedby><cites>FETCH-LOGICAL-c292t-35381fb672ba65276deeafc154699d53827b4e6d674e577cbf60c6221e41023c3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/1054444$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54737</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/1054444$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Weidemann, H.</creatorcontrib><creatorcontrib>Stear, E.</creatorcontrib><title>Entropy analysis of estimating systems</title><title>IEEE transactions on information theory</title><addtitle>TIT</addtitle><description>A study of the use of entropy as a criterion function for analyzing the performance of sampled-data estimating systems is presented, and performance bounds are obtained for a broad class of such systems. The general result is that the difference between the entropy of the signal to be estimated and the entropy of its estimate based on the output of a noisy sensor can never be larger than the mutual information between the sensor input and output. An interesting, but not totally satisfactory, sufficient condition for attainment of the bound is developed.</description><issn>0018-9448</issn><issn>1557-9654</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>1970</creationdate><recordtype>article</recordtype><recordid>eNpNkM1Lw0AQxRdRsFbvgpecekvd2exH9iil1kLBSz0vm-1EIvkykx7y37slPTiXYXjvDY8fY8_A1wDcvh73xzVYEy-uZJwbtgClTGq1krdswTnkqZUyv2cPRD_xlArEgq227Th0_ZT41tcTVZR0ZYI0Vo0fq_Y7oYlGbOiR3ZW-Jny67iX7et8eNx_p4XO337wd0iCsGNNMZTmUhTai8FoJo0-IvgygpLb2FEVhCon6pI1EZUwoSs2DFgJQAhdZyJZsNf_th-73HHu4pqKAde1b7M7kRC6NVgDRyGdjGDqiAUvXD7HzMDng7gLERSDuAsRdgcTIyxypEPGffVb_ALxSWvM</recordid><startdate>19700501</startdate><enddate>19700501</enddate><creator>Weidemann, H.</creator><creator>Stear, E.</creator><general>IEEE</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>19700501</creationdate><title>Entropy analysis of estimating systems</title><author>Weidemann, H. ; Stear, E.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c292t-35381fb672ba65276deeafc154699d53827b4e6d674e577cbf60c6221e41023c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>1970</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Weidemann, H.</creatorcontrib><creatorcontrib>Stear, E.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on information theory</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Weidemann, H.</au><au>Stear, E.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Entropy analysis of estimating systems</atitle><jtitle>IEEE transactions on information theory</jtitle><stitle>TIT</stitle><date>1970-05-01</date><risdate>1970</risdate><volume>16</volume><issue>3</issue><spage>264</spage><epage>270</epage><pages>264-270</pages><issn>0018-9448</issn><eissn>1557-9654</eissn><coden>IETTAW</coden><abstract>A study of the use of entropy as a criterion function for analyzing the performance of sampled-data estimating systems is presented, and performance bounds are obtained for a broad class of such systems. The general result is that the difference between the entropy of the signal to be estimated and the entropy of its estimate based on the output of a noisy sensor can never be larger than the mutual information between the sensor input and output. An interesting, but not totally satisfactory, sufficient condition for attainment of the bound is developed.</abstract><pub>IEEE</pub><doi>10.1109/TIT.1970.1054444</doi><tpages>7</tpages></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 0018-9448 |
| ispartof | IEEE transactions on information theory, 1970-05, Vol.16 (3), p.264-270 |
| issn | 0018-9448 1557-9654 |
| language | eng |
| recordid | cdi_ieee_primary_1054444 |
| source | IEEE Electronic Library (IEL) |
| title | Entropy analysis of estimating systems |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T22%3A57%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Entropy%20analysis%20of%20estimating%20systems&rft.jtitle=IEEE%20transactions%20on%20information%20theory&rft.au=Weidemann,%20H.&rft.date=1970-05-01&rft.volume=16&rft.issue=3&rft.spage=264&rft.epage=270&rft.pages=264-270&rft.issn=0018-9448&rft.eissn=1557-9654&rft.coden=IETTAW&rft_id=info:doi/10.1109/TIT.1970.1054444&rft_dat=%3Cproquest_RIE%3E28476511%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=28476511&rft_id=info:pmid/&rft_ieee_id=1054444&rfr_iscdi=true |