Free energy coding
We introduce a new approach to the problem of optimal compression when a source code produces multiple codewords for a given symbol. It may seem that the most sensible codeword to use in this case is the shortest one. However, in the proposed free energy approach, random codeword selection yields an...
Gespeichert in:
| Hauptverfasser: | , |
|---|---|
| Format: | Tagungsbericht |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 81 |
|---|---|
| container_issue | |
| container_start_page | 73 |
| container_title | |
| container_volume | |
| creator | Frey, B.J. Hinton, G.E. |
| description | We introduce a new approach to the problem of optimal compression when a source code produces multiple codewords for a given symbol. It may seem that the most sensible codeword to use in this case is the shortest one. However, in the proposed free energy approach, random codeword selection yields an effective codeword length that can be less than the shortest codeword length. If the random choices are Boltzmann distributed, the effective length is optimal for the given source code. The expectation-maximization parameter estimation algorithms minimize this effective codeword length. We illustrate the performance of free energy coding on a simple problem where a compression factor of two is gained by using the new method. |
| doi_str_mv | 10.1109/DCC.1996.488312 |
| format | Conference Proceeding |
| fullrecord | <record><control><sourceid>proquest_6IE</sourceid><recordid>TN_cdi_ieee_primary_488312</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>488312</ieee_id><sourcerecordid>26148482</sourcerecordid><originalsourceid>FETCH-LOGICAL-i203t-aaeb809cb966d5fe1bceb20188b913133293549057701bca31584f01cf0e897c3</originalsourceid><addsrcrecordid>eNotj79PwzAQRi1-SKSFhQWJqRNbwp3Pds4jSikgVWKBOUrcSxWUNiVuh_73RArTN7ynJ31KPSBkiOCfl0WRofcuM8yE-kIlmnKbAll_qWbAyC4ny3SlEgTHI0Bzo2Yx_gBoAIeJul8NIgvZy7A9L0K_affbW3XdVF2Uu_-dq-_V61fxnq4_3z6Kl3XaaqBjWlVSM_hQe-c2thGsg9QakLn2SEikPVnjweY5jKwitGwawNCAsM8DzdXT1D0M_e9J4rHctTFI11V76U-x1A4NG9aj-DiJrYiUh6HdVcO5nD7THyvMRVY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype><pqid>26148482</pqid></control><display><type>conference_proceeding</type><title>Free energy coding</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Frey, B.J. ; Hinton, G.E.</creator><creatorcontrib>Frey, B.J. ; Hinton, G.E.</creatorcontrib><description>We introduce a new approach to the problem of optimal compression when a source code produces multiple codewords for a given symbol. It may seem that the most sensible codeword to use in this case is the shortest one. However, in the proposed free energy approach, random codeword selection yields an effective codeword length that can be less than the shortest codeword length. If the random choices are Boltzmann distributed, the effective length is optimal for the given source code. The expectation-maximization parameter estimation algorithms minimize this effective codeword length. We illustrate the performance of free energy coding on a simple problem where a compression factor of two is gained by using the new method.</description><identifier>ISSN: 1068-0314</identifier><identifier>ISBN: 0818673583</identifier><identifier>ISBN: 9780818673580</identifier><identifier>EISSN: 2375-0359</identifier><identifier>DOI: 10.1109/DCC.1996.488312</identifier><language>eng</language><publisher>IEEE</publisher><subject>Boltzmann distribution ; Data compression ; Educational institutions ; Parameter estimation ; Source coding</subject><ispartof>DCC (Los Alamitos, Calif.), 1996, p.73-81</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/488312$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,776,780,785,786,2051,4035,4036,27904,54898</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/488312$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Frey, B.J.</creatorcontrib><creatorcontrib>Hinton, G.E.</creatorcontrib><title>Free energy coding</title><title>DCC (Los Alamitos, Calif.)</title><addtitle>DCC</addtitle><description>We introduce a new approach to the problem of optimal compression when a source code produces multiple codewords for a given symbol. It may seem that the most sensible codeword to use in this case is the shortest one. However, in the proposed free energy approach, random codeword selection yields an effective codeword length that can be less than the shortest codeword length. If the random choices are Boltzmann distributed, the effective length is optimal for the given source code. The expectation-maximization parameter estimation algorithms minimize this effective codeword length. We illustrate the performance of free energy coding on a simple problem where a compression factor of two is gained by using the new method.</description><subject>Boltzmann distribution</subject><subject>Data compression</subject><subject>Educational institutions</subject><subject>Parameter estimation</subject><subject>Source coding</subject><issn>1068-0314</issn><issn>2375-0359</issn><isbn>0818673583</isbn><isbn>9780818673580</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>1996</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotj79PwzAQRi1-SKSFhQWJqRNbwp3Pds4jSikgVWKBOUrcSxWUNiVuh_73RArTN7ynJ31KPSBkiOCfl0WRofcuM8yE-kIlmnKbAll_qWbAyC4ny3SlEgTHI0Bzo2Yx_gBoAIeJul8NIgvZy7A9L0K_affbW3XdVF2Uu_-dq-_V61fxnq4_3z6Kl3XaaqBjWlVSM_hQe-c2thGsg9QakLn2SEikPVnjweY5jKwitGwawNCAsM8DzdXT1D0M_e9J4rHctTFI11V76U-x1A4NG9aj-DiJrYiUh6HdVcO5nD7THyvMRVY</recordid><startdate>1996</startdate><enddate>1996</enddate><creator>Frey, B.J.</creator><creator>Hinton, G.E.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>1996</creationdate><title>Free energy coding</title><author>Frey, B.J. ; Hinton, G.E.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i203t-aaeb809cb966d5fe1bceb20188b913133293549057701bca31584f01cf0e897c3</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>1996</creationdate><topic>Boltzmann distribution</topic><topic>Data compression</topic><topic>Educational institutions</topic><topic>Parameter estimation</topic><topic>Source coding</topic><toplevel>online_resources</toplevel><creatorcontrib>Frey, B.J.</creatorcontrib><creatorcontrib>Hinton, G.E.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Frey, B.J.</au><au>Hinton, G.E.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Free energy coding</atitle><btitle>DCC (Los Alamitos, Calif.)</btitle><stitle>DCC</stitle><date>1996</date><risdate>1996</risdate><spage>73</spage><epage>81</epage><pages>73-81</pages><issn>1068-0314</issn><eissn>2375-0359</eissn><isbn>0818673583</isbn><isbn>9780818673580</isbn><abstract>We introduce a new approach to the problem of optimal compression when a source code produces multiple codewords for a given symbol. It may seem that the most sensible codeword to use in this case is the shortest one. However, in the proposed free energy approach, random codeword selection yields an effective codeword length that can be less than the shortest codeword length. If the random choices are Boltzmann distributed, the effective length is optimal for the given source code. The expectation-maximization parameter estimation algorithms minimize this effective codeword length. We illustrate the performance of free energy coding on a simple problem where a compression factor of two is gained by using the new method.</abstract><pub>IEEE</pub><doi>10.1109/DCC.1996.488312</doi><tpages>9</tpages></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 1068-0314 |
| ispartof | DCC (Los Alamitos, Calif.), 1996, p.73-81 |
| issn | 1068-0314 2375-0359 |
| language | eng |
| recordid | cdi_ieee_primary_488312 |
| source | IEEE Electronic Library (IEL) Conference Proceedings |
| subjects | Boltzmann distribution Data compression Educational institutions Parameter estimation Source coding |
| title | Free energy coding |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-26T04%3A09%3A29IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Free%20energy%20coding&rft.btitle=DCC%20(Los%20Alamitos,%20Calif.)&rft.au=Frey,%20B.J.&rft.date=1996&rft.spage=73&rft.epage=81&rft.pages=73-81&rft.issn=1068-0314&rft.eissn=2375-0359&rft.isbn=0818673583&rft.isbn_list=9780818673580&rft_id=info:doi/10.1109/DCC.1996.488312&rft_dat=%3Cproquest_6IE%3E26148482%3C/proquest_6IE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=26148482&rft_id=info:pmid/&rft_ieee_id=488312&rfr_iscdi=true |