Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories
Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how th...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2022-07 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Giordano De Marzo Iannelli, Giulio |
description | Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how the retrieval capability of the Hopfield network at null temperature is affected by spatial correlations in the data we feed to it. In particular, we use as patterns to be stored the configurations of a linear Ising model at inverse temperature \(\beta\). Exploiting the signal to noise technique we obtain a phase diagram in the load of the Hopfield network and the Ising temperature where a fuzzy phase and a retrieval region can be observed. Remarkably, as the spatial correlation inside patterns is increased, the critical load of the Hopfield network diminishes, a result also confirmed by numerical simulations. The analysis is then generalized to Dense Associative Memories with arbitrary odd-body interactions, for which we obtain analogous results. |
doi_str_mv | 10.48550/arxiv.2207.05218 |
format | Article |
fullrecord | <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2207_05218</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2688766206</sourcerecordid><originalsourceid>FETCH-LOGICAL-a958-6cce56f2470a1d84c4a7d22cbe15fece9d33bbf4004f4a828bb1552916a46e623</originalsourceid><addsrcrecordid>eNotj81OwzAQhC0kJKrSB-CEJc4p9von7rEqhSKVcumBW-Q4aykljYOdFnj7hpbTjrQzo_kIueNsKo1S7NHGn_o4BWD5lCng5oqMQAieGQlwQyYp7RhjoHNQSozIx9J7dD0NnqbO9rVtqAsxYjPo0CYaWroKna-xqegGD3H4b7D_DvGT2raiT9gmpPOUgquHxBHpG-5DrDHdkmtvm4ST_zsm2-fldrHK1u8vr4v5OrMzZTLtHCrtQebM8spIJ21eAbgSuRp24awSoiy9ZEx6aQ2YsuRKwYxrKzVqEGNyf6k9YxddrPc2_hZ_-MUZf3A8XBxdDF8HTH2xC4fYDpsK0MbkWgPT4gTkzl3Y</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2688766206</pqid></control><display><type>article</type><title>Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Giordano De Marzo ; Iannelli, Giulio</creator><creatorcontrib>Giordano De Marzo ; Iannelli, Giulio</creatorcontrib><description>Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how the retrieval capability of the Hopfield network at null temperature is affected by spatial correlations in the data we feed to it. In particular, we use as patterns to be stored the configurations of a linear Ising model at inverse temperature \(\beta\). Exploiting the signal to noise technique we obtain a phase diagram in the load of the Hopfield network and the Ising temperature where a fuzzy phase and a retrieval region can be observed. Remarkably, as the spatial correlation inside patterns is increased, the critical load of the Hopfield network diminishes, a result also confirmed by numerical simulations. The analysis is then generalized to Dense Associative Memories with arbitrary odd-body interactions, for which we obtain analogous results.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2207.05218</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Associative memory ; Ising model ; Mathematical models ; Neural networks ; Phase diagrams ; Physics - Disordered Systems and Neural Networks ; Physics - Statistical Mechanics ; Retrieval</subject><ispartof>arXiv.org, 2022-07</ispartof><rights>2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,784,885,27925</link.rule.ids><backlink>$$Uhttps://doi.org/10.48550/arXiv.2207.05218$$DView paper in arXiv$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.1016/j.physa.2023.128487$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink></links><search><creatorcontrib>Giordano De Marzo</creatorcontrib><creatorcontrib>Iannelli, Giulio</creatorcontrib><title>Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories</title><title>arXiv.org</title><description>Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how the retrieval capability of the Hopfield network at null temperature is affected by spatial correlations in the data we feed to it. In particular, we use as patterns to be stored the configurations of a linear Ising model at inverse temperature \(\beta\). Exploiting the signal to noise technique we obtain a phase diagram in the load of the Hopfield network and the Ising temperature where a fuzzy phase and a retrieval region can be observed. Remarkably, as the spatial correlation inside patterns is increased, the critical load of the Hopfield network diminishes, a result also confirmed by numerical simulations. The analysis is then generalized to Dense Associative Memories with arbitrary odd-body interactions, for which we obtain analogous results.</description><subject>Associative memory</subject><subject>Ising model</subject><subject>Mathematical models</subject><subject>Neural networks</subject><subject>Phase diagrams</subject><subject>Physics - Disordered Systems and Neural Networks</subject><subject>Physics - Statistical Mechanics</subject><subject>Retrieval</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GOX</sourceid><recordid>eNotj81OwzAQhC0kJKrSB-CEJc4p9von7rEqhSKVcumBW-Q4aykljYOdFnj7hpbTjrQzo_kIueNsKo1S7NHGn_o4BWD5lCng5oqMQAieGQlwQyYp7RhjoHNQSozIx9J7dD0NnqbO9rVtqAsxYjPo0CYaWroKna-xqegGD3H4b7D_DvGT2raiT9gmpPOUgquHxBHpG-5DrDHdkmtvm4ST_zsm2-fldrHK1u8vr4v5OrMzZTLtHCrtQebM8spIJ21eAbgSuRp24awSoiy9ZEx6aQ2YsuRKwYxrKzVqEGNyf6k9YxddrPc2_hZ_-MUZf3A8XBxdDF8HTH2xC4fYDpsK0MbkWgPT4gTkzl3Y</recordid><startdate>20220711</startdate><enddate>20220711</enddate><creator>Giordano De Marzo</creator><creator>Iannelli, Giulio</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>GOX</scope></search><sort><creationdate>20220711</creationdate><title>Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories</title><author>Giordano De Marzo ; Iannelli, Giulio</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a958-6cce56f2470a1d84c4a7d22cbe15fece9d33bbf4004f4a828bb1552916a46e623</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Associative memory</topic><topic>Ising model</topic><topic>Mathematical models</topic><topic>Neural networks</topic><topic>Phase diagrams</topic><topic>Physics - Disordered Systems and Neural Networks</topic><topic>Physics - Statistical Mechanics</topic><topic>Retrieval</topic><toplevel>online_resources</toplevel><creatorcontrib>Giordano De Marzo</creatorcontrib><creatorcontrib>Iannelli, Giulio</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Giordano De Marzo</au><au>Iannelli, Giulio</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories</atitle><jtitle>arXiv.org</jtitle><date>2022-07-11</date><risdate>2022</risdate><eissn>2331-8422</eissn><abstract>Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how the retrieval capability of the Hopfield network at null temperature is affected by spatial correlations in the data we feed to it. In particular, we use as patterns to be stored the configurations of a linear Ising model at inverse temperature \(\beta\). Exploiting the signal to noise technique we obtain a phase diagram in the load of the Hopfield network and the Ising temperature where a fuzzy phase and a retrieval region can be observed. Remarkably, as the spatial correlation inside patterns is increased, the critical load of the Hopfield network diminishes, a result also confirmed by numerical simulations. The analysis is then generalized to Dense Associative Memories with arbitrary odd-body interactions, for which we obtain analogous results.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2207.05218</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2022-07 |
issn | 2331-8422 |
language | eng |
recordid | cdi_arxiv_primary_2207_05218 |
source | arXiv.org; Free E- Journals |
subjects | Associative memory Ising model Mathematical models Neural networks Phase diagrams Physics - Disordered Systems and Neural Networks Physics - Statistical Mechanics Retrieval |
title | Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T20%3A54%3A39IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Effect%20of%20spatial%20correlations%20on%20Hopfield%20Neural%20Network%20and%20Dense%20Associative%20Memories&rft.jtitle=arXiv.org&rft.au=Giordano%20De%20Marzo&rft.date=2022-07-11&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2207.05218&rft_dat=%3Cproquest_arxiv%3E2688766206%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2688766206&rft_id=info:pmid/&rfr_iscdi=true |