Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories

Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how th...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2022-07
Hauptverfasser: Giordano De Marzo, Iannelli, Giulio
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Giordano De Marzo
Iannelli, Giulio
description Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how the retrieval capability of the Hopfield network at null temperature is affected by spatial correlations in the data we feed to it. In particular, we use as patterns to be stored the configurations of a linear Ising model at inverse temperature \(\beta\). Exploiting the signal to noise technique we obtain a phase diagram in the load of the Hopfield network and the Ising temperature where a fuzzy phase and a retrieval region can be observed. Remarkably, as the spatial correlation inside patterns is increased, the critical load of the Hopfield network diminishes, a result also confirmed by numerical simulations. The analysis is then generalized to Dense Associative Memories with arbitrary odd-body interactions, for which we obtain analogous results.
doi_str_mv 10.48550/arxiv.2207.05218
format Article
fullrecord <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2207_05218</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2688766206</sourcerecordid><originalsourceid>FETCH-LOGICAL-a958-6cce56f2470a1d84c4a7d22cbe15fece9d33bbf4004f4a828bb1552916a46e623</originalsourceid><addsrcrecordid>eNotj81OwzAQhC0kJKrSB-CEJc4p9von7rEqhSKVcumBW-Q4aykljYOdFnj7hpbTjrQzo_kIueNsKo1S7NHGn_o4BWD5lCng5oqMQAieGQlwQyYp7RhjoHNQSozIx9J7dD0NnqbO9rVtqAsxYjPo0CYaWroKna-xqegGD3H4b7D_DvGT2raiT9gmpPOUgquHxBHpG-5DrDHdkmtvm4ST_zsm2-fldrHK1u8vr4v5OrMzZTLtHCrtQebM8spIJ21eAbgSuRp24awSoiy9ZEx6aQ2YsuRKwYxrKzVqEGNyf6k9YxddrPc2_hZ_-MUZf3A8XBxdDF8HTH2xC4fYDpsK0MbkWgPT4gTkzl3Y</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2688766206</pqid></control><display><type>article</type><title>Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Giordano De Marzo ; Iannelli, Giulio</creator><creatorcontrib>Giordano De Marzo ; Iannelli, Giulio</creatorcontrib><description>Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how the retrieval capability of the Hopfield network at null temperature is affected by spatial correlations in the data we feed to it. In particular, we use as patterns to be stored the configurations of a linear Ising model at inverse temperature \(\beta\). Exploiting the signal to noise technique we obtain a phase diagram in the load of the Hopfield network and the Ising temperature where a fuzzy phase and a retrieval region can be observed. Remarkably, as the spatial correlation inside patterns is increased, the critical load of the Hopfield network diminishes, a result also confirmed by numerical simulations. The analysis is then generalized to Dense Associative Memories with arbitrary odd-body interactions, for which we obtain analogous results.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2207.05218</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Associative memory ; Ising model ; Mathematical models ; Neural networks ; Phase diagrams ; Physics - Disordered Systems and Neural Networks ; Physics - Statistical Mechanics ; Retrieval</subject><ispartof>arXiv.org, 2022-07</ispartof><rights>2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,784,885,27925</link.rule.ids><backlink>$$Uhttps://doi.org/10.48550/arXiv.2207.05218$$DView paper in arXiv$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.1016/j.physa.2023.128487$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink></links><search><creatorcontrib>Giordano De Marzo</creatorcontrib><creatorcontrib>Iannelli, Giulio</creatorcontrib><title>Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories</title><title>arXiv.org</title><description>Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how the retrieval capability of the Hopfield network at null temperature is affected by spatial correlations in the data we feed to it. In particular, we use as patterns to be stored the configurations of a linear Ising model at inverse temperature \(\beta\). Exploiting the signal to noise technique we obtain a phase diagram in the load of the Hopfield network and the Ising temperature where a fuzzy phase and a retrieval region can be observed. Remarkably, as the spatial correlation inside patterns is increased, the critical load of the Hopfield network diminishes, a result also confirmed by numerical simulations. The analysis is then generalized to Dense Associative Memories with arbitrary odd-body interactions, for which we obtain analogous results.</description><subject>Associative memory</subject><subject>Ising model</subject><subject>Mathematical models</subject><subject>Neural networks</subject><subject>Phase diagrams</subject><subject>Physics - Disordered Systems and Neural Networks</subject><subject>Physics - Statistical Mechanics</subject><subject>Retrieval</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GOX</sourceid><recordid>eNotj81OwzAQhC0kJKrSB-CEJc4p9von7rEqhSKVcumBW-Q4aykljYOdFnj7hpbTjrQzo_kIueNsKo1S7NHGn_o4BWD5lCng5oqMQAieGQlwQyYp7RhjoHNQSozIx9J7dD0NnqbO9rVtqAsxYjPo0CYaWroKna-xqegGD3H4b7D_DvGT2raiT9gmpPOUgquHxBHpG-5DrDHdkmtvm4ST_zsm2-fldrHK1u8vr4v5OrMzZTLtHCrtQebM8spIJ21eAbgSuRp24awSoiy9ZEx6aQ2YsuRKwYxrKzVqEGNyf6k9YxddrPc2_hZ_-MUZf3A8XBxdDF8HTH2xC4fYDpsK0MbkWgPT4gTkzl3Y</recordid><startdate>20220711</startdate><enddate>20220711</enddate><creator>Giordano De Marzo</creator><creator>Iannelli, Giulio</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>GOX</scope></search><sort><creationdate>20220711</creationdate><title>Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories</title><author>Giordano De Marzo ; Iannelli, Giulio</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a958-6cce56f2470a1d84c4a7d22cbe15fece9d33bbf4004f4a828bb1552916a46e623</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Associative memory</topic><topic>Ising model</topic><topic>Mathematical models</topic><topic>Neural networks</topic><topic>Phase diagrams</topic><topic>Physics - Disordered Systems and Neural Networks</topic><topic>Physics - Statistical Mechanics</topic><topic>Retrieval</topic><toplevel>online_resources</toplevel><creatorcontrib>Giordano De Marzo</creatorcontrib><creatorcontrib>Iannelli, Giulio</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Giordano De Marzo</au><au>Iannelli, Giulio</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories</atitle><jtitle>arXiv.org</jtitle><date>2022-07-11</date><risdate>2022</risdate><eissn>2331-8422</eissn><abstract>Hopfield model is one of the few neural networks for which analytical results can be obtained. However, most of them are derived under the assumption of random uncorrelated patterns, while in real life applications data to be stored show non-trivial correlations. In the present paper we study how the retrieval capability of the Hopfield network at null temperature is affected by spatial correlations in the data we feed to it. In particular, we use as patterns to be stored the configurations of a linear Ising model at inverse temperature \(\beta\). Exploiting the signal to noise technique we obtain a phase diagram in the load of the Hopfield network and the Ising temperature where a fuzzy phase and a retrieval region can be observed. Remarkably, as the spatial correlation inside patterns is increased, the critical load of the Hopfield network diminishes, a result also confirmed by numerical simulations. The analysis is then generalized to Dense Associative Memories with arbitrary odd-body interactions, for which we obtain analogous results.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2207.05218</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2022-07
issn 2331-8422
language eng
recordid cdi_arxiv_primary_2207_05218
source arXiv.org; Free E- Journals
subjects Associative memory
Ising model
Mathematical models
Neural networks
Phase diagrams
Physics - Disordered Systems and Neural Networks
Physics - Statistical Mechanics
Retrieval
title Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T20%3A54%3A39IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Effect%20of%20spatial%20correlations%20on%20Hopfield%20Neural%20Network%20and%20Dense%20Associative%20Memories&rft.jtitle=arXiv.org&rft.au=Giordano%20De%20Marzo&rft.date=2022-07-11&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2207.05218&rft_dat=%3Cproquest_arxiv%3E2688766206%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2688766206&rft_id=info:pmid/&rfr_iscdi=true