Information-Geometric Measures for Estimation of Connection Weight Under Correlated Inputs

The brain processes information in a highly parallel manner. Determination of the relationship between neural spikes and synaptic connections plays a key role in the analysis of electrophysiological data. Information geometry (IG) has been proposed as a powerful analysis tool for multiple spike data...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Neural computation 2012-12, Vol.24 (12), p.3213-3245
Hauptverfasser: Nie, Yimin, Tatsuno, Masami
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 3245
container_issue 12
container_start_page 3213
container_title Neural computation
container_volume 24
creator Nie, Yimin
Tatsuno, Masami
description The brain processes information in a highly parallel manner. Determination of the relationship between neural spikes and synaptic connections plays a key role in the analysis of electrophysiological data. Information geometry (IG) has been proposed as a powerful analysis tool for multiple spike data, providing useful insights into the statistical interactions within a population of neurons. Previous work has demonstrated that IG measures can be used to infer the connection weight between two neurons in a neural network. This property is useful in neuroscience because it provides a way to estimate learning-induced changes in synaptic strengths from extracellular neuronal recordings. A previous study has shown, however, that this property would hold only when inputs to neurons are not correlated. Since neurons in the brain often receive common inputs, this would hinder the application of the IG method to real data. We investigated the two-neuron-IG measures in higher-order log-linear models to overcome this limitation. First, we mathematically showed that the estimation of uniformly connected synaptic weight can be improved by taking into account higher-order log-linear models. Second, we numerically showed that the estimation can be improved for more general asymmetrically connected networks. Considering the estimated number of the synaptic connections in the brain, we showed that the two-neuron IG measure calculated by the fourth- or fifth-order log-linear model would provide an accurate estimation of connection strength within approximately a 10% error. These studies suggest that the two-neuron IG measure with higher-order log-linear expansion is a robust estimator of connection weight even under correlated inputs, providing a useful analytical tool for real multineuronal spike data.
doi_str_mv 10.1162/NECO_a_00367
format Article
fullrecord <record><control><sourceid>proquest_mit_j</sourceid><recordid>TN_cdi_mit_journals_10_1162_NECO_a_00367</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2813419211</sourcerecordid><originalsourceid>FETCH-LOGICAL-c509t-eac3581cae9974665bb7343d21343c8adef07740e465847d827eca5b8ce1a79b3</originalsourceid><addsrcrecordid>eNqFkc1PHCEYh4lpo9ttb56bSXrpoWNfYPg6ms1qN9F6qdH0QhjmHTtmZ9jCTBP966WuX2lMegACPDzA-yNkn8IBpZJ9_b5cnFlnAbhUO2RGBYdSa335hsxAG1MqKdUeeZfSNQBICmKX7DFmFGilZuTnamhD7N3YhaE8xtDjGDtfnKJLU8RU5M1imcZuSxShLRZhGNDfzy6wu_o1FudDgzGvx4hrN2JTrIbNNKb35G3r1gk_PIxzcn60_LH4Vp6cHa8WhyelF2DGEp3nQlPv0BhVSSnqWvGKN4zm3mvXYAtKVYCVFLpSjWYKvRO19kidMjWfk89b7yaG3xOm0fZd8rheuwHDlCxljNIszhX6L0orrqUyWmT00z_odZjikD-SKUFBcZnbnHzZUj6GlCK2dhNzreKNpWD_xmNfxpPxjw_Sqe6xeYIf83h-YN-9vPB11-EraI4m_GFVR5nlwARIy4DRfNyCsbfd5h54ctwBARSsKw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1151073607</pqid></control><display><type>article</type><title>Information-Geometric Measures for Estimation of Connection Weight Under Correlated Inputs</title><source>MEDLINE</source><source>MIT Press Journals</source><creator>Nie, Yimin ; Tatsuno, Masami</creator><creatorcontrib>Nie, Yimin ; Tatsuno, Masami</creatorcontrib><description>The brain processes information in a highly parallel manner. Determination of the relationship between neural spikes and synaptic connections plays a key role in the analysis of electrophysiological data. Information geometry (IG) has been proposed as a powerful analysis tool for multiple spike data, providing useful insights into the statistical interactions within a population of neurons. Previous work has demonstrated that IG measures can be used to infer the connection weight between two neurons in a neural network. This property is useful in neuroscience because it provides a way to estimate learning-induced changes in synaptic strengths from extracellular neuronal recordings. A previous study has shown, however, that this property would hold only when inputs to neurons are not correlated. Since neurons in the brain often receive common inputs, this would hinder the application of the IG method to real data. We investigated the two-neuron-IG measures in higher-order log-linear models to overcome this limitation. First, we mathematically showed that the estimation of uniformly connected synaptic weight can be improved by taking into account higher-order log-linear models. Second, we numerically showed that the estimation can be improved for more general asymmetrically connected networks. Considering the estimated number of the synaptic connections in the brain, we showed that the two-neuron IG measure calculated by the fourth- or fifth-order log-linear model would provide an accurate estimation of connection strength within approximately a 10% error. These studies suggest that the two-neuron IG measure with higher-order log-linear expansion is a robust estimator of connection weight even under correlated inputs, providing a useful analytical tool for real multineuronal spike data.</description><identifier>ISSN: 0899-7667</identifier><identifier>EISSN: 1530-888X</identifier><identifier>DOI: 10.1162/NECO_a_00367</identifier><identifier>PMID: 22970877</identifier><identifier>CODEN: NEUCEB</identifier><language>eng</language><publisher>One Rogers Street, Cambridge, MA 02142-1209, USA: MIT Press</publisher><subject>Animals ; Brain ; Brain - physiology ; Computer Simulation ; Data processing ; Estimating techniques ; Firing pattern ; Humans ; Immunoglobulins ; Information processing ; Letters ; Mathematical analysis ; Mathematical models ; Models, Neurological ; Models, Theoretical ; Nervous system ; Neural networks ; Neural Networks (Computer) ; Neurons ; Neuropsychology ; Neurosciences ; Statistics ; Synapses ; Synaptic strength</subject><ispartof>Neural computation, 2012-12, Vol.24 (12), p.3213-3245</ispartof><rights>Copyright MIT Press Journals Dec 2012</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c509t-eac3581cae9974665bb7343d21343c8adef07740e465847d827eca5b8ce1a79b3</citedby><cites>FETCH-LOGICAL-c509t-eac3581cae9974665bb7343d21343c8adef07740e465847d827eca5b8ce1a79b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://direct.mit.edu/neco/article/doi/10.1162/NECO_a_00367$$EHTML$$P50$$Gmit$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,53984,53985</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/22970877$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Nie, Yimin</creatorcontrib><creatorcontrib>Tatsuno, Masami</creatorcontrib><title>Information-Geometric Measures for Estimation of Connection Weight Under Correlated Inputs</title><title>Neural computation</title><addtitle>Neural Comput</addtitle><description>The brain processes information in a highly parallel manner. Determination of the relationship between neural spikes and synaptic connections plays a key role in the analysis of electrophysiological data. Information geometry (IG) has been proposed as a powerful analysis tool for multiple spike data, providing useful insights into the statistical interactions within a population of neurons. Previous work has demonstrated that IG measures can be used to infer the connection weight between two neurons in a neural network. This property is useful in neuroscience because it provides a way to estimate learning-induced changes in synaptic strengths from extracellular neuronal recordings. A previous study has shown, however, that this property would hold only when inputs to neurons are not correlated. Since neurons in the brain often receive common inputs, this would hinder the application of the IG method to real data. We investigated the two-neuron-IG measures in higher-order log-linear models to overcome this limitation. First, we mathematically showed that the estimation of uniformly connected synaptic weight can be improved by taking into account higher-order log-linear models. Second, we numerically showed that the estimation can be improved for more general asymmetrically connected networks. Considering the estimated number of the synaptic connections in the brain, we showed that the two-neuron IG measure calculated by the fourth- or fifth-order log-linear model would provide an accurate estimation of connection strength within approximately a 10% error. These studies suggest that the two-neuron IG measure with higher-order log-linear expansion is a robust estimator of connection weight even under correlated inputs, providing a useful analytical tool for real multineuronal spike data.</description><subject>Animals</subject><subject>Brain</subject><subject>Brain - physiology</subject><subject>Computer Simulation</subject><subject>Data processing</subject><subject>Estimating techniques</subject><subject>Firing pattern</subject><subject>Humans</subject><subject>Immunoglobulins</subject><subject>Information processing</subject><subject>Letters</subject><subject>Mathematical analysis</subject><subject>Mathematical models</subject><subject>Models, Neurological</subject><subject>Models, Theoretical</subject><subject>Nervous system</subject><subject>Neural networks</subject><subject>Neural Networks (Computer)</subject><subject>Neurons</subject><subject>Neuropsychology</subject><subject>Neurosciences</subject><subject>Statistics</subject><subject>Synapses</subject><subject>Synaptic strength</subject><issn>0899-7667</issn><issn>1530-888X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNqFkc1PHCEYh4lpo9ttb56bSXrpoWNfYPg6ms1qN9F6qdH0QhjmHTtmZ9jCTBP966WuX2lMegACPDzA-yNkn8IBpZJ9_b5cnFlnAbhUO2RGBYdSa335hsxAG1MqKdUeeZfSNQBICmKX7DFmFGilZuTnamhD7N3YhaE8xtDjGDtfnKJLU8RU5M1imcZuSxShLRZhGNDfzy6wu_o1FudDgzGvx4hrN2JTrIbNNKb35G3r1gk_PIxzcn60_LH4Vp6cHa8WhyelF2DGEp3nQlPv0BhVSSnqWvGKN4zm3mvXYAtKVYCVFLpSjWYKvRO19kidMjWfk89b7yaG3xOm0fZd8rheuwHDlCxljNIszhX6L0orrqUyWmT00z_odZjikD-SKUFBcZnbnHzZUj6GlCK2dhNzreKNpWD_xmNfxpPxjw_Sqe6xeYIf83h-YN-9vPB11-EraI4m_GFVR5nlwARIy4DRfNyCsbfd5h54ctwBARSsKw</recordid><startdate>20121201</startdate><enddate>20121201</enddate><creator>Nie, Yimin</creator><creator>Tatsuno, Masami</creator><general>MIT Press</general><general>MIT Press Journals, The</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7X8</scope><scope>7TK</scope></search><sort><creationdate>20121201</creationdate><title>Information-Geometric Measures for Estimation of Connection Weight Under Correlated Inputs</title><author>Nie, Yimin ; Tatsuno, Masami</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c509t-eac3581cae9974665bb7343d21343c8adef07740e465847d827eca5b8ce1a79b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Animals</topic><topic>Brain</topic><topic>Brain - physiology</topic><topic>Computer Simulation</topic><topic>Data processing</topic><topic>Estimating techniques</topic><topic>Firing pattern</topic><topic>Humans</topic><topic>Immunoglobulins</topic><topic>Information processing</topic><topic>Letters</topic><topic>Mathematical analysis</topic><topic>Mathematical models</topic><topic>Models, Neurological</topic><topic>Models, Theoretical</topic><topic>Nervous system</topic><topic>Neural networks</topic><topic>Neural Networks (Computer)</topic><topic>Neurons</topic><topic>Neuropsychology</topic><topic>Neurosciences</topic><topic>Statistics</topic><topic>Synapses</topic><topic>Synaptic strength</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Nie, Yimin</creatorcontrib><creatorcontrib>Tatsuno, Masami</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>MEDLINE - Academic</collection><collection>Neurosciences Abstracts</collection><jtitle>Neural computation</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Nie, Yimin</au><au>Tatsuno, Masami</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Information-Geometric Measures for Estimation of Connection Weight Under Correlated Inputs</atitle><jtitle>Neural computation</jtitle><addtitle>Neural Comput</addtitle><date>2012-12-01</date><risdate>2012</risdate><volume>24</volume><issue>12</issue><spage>3213</spage><epage>3245</epage><pages>3213-3245</pages><issn>0899-7667</issn><eissn>1530-888X</eissn><coden>NEUCEB</coden><abstract>The brain processes information in a highly parallel manner. Determination of the relationship between neural spikes and synaptic connections plays a key role in the analysis of electrophysiological data. Information geometry (IG) has been proposed as a powerful analysis tool for multiple spike data, providing useful insights into the statistical interactions within a population of neurons. Previous work has demonstrated that IG measures can be used to infer the connection weight between two neurons in a neural network. This property is useful in neuroscience because it provides a way to estimate learning-induced changes in synaptic strengths from extracellular neuronal recordings. A previous study has shown, however, that this property would hold only when inputs to neurons are not correlated. Since neurons in the brain often receive common inputs, this would hinder the application of the IG method to real data. We investigated the two-neuron-IG measures in higher-order log-linear models to overcome this limitation. First, we mathematically showed that the estimation of uniformly connected synaptic weight can be improved by taking into account higher-order log-linear models. Second, we numerically showed that the estimation can be improved for more general asymmetrically connected networks. Considering the estimated number of the synaptic connections in the brain, we showed that the two-neuron IG measure calculated by the fourth- or fifth-order log-linear model would provide an accurate estimation of connection strength within approximately a 10% error. These studies suggest that the two-neuron IG measure with higher-order log-linear expansion is a robust estimator of connection weight even under correlated inputs, providing a useful analytical tool for real multineuronal spike data.</abstract><cop>One Rogers Street, Cambridge, MA 02142-1209, USA</cop><pub>MIT Press</pub><pmid>22970877</pmid><doi>10.1162/NECO_a_00367</doi><tpages>33</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0899-7667
ispartof Neural computation, 2012-12, Vol.24 (12), p.3213-3245
issn 0899-7667
1530-888X
language eng
recordid cdi_mit_journals_10_1162_NECO_a_00367
source MEDLINE; MIT Press Journals
subjects Animals
Brain
Brain - physiology
Computer Simulation
Data processing
Estimating techniques
Firing pattern
Humans
Immunoglobulins
Information processing
Letters
Mathematical analysis
Mathematical models
Models, Neurological
Models, Theoretical
Nervous system
Neural networks
Neural Networks (Computer)
Neurons
Neuropsychology
Neurosciences
Statistics
Synapses
Synaptic strength
title Information-Geometric Measures for Estimation of Connection Weight Under Correlated Inputs
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-21T20%3A21%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_mit_j&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Information-Geometric%20Measures%20for%20Estimation%20of%20Connection%20Weight%20Under%20Correlated%20Inputs&rft.jtitle=Neural%20computation&rft.au=Nie,%20Yimin&rft.date=2012-12-01&rft.volume=24&rft.issue=12&rft.spage=3213&rft.epage=3245&rft.pages=3213-3245&rft.issn=0899-7667&rft.eissn=1530-888X&rft.coden=NEUCEB&rft_id=info:doi/10.1162/NECO_a_00367&rft_dat=%3Cproquest_mit_j%3E2813419211%3C/proquest_mit_j%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1151073607&rft_id=info:pmid/22970877&rfr_iscdi=true