A Bio-Inspired AER Temporal Tri-Color Differentiator Pixel Array
This article investigates the potential of a bio-inspired vision sensor with pixels that detect transients between three primary colors. The in-pixel color processing is inspired by the retinal color opponency that are found in mammalian retinas. Color transitions in a pixel are represented by volta...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on biomedical circuits and systems 2015-10, Vol.9 (5), p.686-698 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 698 |
|---|---|
| container_issue | 5 |
| container_start_page | 686 |
| container_title | IEEE transactions on biomedical circuits and systems |
| container_volume | 9 |
| creator | Farian, Lukasz Lenero-Bardallo, Juan Antonio Hafliger, Philipp |
| description | This article investigates the potential of a bio-inspired vision sensor with pixels that detect transients between three primary colors. The in-pixel color processing is inspired by the retinal color opponency that are found in mammalian retinas. Color transitions in a pixel are represented by voltage spikes, which are akin to a neuron's action potential. These spikes are conveyed off-chip by the Address Event Representation (AER) protocol. To achieve sensitivity to three different color spectra within the visual spectrum, each pixel has three stacked photodiodes at different depths in the silicon substrate. The sensor has been fabricated in the standard TSMC 90 nm CMOS technology. A post-processing method to decode events into color transitions has been proposed and implemented as a custom interface to display real-time color changes in the visual scene. Experimental results are provided. Color transitions can be detected at high speed (up to 2.7 kHz). The sensor has a dynamic range of 58 dB and a power consumption of 22.5 mW. This type of sensor can be of use in industrial, robotics, automotive and other applications where essential information is contained in transient emissions shifts within the visual spectrum. |
| doi_str_mv | 10.1109/TBCAS.2015.2492460 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_pubmed_primary_26540694</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>7313036</ieee_id><sourcerecordid>3883757741</sourcerecordid><originalsourceid>FETCH-LOGICAL-c465t-319ef79d7d4bcbda3aa374a756c4c7da1003eaacabb891d9d9db83d6d493941a3</originalsourceid><addsrcrecordid>eNpdkEtLw0AQgBdRrFb_gIIEvHhJ3WeSvZnGqoWCovG8bLIb2JJH3U3A_nu3pvYgc5gZ5pth-AC4QnCGEOT3-TxLP2YYIjbDlGMawSNwhjiFIeccHu9qgkPKKJuAc-fWELIIc3wKJjhiFEacnoGHNJibLly2bmOsVkG6eA9y3Ww6K-sgtybMurqzwaOpKm112xvZ-_bNfOs6SK2V2wtwUsna6ct9noLPp0WevYSr1-dllq7CkkasDwniuoq5ihUtykJJIiWJqYxZVNIyVhJBSLSUpSyKhCPFfRQJUZGinHCKJJmCu_HuxnZfg3a9aIwrdV3LVneDEygmSYJYQqBHb_-h626wrf9upBglDHkKj1RpO-esrsTGmkbarUBQ7PyKX79i51fs_fqlm_3poWi0Oqz8CfXA9QgYrfVhHBPk_4rID3u0fTU</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1738854351</pqid></control><display><type>article</type><title>A Bio-Inspired AER Temporal Tri-Color Differentiator Pixel Array</title><source>IEEE Electronic Library (IEL)</source><creator>Farian, Lukasz ; Lenero-Bardallo, Juan Antonio ; Hafliger, Philipp</creator><creatorcontrib>Farian, Lukasz ; Lenero-Bardallo, Juan Antonio ; Hafliger, Philipp</creatorcontrib><description>This article investigates the potential of a bio-inspired vision sensor with pixels that detect transients between three primary colors. The in-pixel color processing is inspired by the retinal color opponency that are found in mammalian retinas. Color transitions in a pixel are represented by voltage spikes, which are akin to a neuron's action potential. These spikes are conveyed off-chip by the Address Event Representation (AER) protocol. To achieve sensitivity to three different color spectra within the visual spectrum, each pixel has three stacked photodiodes at different depths in the silicon substrate. The sensor has been fabricated in the standard TSMC 90 nm CMOS technology. A post-processing method to decode events into color transitions has been proposed and implemented as a custom interface to display real-time color changes in the visual scene. Experimental results are provided. Color transitions can be detected at high speed (up to 2.7 kHz). The sensor has a dynamic range of 58 dB and a power consumption of 22.5 mW. This type of sensor can be of use in industrial, robotics, automotive and other applications where essential information is contained in transient emissions shifts within the visual spectrum.</description><identifier>ISSN: 1932-4545</identifier><identifier>EISSN: 1940-9990</identifier><identifier>DOI: 10.1109/TBCAS.2015.2492460</identifier><identifier>PMID: 26540694</identifier><identifier>CODEN: ITBCCW</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Address Event Representation (AER) ; Arrays ; asynchronous vision sensor ; Biomedical Engineering - instrumentation ; Biomedical Engineering - methods ; CMOS pixel ; Color ; color processing ; dynamic vision sensor ; Equipment Design ; high-speed vision sensor ; Humans ; Image color analysis ; Image Processing, Computer-Assisted - instrumentation ; Image Processing, Computer-Assisted - methods ; image sensors ; Laser printers ; Models, Neurological ; Photodiodes ; Retina ; Retina - physiology ; Robot sensing systems ; Semiconductors ; Sensitivity ; Silicon ; temporal contrast</subject><ispartof>IEEE transactions on biomedical circuits and systems, 2015-10, Vol.9 (5), p.686-698</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Oct 2015</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c465t-319ef79d7d4bcbda3aa374a756c4c7da1003eaacabb891d9d9db83d6d493941a3</citedby><cites>FETCH-LOGICAL-c465t-319ef79d7d4bcbda3aa374a756c4c7da1003eaacabb891d9d9db83d6d493941a3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/7313036$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/7313036$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/26540694$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Farian, Lukasz</creatorcontrib><creatorcontrib>Lenero-Bardallo, Juan Antonio</creatorcontrib><creatorcontrib>Hafliger, Philipp</creatorcontrib><title>A Bio-Inspired AER Temporal Tri-Color Differentiator Pixel Array</title><title>IEEE transactions on biomedical circuits and systems</title><addtitle>TBCAS</addtitle><addtitle>IEEE Trans Biomed Circuits Syst</addtitle><description>This article investigates the potential of a bio-inspired vision sensor with pixels that detect transients between three primary colors. The in-pixel color processing is inspired by the retinal color opponency that are found in mammalian retinas. Color transitions in a pixel are represented by voltage spikes, which are akin to a neuron's action potential. These spikes are conveyed off-chip by the Address Event Representation (AER) protocol. To achieve sensitivity to three different color spectra within the visual spectrum, each pixel has three stacked photodiodes at different depths in the silicon substrate. The sensor has been fabricated in the standard TSMC 90 nm CMOS technology. A post-processing method to decode events into color transitions has been proposed and implemented as a custom interface to display real-time color changes in the visual scene. Experimental results are provided. Color transitions can be detected at high speed (up to 2.7 kHz). The sensor has a dynamic range of 58 dB and a power consumption of 22.5 mW. This type of sensor can be of use in industrial, robotics, automotive and other applications where essential information is contained in transient emissions shifts within the visual spectrum.</description><subject>Address Event Representation (AER)</subject><subject>Arrays</subject><subject>asynchronous vision sensor</subject><subject>Biomedical Engineering - instrumentation</subject><subject>Biomedical Engineering - methods</subject><subject>CMOS pixel</subject><subject>Color</subject><subject>color processing</subject><subject>dynamic vision sensor</subject><subject>Equipment Design</subject><subject>high-speed vision sensor</subject><subject>Humans</subject><subject>Image color analysis</subject><subject>Image Processing, Computer-Assisted - instrumentation</subject><subject>Image Processing, Computer-Assisted - methods</subject><subject>image sensors</subject><subject>Laser printers</subject><subject>Models, Neurological</subject><subject>Photodiodes</subject><subject>Retina</subject><subject>Retina - physiology</subject><subject>Robot sensing systems</subject><subject>Semiconductors</subject><subject>Sensitivity</subject><subject>Silicon</subject><subject>temporal contrast</subject><issn>1932-4545</issn><issn>1940-9990</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><sourceid>EIF</sourceid><recordid>eNpdkEtLw0AQgBdRrFb_gIIEvHhJ3WeSvZnGqoWCovG8bLIb2JJH3U3A_nu3pvYgc5gZ5pth-AC4QnCGEOT3-TxLP2YYIjbDlGMawSNwhjiFIeccHu9qgkPKKJuAc-fWELIIc3wKJjhiFEacnoGHNJibLly2bmOsVkG6eA9y3Ww6K-sgtybMurqzwaOpKm112xvZ-_bNfOs6SK2V2wtwUsna6ct9noLPp0WevYSr1-dllq7CkkasDwniuoq5ihUtykJJIiWJqYxZVNIyVhJBSLSUpSyKhCPFfRQJUZGinHCKJJmCu_HuxnZfg3a9aIwrdV3LVneDEygmSYJYQqBHb_-h626wrf9upBglDHkKj1RpO-esrsTGmkbarUBQ7PyKX79i51fs_fqlm_3poWi0Oqz8CfXA9QgYrfVhHBPk_4rID3u0fTU</recordid><startdate>20151001</startdate><enddate>20151001</enddate><creator>Farian, Lukasz</creator><creator>Lenero-Bardallo, Juan Antonio</creator><creator>Hafliger, Philipp</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QO</scope><scope>7SP</scope><scope>7TB</scope><scope>8FD</scope><scope>FR3</scope><scope>L7M</scope><scope>P64</scope><scope>7X8</scope></search><sort><creationdate>20151001</creationdate><title>A Bio-Inspired AER Temporal Tri-Color Differentiator Pixel Array</title><author>Farian, Lukasz ; Lenero-Bardallo, Juan Antonio ; Hafliger, Philipp</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c465t-319ef79d7d4bcbda3aa374a756c4c7da1003eaacabb891d9d9db83d6d493941a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Address Event Representation (AER)</topic><topic>Arrays</topic><topic>asynchronous vision sensor</topic><topic>Biomedical Engineering - instrumentation</topic><topic>Biomedical Engineering - methods</topic><topic>CMOS pixel</topic><topic>Color</topic><topic>color processing</topic><topic>dynamic vision sensor</topic><topic>Equipment Design</topic><topic>high-speed vision sensor</topic><topic>Humans</topic><topic>Image color analysis</topic><topic>Image Processing, Computer-Assisted - instrumentation</topic><topic>Image Processing, Computer-Assisted - methods</topic><topic>image sensors</topic><topic>Laser printers</topic><topic>Models, Neurological</topic><topic>Photodiodes</topic><topic>Retina</topic><topic>Retina - physiology</topic><topic>Robot sensing systems</topic><topic>Semiconductors</topic><topic>Sensitivity</topic><topic>Silicon</topic><topic>temporal contrast</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Farian, Lukasz</creatorcontrib><creatorcontrib>Lenero-Bardallo, Juan Antonio</creatorcontrib><creatorcontrib>Hafliger, Philipp</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Biotechnology Research Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on biomedical circuits and systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Farian, Lukasz</au><au>Lenero-Bardallo, Juan Antonio</au><au>Hafliger, Philipp</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Bio-Inspired AER Temporal Tri-Color Differentiator Pixel Array</atitle><jtitle>IEEE transactions on biomedical circuits and systems</jtitle><stitle>TBCAS</stitle><addtitle>IEEE Trans Biomed Circuits Syst</addtitle><date>2015-10-01</date><risdate>2015</risdate><volume>9</volume><issue>5</issue><spage>686</spage><epage>698</epage><pages>686-698</pages><issn>1932-4545</issn><eissn>1940-9990</eissn><coden>ITBCCW</coden><abstract>This article investigates the potential of a bio-inspired vision sensor with pixels that detect transients between three primary colors. The in-pixel color processing is inspired by the retinal color opponency that are found in mammalian retinas. Color transitions in a pixel are represented by voltage spikes, which are akin to a neuron's action potential. These spikes are conveyed off-chip by the Address Event Representation (AER) protocol. To achieve sensitivity to three different color spectra within the visual spectrum, each pixel has three stacked photodiodes at different depths in the silicon substrate. The sensor has been fabricated in the standard TSMC 90 nm CMOS technology. A post-processing method to decode events into color transitions has been proposed and implemented as a custom interface to display real-time color changes in the visual scene. Experimental results are provided. Color transitions can be detected at high speed (up to 2.7 kHz). The sensor has a dynamic range of 58 dB and a power consumption of 22.5 mW. This type of sensor can be of use in industrial, robotics, automotive and other applications where essential information is contained in transient emissions shifts within the visual spectrum.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>26540694</pmid><doi>10.1109/TBCAS.2015.2492460</doi><tpages>13</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 1932-4545 |
| ispartof | IEEE transactions on biomedical circuits and systems, 2015-10, Vol.9 (5), p.686-698 |
| issn | 1932-4545 1940-9990 |
| language | eng |
| recordid | cdi_pubmed_primary_26540694 |
| source | IEEE Electronic Library (IEL) |
| subjects | Address Event Representation (AER) Arrays asynchronous vision sensor Biomedical Engineering - instrumentation Biomedical Engineering - methods CMOS pixel Color color processing dynamic vision sensor Equipment Design high-speed vision sensor Humans Image color analysis Image Processing, Computer-Assisted - instrumentation Image Processing, Computer-Assisted - methods image sensors Laser printers Models, Neurological Photodiodes Retina Retina - physiology Robot sensing systems Semiconductors Sensitivity Silicon temporal contrast |
| title | A Bio-Inspired AER Temporal Tri-Color Differentiator Pixel Array |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-10T03%3A59%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Bio-Inspired%20AER%20Temporal%20Tri-Color%20Differentiator%20Pixel%20Array&rft.jtitle=IEEE%20transactions%20on%20biomedical%20circuits%20and%20systems&rft.au=Farian,%20Lukasz&rft.date=2015-10-01&rft.volume=9&rft.issue=5&rft.spage=686&rft.epage=698&rft.pages=686-698&rft.issn=1932-4545&rft.eissn=1940-9990&rft.coden=ITBCCW&rft_id=info:doi/10.1109/TBCAS.2015.2492460&rft_dat=%3Cproquest_RIE%3E3883757741%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1738854351&rft_id=info:pmid/26540694&rft_ieee_id=7313036&rfr_iscdi=true |