Large-scale photonic natural language processing
Modern machine learning applications require huge artificial networks demanding in computational power and memory. Light-based platforms promise ultra-fast and energy-efficient hardware, which may help in realizing next-generation data processing devices. However, current photonic networks are limit...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Valensise, Carlo Michele Grecco, Ivana Pierangeli, Davide Conti, Claudio |
description | Modern machine learning applications require huge artificial networks
demanding in computational power and memory. Light-based platforms promise
ultra-fast and energy-efficient hardware, which may help in realizing
next-generation data processing devices. However, current photonic networks are
limited by the number of input-output nodes that can be processed in a single
shot. This restricted network capacity prevents their application to relevant
large-scale problems such as natural language processing. Here, we realize a
photonic processor with a capacity exceeding $1.5 \times 10^{10}$ optical
nodes, more than one order of magnitude larger than any previous
implementation, which enables photonic large-scale text encoding and
classification. By exploiting the full three-dimensional structure of the
optical field propagating in free space, we overcome the interpolation
threshold and reach the over-parametrized region of machine learning, a
condition that allows high-performance natural language processing with a
minimal fraction of training points. Our results provide a novel solution to
scale-up light-driven computing and open the route to photonic language
processing. |
doi_str_mv | 10.48550/arxiv.2208.13649 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2208_13649</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2208_13649</sourcerecordid><originalsourceid>FETCH-LOGICAL-a679-e819a63036ebf281057ded1f8a088a98ade26569fffe5f50b80260614854a63a3</originalsourceid><addsrcrecordid>eNotzsFuwjAQBFBfOFTAB_REfsDp2o7N-ogQ0EqReuEeLck6RAoJcpKK_n1T2tMcRjN6QrwqSDO0Ft4oPpqvVGvAVBmX-RcBOcWa5VBSy8n92o9915RJR-MUqU1a6uqJ6rmJfcnD0HT1SiwCtQOv_3MpzsfDef8u88_Tx36XS3JbLxmVJ2fAOL4EjQrstuJKBSRAJI9UsXbW-RAC22DhgqAdODUzs3lHZik2f7dPcnGPzY3id_FLL5508wNcUD3v</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Large-scale photonic natural language processing</title><source>arXiv.org</source><creator>Valensise, Carlo Michele ; Grecco, Ivana ; Pierangeli, Davide ; Conti, Claudio</creator><creatorcontrib>Valensise, Carlo Michele ; Grecco, Ivana ; Pierangeli, Davide ; Conti, Claudio</creatorcontrib><description>Modern machine learning applications require huge artificial networks
demanding in computational power and memory. Light-based platforms promise
ultra-fast and energy-efficient hardware, which may help in realizing
next-generation data processing devices. However, current photonic networks are
limited by the number of input-output nodes that can be processed in a single
shot. This restricted network capacity prevents their application to relevant
large-scale problems such as natural language processing. Here, we realize a
photonic processor with a capacity exceeding $1.5 \times 10^{10}$ optical
nodes, more than one order of magnitude larger than any previous
implementation, which enables photonic large-scale text encoding and
classification. By exploiting the full three-dimensional structure of the
optical field propagating in free space, we overcome the interpolation
threshold and reach the over-parametrized region of machine learning, a
condition that allows high-performance natural language processing with a
minimal fraction of training points. Our results provide a novel solution to
scale-up light-driven computing and open the route to photonic language
processing.</description><identifier>DOI: 10.48550/arxiv.2208.13649</identifier><language>eng</language><subject>Computer Science - Emerging Technologies ; Physics - Optics</subject><creationdate>2022-08</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2208.13649$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2208.13649$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Valensise, Carlo Michele</creatorcontrib><creatorcontrib>Grecco, Ivana</creatorcontrib><creatorcontrib>Pierangeli, Davide</creatorcontrib><creatorcontrib>Conti, Claudio</creatorcontrib><title>Large-scale photonic natural language processing</title><description>Modern machine learning applications require huge artificial networks
demanding in computational power and memory. Light-based platforms promise
ultra-fast and energy-efficient hardware, which may help in realizing
next-generation data processing devices. However, current photonic networks are
limited by the number of input-output nodes that can be processed in a single
shot. This restricted network capacity prevents their application to relevant
large-scale problems such as natural language processing. Here, we realize a
photonic processor with a capacity exceeding $1.5 \times 10^{10}$ optical
nodes, more than one order of magnitude larger than any previous
implementation, which enables photonic large-scale text encoding and
classification. By exploiting the full three-dimensional structure of the
optical field propagating in free space, we overcome the interpolation
threshold and reach the over-parametrized region of machine learning, a
condition that allows high-performance natural language processing with a
minimal fraction of training points. Our results provide a novel solution to
scale-up light-driven computing and open the route to photonic language
processing.</description><subject>Computer Science - Emerging Technologies</subject><subject>Physics - Optics</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzsFuwjAQBFBfOFTAB_REfsDp2o7N-ogQ0EqReuEeLck6RAoJcpKK_n1T2tMcRjN6QrwqSDO0Ft4oPpqvVGvAVBmX-RcBOcWa5VBSy8n92o9915RJR-MUqU1a6uqJ6rmJfcnD0HT1SiwCtQOv_3MpzsfDef8u88_Tx36XS3JbLxmVJ2fAOL4EjQrstuJKBSRAJI9UsXbW-RAC22DhgqAdODUzs3lHZik2f7dPcnGPzY3id_FLL5508wNcUD3v</recordid><startdate>20220829</startdate><enddate>20220829</enddate><creator>Valensise, Carlo Michele</creator><creator>Grecco, Ivana</creator><creator>Pierangeli, Davide</creator><creator>Conti, Claudio</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20220829</creationdate><title>Large-scale photonic natural language processing</title><author>Valensise, Carlo Michele ; Grecco, Ivana ; Pierangeli, Davide ; Conti, Claudio</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a679-e819a63036ebf281057ded1f8a088a98ade26569fffe5f50b80260614854a63a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer Science - Emerging Technologies</topic><topic>Physics - Optics</topic><toplevel>online_resources</toplevel><creatorcontrib>Valensise, Carlo Michele</creatorcontrib><creatorcontrib>Grecco, Ivana</creatorcontrib><creatorcontrib>Pierangeli, Davide</creatorcontrib><creatorcontrib>Conti, Claudio</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Valensise, Carlo Michele</au><au>Grecco, Ivana</au><au>Pierangeli, Davide</au><au>Conti, Claudio</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Large-scale photonic natural language processing</atitle><date>2022-08-29</date><risdate>2022</risdate><abstract>Modern machine learning applications require huge artificial networks
demanding in computational power and memory. Light-based platforms promise
ultra-fast and energy-efficient hardware, which may help in realizing
next-generation data processing devices. However, current photonic networks are
limited by the number of input-output nodes that can be processed in a single
shot. This restricted network capacity prevents their application to relevant
large-scale problems such as natural language processing. Here, we realize a
photonic processor with a capacity exceeding $1.5 \times 10^{10}$ optical
nodes, more than one order of magnitude larger than any previous
implementation, which enables photonic large-scale text encoding and
classification. By exploiting the full three-dimensional structure of the
optical field propagating in free space, we overcome the interpolation
threshold and reach the over-parametrized region of machine learning, a
condition that allows high-performance natural language processing with a
minimal fraction of training points. Our results provide a novel solution to
scale-up light-driven computing and open the route to photonic language
processing.</abstract><doi>10.48550/arxiv.2208.13649</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2208.13649 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2208_13649 |
source | arXiv.org |
subjects | Computer Science - Emerging Technologies Physics - Optics |
title | Large-scale photonic natural language processing |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-21T16%3A04%3A02IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Large-scale%20photonic%20natural%20language%20processing&rft.au=Valensise,%20Carlo%20Michele&rft.date=2022-08-29&rft_id=info:doi/10.48550/arxiv.2208.13649&rft_dat=%3Carxiv_GOX%3E2208_13649%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |