Multi-head attention mechanism fusion calculation distribution method based on acceleration processor
The invention relates to the field of data processing, and discloses a multi-head attention mechanism fusion calculation distribution method based on an acceleration processor, and the method comprises the steps: obtaining slave core information, to-be-processed data in a memory, and a calculation d...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | GAO WEI XU NILIN YAN XIACHAO |
description | The invention relates to the field of data processing, and discloses a multi-head attention mechanism fusion calculation distribution method based on an acceleration processor, and the method comprises the steps: obtaining slave core information, to-be-processed data in a memory, and a calculation demand of the to-be-processed data; based on the calculation demand and the slave core information, carrying out fusion association on operators of the slave cores to obtain fusion operators and calculation logic corresponding to each fusion operator; and calling the interfaces corresponding to the fusion operators in sequence to start the slave core, so that the slave core calculates the to-be-processed data by using the corresponding operators according to the calculation logic of each fusion operator in sequence to obtain a calculation result. The mode of fusing the operator combination is beneficial to full use of hardware resources, and compared with the situation that only a single operator is processed at the |
format | Patent |
fullrecord | <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN116431562A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN116431562A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN116431562A3</originalsourceid><addsrcrecordid>eNqNyjsOwjAQBNA0FAi4gzlAihBIjyIQDVT00WY9USw5duRd359fDkA1mpm3LnDPXl05gqwhVQR1MZgJPFJwMpkhy2dg8pw9fU_rRJPr8yJ1jNb0JLDm3YkZHukn5xQZIjFti9VAXrBbclPsr5dneysxxw4yEyNAu_ZRVc2xrk7N4Vz_Y162mUBF</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Multi-head attention mechanism fusion calculation distribution method based on acceleration processor</title><source>esp@cenet</source><creator>GAO WEI ; XU NILIN ; YAN XIACHAO</creator><creatorcontrib>GAO WEI ; XU NILIN ; YAN XIACHAO</creatorcontrib><description>The invention relates to the field of data processing, and discloses a multi-head attention mechanism fusion calculation distribution method based on an acceleration processor, and the method comprises the steps: obtaining slave core information, to-be-processed data in a memory, and a calculation demand of the to-be-processed data; based on the calculation demand and the slave core information, carrying out fusion association on operators of the slave cores to obtain fusion operators and calculation logic corresponding to each fusion operator; and calling the interfaces corresponding to the fusion operators in sequence to start the slave core, so that the slave core calculates the to-be-processed data by using the corresponding operators according to the calculation logic of each fusion operator in sequence to obtain a calculation result. The mode of fusing the operator combination is beneficial to full use of hardware resources, and compared with the situation that only a single operator is processed at the</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2023</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20230714&DB=EPODOC&CC=CN&NR=116431562A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20230714&DB=EPODOC&CC=CN&NR=116431562A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>GAO WEI</creatorcontrib><creatorcontrib>XU NILIN</creatorcontrib><creatorcontrib>YAN XIACHAO</creatorcontrib><title>Multi-head attention mechanism fusion calculation distribution method based on acceleration processor</title><description>The invention relates to the field of data processing, and discloses a multi-head attention mechanism fusion calculation distribution method based on an acceleration processor, and the method comprises the steps: obtaining slave core information, to-be-processed data in a memory, and a calculation demand of the to-be-processed data; based on the calculation demand and the slave core information, carrying out fusion association on operators of the slave cores to obtain fusion operators and calculation logic corresponding to each fusion operator; and calling the interfaces corresponding to the fusion operators in sequence to start the slave core, so that the slave core calculates the to-be-processed data by using the corresponding operators according to the calculation logic of each fusion operator in sequence to obtain a calculation result. The mode of fusing the operator combination is beneficial to full use of hardware resources, and compared with the situation that only a single operator is processed at the</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2023</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNyjsOwjAQBNA0FAi4gzlAihBIjyIQDVT00WY9USw5duRd359fDkA1mpm3LnDPXl05gqwhVQR1MZgJPFJwMpkhy2dg8pw9fU_rRJPr8yJ1jNb0JLDm3YkZHukn5xQZIjFti9VAXrBbclPsr5dneysxxw4yEyNAu_ZRVc2xrk7N4Vz_Y162mUBF</recordid><startdate>20230714</startdate><enddate>20230714</enddate><creator>GAO WEI</creator><creator>XU NILIN</creator><creator>YAN XIACHAO</creator><scope>EVB</scope></search><sort><creationdate>20230714</creationdate><title>Multi-head attention mechanism fusion calculation distribution method based on acceleration processor</title><author>GAO WEI ; XU NILIN ; YAN XIACHAO</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN116431562A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2023</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>GAO WEI</creatorcontrib><creatorcontrib>XU NILIN</creatorcontrib><creatorcontrib>YAN XIACHAO</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>GAO WEI</au><au>XU NILIN</au><au>YAN XIACHAO</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Multi-head attention mechanism fusion calculation distribution method based on acceleration processor</title><date>2023-07-14</date><risdate>2023</risdate><abstract>The invention relates to the field of data processing, and discloses a multi-head attention mechanism fusion calculation distribution method based on an acceleration processor, and the method comprises the steps: obtaining slave core information, to-be-processed data in a memory, and a calculation demand of the to-be-processed data; based on the calculation demand and the slave core information, carrying out fusion association on operators of the slave cores to obtain fusion operators and calculation logic corresponding to each fusion operator; and calling the interfaces corresponding to the fusion operators in sequence to start the slave core, so that the slave core calculates the to-be-processed data by using the corresponding operators according to the calculation logic of each fusion operator in sequence to obtain a calculation result. The mode of fusing the operator combination is beneficial to full use of hardware resources, and compared with the situation that only a single operator is processed at the</abstract><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | |
ispartof | |
issn | |
language | chi ; eng |
recordid | cdi_epo_espacenet_CN116431562A |
source | esp@cenet |
subjects | CALCULATING COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS |
title | Multi-head attention mechanism fusion calculation distribution method based on acceleration processor |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-23T15%3A53%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=GAO%20WEI&rft.date=2023-07-14&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN116431562A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |