Data set cache processing method, device and system

Data set cache processing method, device and system

The invention provides a data set cache processing method, device and system, belongs to the technical field of data processing, and solves the problems that in the prior art, an AIStation V2.1 version data set node cache mode is imperfect in design, so that when multiple users concurrently pull sma...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: FANG XUEJING
Format: Patent
Sprache:chi ; eng
Schlagworte:
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator FANG XUEJING
description The invention provides a data set cache processing method, device and system, belongs to the technical field of data processing, and solves the problems that in the prior art, an AIStation V2.1 version data set node cache mode is imperfect in design, so that when multiple users concurrently pull small files and large data sets, the performance is low, and the user experience is poor. And an alarmis generated because the pressure on the system is too large. The method comprises the steps of initializing a container in a Pod, caching data sets according to task requests, judging whether the data sets are caching requests sent by the same user or not, and if the data sets are different data sets cached by the same task of the same user, executing caching in a sequential queuing mode. According to the method, the technical problem of jamming caused by frequent restart of the initcontainer is solved, data set uniqueness verification is increased, performance consumption caused by repeatedcaching of the same data s
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN112181290A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN112181290A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN112181290A3</originalsourceid><addsrcrecordid>eNrjZDB2SSxJVChOLVFITkzOSFUoKMpPTi0uzsxLV8hNLcnIT9FRSEkty0xOVUjMS1EoriwuSc3lYWBNS8wpTuWF0twMim6uIc4euqkF-fGpxQWJyal5qSXxzn6GhkaGFoZGlgaOxsSoAQC7iyvY</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Data set cache processing method, device and system</title><source>esp@cenet</source><creator>FANG XUEJING</creator><creatorcontrib>FANG XUEJING</creatorcontrib><description>The invention provides a data set cache processing method, device and system, belongs to the technical field of data processing, and solves the problems that in the prior art, an AIStation V2.1 version data set node cache mode is imperfect in design, so that when multiple users concurrently pull small files and large data sets, the performance is low, and the user experience is poor. And an alarmis generated because the pressure on the system is too large. The method comprises the steps of initializing a container in a Pod, caching data sets according to task requests, judging whether the data sets are caching requests sent by the same user or not, and if the data sets are different data sets cached by the same task of the same user, executing caching in a sequential queuing mode. According to the method, the technical problem of jamming caused by frequent restart of the initcontainer is solved, data set uniqueness verification is increased, performance consumption caused by repeatedcaching of the same data s</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2021</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20210105&amp;DB=EPODOC&amp;CC=CN&amp;NR=112181290A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,778,883,25551,76302</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20210105&amp;DB=EPODOC&amp;CC=CN&amp;NR=112181290A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>FANG XUEJING</creatorcontrib><title>Data set cache processing method, device and system</title><description>The invention provides a data set cache processing method, device and system, belongs to the technical field of data processing, and solves the problems that in the prior art, an AIStation V2.1 version data set node cache mode is imperfect in design, so that when multiple users concurrently pull small files and large data sets, the performance is low, and the user experience is poor. And an alarmis generated because the pressure on the system is too large. The method comprises the steps of initializing a container in a Pod, caching data sets according to task requests, judging whether the data sets are caching requests sent by the same user or not, and if the data sets are different data sets cached by the same task of the same user, executing caching in a sequential queuing mode. According to the method, the technical problem of jamming caused by frequent restart of the initcontainer is solved, data set uniqueness verification is increased, performance consumption caused by repeatedcaching of the same data s</description><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2021</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZDB2SSxJVChOLVFITkzOSFUoKMpPTi0uzsxLV8hNLcnIT9FRSEkty0xOVUjMS1EoriwuSc3lYWBNS8wpTuWF0twMim6uIc4euqkF-fGpxQWJyal5qSXxzn6GhkaGFoZGlgaOxsSoAQC7iyvY</recordid><startdate>20210105</startdate><enddate>20210105</enddate><creator>FANG XUEJING</creator><scope>EVB</scope></search><sort><creationdate>20210105</creationdate><title>Data set cache processing method, device and system</title><author>FANG XUEJING</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN112181290A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2021</creationdate><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>FANG XUEJING</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>FANG XUEJING</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Data set cache processing method, device and system</title><date>2021-01-05</date><risdate>2021</risdate><abstract>The invention provides a data set cache processing method, device and system, belongs to the technical field of data processing, and solves the problems that in the prior art, an AIStation V2.1 version data set node cache mode is imperfect in design, so that when multiple users concurrently pull small files and large data sets, the performance is low, and the user experience is poor. And an alarmis generated because the pressure on the system is too large. The method comprises the steps of initializing a container in a Pod, caching data sets according to task requests, judging whether the data sets are caching requests sent by the same user or not, and if the data sets are different data sets cached by the same task of the same user, executing caching in a sequential queuing mode. According to the method, the technical problem of jamming caused by frequent restart of the initcontainer is solved, data set uniqueness verification is increased, performance consumption caused by repeatedcaching of the same data s</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language chi ; eng
recordid cdi_epo_espacenet_CN112181290A
source esp@cenet
subjects CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
title Data set cache processing method, device and system
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T01%3A58%3A20IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=FANG%20XUEJING&rft.date=2021-01-05&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN112181290A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true