Data management method, corresponding device and system

The invention discloses a data management method which can be applied to a database system, such as a vector database system. According to the method, the data in the disk can be recorded through the index map in the memory, so that when the variable data (newly added data, data to be updated or dat...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHANG QINTAO, YAO JIAJIE, ZHOU ZIQIU
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator ZHANG QINTAO
YAO JIAJIE
ZHOU ZIQIU
description The invention discloses a data management method which can be applied to a database system, such as a vector database system. According to the method, the data in the disk can be recorded through the index map in the memory, so that when the variable data (newly added data, data to be updated or data to be deleted) exists, only the index information associated with the variable data needs to be determined according to the index map, and the index information associated with the variable data is serialized into the disk from the memory. According to the method, merging from the memory index to the disk index in the serialization process is not needed, so that the serialization speed can be increased, the memory can be quickly unlocked, and the performance of a database system is improved. 本申请公开了一种数据管理方法,可以应用于数据库系统,例如:向量数据库系统。该方法可以通过内存中的索引图来记录磁盘中的数据,这样,当有变量数据(新增数据、待更新数据或有待删除数据)时,只需要根据索引图确定变量数据关联的索引信息,将该变量数据关联的索引信息从内存序列化到磁盘中即可。不需要在序列化的过程中做从内存索引到磁盘索引的合并,可以提高序列化的速度,进而可以快速解锁内存,提高了数据库系统的性能。
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN118277357A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN118277357A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN118277357A3</originalsourceid><addsrcrecordid>eNrjZDB3SSxJVMhNzEtMT81NzStRyE0tychP0VFIzi8qSi0uyM9LycxLV0hJLctMTlVIzEtRKK4sLknN5WFgTUvMKU7lhdLcDIpuriHOHrqpBfnxQH2Jyal5qSXxzn6GhhZG5ubGpuaOxsSoAQDOmC35</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Data management method, corresponding device and system</title><source>esp@cenet</source><creator>ZHANG QINTAO ; YAO JIAJIE ; ZHOU ZIQIU</creator><creatorcontrib>ZHANG QINTAO ; YAO JIAJIE ; ZHOU ZIQIU</creatorcontrib><description>The invention discloses a data management method which can be applied to a database system, such as a vector database system. According to the method, the data in the disk can be recorded through the index map in the memory, so that when the variable data (newly added data, data to be updated or data to be deleted) exists, only the index information associated with the variable data needs to be determined according to the index map, and the index information associated with the variable data is serialized into the disk from the memory. According to the method, merging from the memory index to the disk index in the serialization process is not needed, so that the serialization speed can be increased, the memory can be quickly unlocked, and the performance of a database system is improved. 本申请公开了一种数据管理方法,可以应用于数据库系统,例如:向量数据库系统。该方法可以通过内存中的索引图来记录磁盘中的数据,这样,当有变量数据(新增数据、待更新数据或有待删除数据)时,只需要根据索引图确定变量数据关联的索引信息,将该变量数据关联的索引信息从内存序列化到磁盘中即可。不需要在序列化的过程中做从内存索引到磁盘索引的合并,可以提高序列化的速度,进而可以快速解锁内存,提高了数据库系统的性能。</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2024</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20240702&amp;DB=EPODOC&amp;CC=CN&amp;NR=118277357A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,309,781,886,25566,76549</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20240702&amp;DB=EPODOC&amp;CC=CN&amp;NR=118277357A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>ZHANG QINTAO</creatorcontrib><creatorcontrib>YAO JIAJIE</creatorcontrib><creatorcontrib>ZHOU ZIQIU</creatorcontrib><title>Data management method, corresponding device and system</title><description>The invention discloses a data management method which can be applied to a database system, such as a vector database system. According to the method, the data in the disk can be recorded through the index map in the memory, so that when the variable data (newly added data, data to be updated or data to be deleted) exists, only the index information associated with the variable data needs to be determined according to the index map, and the index information associated with the variable data is serialized into the disk from the memory. According to the method, merging from the memory index to the disk index in the serialization process is not needed, so that the serialization speed can be increased, the memory can be quickly unlocked, and the performance of a database system is improved. 本申请公开了一种数据管理方法,可以应用于数据库系统,例如:向量数据库系统。该方法可以通过内存中的索引图来记录磁盘中的数据,这样,当有变量数据(新增数据、待更新数据或有待删除数据)时,只需要根据索引图确定变量数据关联的索引信息,将该变量数据关联的索引信息从内存序列化到磁盘中即可。不需要在序列化的过程中做从内存索引到磁盘索引的合并,可以提高序列化的速度,进而可以快速解锁内存,提高了数据库系统的性能。</description><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2024</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZDB3SSxJVMhNzEtMT81NzStRyE0tychP0VFIzi8qSi0uyM9LycxLV0hJLctMTlVIzEtRKK4sLknN5WFgTUvMKU7lhdLcDIpuriHOHrqpBfnxQH2Jyal5qSXxzn6GhhZG5ubGpuaOxsSoAQDOmC35</recordid><startdate>20240702</startdate><enddate>20240702</enddate><creator>ZHANG QINTAO</creator><creator>YAO JIAJIE</creator><creator>ZHOU ZIQIU</creator><scope>EVB</scope></search><sort><creationdate>20240702</creationdate><title>Data management method, corresponding device and system</title><author>ZHANG QINTAO ; YAO JIAJIE ; ZHOU ZIQIU</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN118277357A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2024</creationdate><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>ZHANG QINTAO</creatorcontrib><creatorcontrib>YAO JIAJIE</creatorcontrib><creatorcontrib>ZHOU ZIQIU</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>ZHANG QINTAO</au><au>YAO JIAJIE</au><au>ZHOU ZIQIU</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Data management method, corresponding device and system</title><date>2024-07-02</date><risdate>2024</risdate><abstract>The invention discloses a data management method which can be applied to a database system, such as a vector database system. According to the method, the data in the disk can be recorded through the index map in the memory, so that when the variable data (newly added data, data to be updated or data to be deleted) exists, only the index information associated with the variable data needs to be determined according to the index map, and the index information associated with the variable data is serialized into the disk from the memory. According to the method, merging from the memory index to the disk index in the serialization process is not needed, so that the serialization speed can be increased, the memory can be quickly unlocked, and the performance of a database system is improved. 本申请公开了一种数据管理方法,可以应用于数据库系统,例如:向量数据库系统。该方法可以通过内存中的索引图来记录磁盘中的数据,这样,当有变量数据(新增数据、待更新数据或有待删除数据)时,只需要根据索引图确定变量数据关联的索引信息,将该变量数据关联的索引信息从内存序列化到磁盘中即可。不需要在序列化的过程中做从内存索引到磁盘索引的合并,可以提高序列化的速度,进而可以快速解锁内存,提高了数据库系统的性能。</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language chi ; eng
recordid cdi_epo_espacenet_CN118277357A
source esp@cenet
subjects CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
title Data management method, corresponding device and system
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-18T08%3A26%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=ZHANG%20QINTAO&rft.date=2024-07-02&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN118277357A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true