Multi-modal map construction method and device, information processing method and device, electronic equipment and medium
The invention provides a multi-modal graph construction method and device, an information processing method and device, electronic equipment and a medium, and relates to the technical field of artificial intelligence, in particular to the technical field of knowledge graphs, natural language process...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | XIAO JUNWEN |
description | The invention provides a multi-modal graph construction method and device, an information processing method and device, electronic equipment and a medium, and relates to the technical field of artificial intelligence, in particular to the technical field of knowledge graphs, natural language processing, computer vision and deep learning. According to the specific implementation scheme, a visual knowledge graph is constructed according to image information of a scene chart; constructing a text knowledge graph according to the text information of the scene chart; constructing a first intermediate multi-modal knowledge graph according to the visual knowledge graph and the text knowledge graph; the first intermediate multi-modal knowledge graph is processed according to similarity relation information, a target multi-modal knowledge graph is obtained, and the similarity relation information represents relation information of at least one of an equivalence relation and an inclusion relation between the two objects |
format | Patent |
fullrecord | <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN116244447A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN116244447A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN116244447A3</originalsourceid><addsrcrecordid>eNqNyrsKwkAQheE0FqK-w9ibIipaS1BstLIPy-zEDOzOrHsRfHslWFp4mr8437R6XYrLXHu1xoE3AVAl5Vgwswp4yoNaMGLB0pORVsDSa_RmvENUpJRY7r8kOcIcVRiBHoWDJ8kj8GS5-Hk16Y1LtPh2Vi1Px1t7riloRykYJKHctdem2a23n-0Pm3_MG0JgRwc</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Multi-modal map construction method and device, information processing method and device, electronic equipment and medium</title><source>esp@cenet</source><creator>XIAO JUNWEN</creator><creatorcontrib>XIAO JUNWEN</creatorcontrib><description>The invention provides a multi-modal graph construction method and device, an information processing method and device, electronic equipment and a medium, and relates to the technical field of artificial intelligence, in particular to the technical field of knowledge graphs, natural language processing, computer vision and deep learning. According to the specific implementation scheme, a visual knowledge graph is constructed according to image information of a scene chart; constructing a text knowledge graph according to the text information of the scene chart; constructing a first intermediate multi-modal knowledge graph according to the visual knowledge graph and the text knowledge graph; the first intermediate multi-modal knowledge graph is processed according to similarity relation information, a target multi-modal knowledge graph is obtained, and the similarity relation information represents relation information of at least one of an equivalence relation and an inclusion relation between the two objects</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2023</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20230609&DB=EPODOC&CC=CN&NR=116244447A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,777,882,25545,76296</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20230609&DB=EPODOC&CC=CN&NR=116244447A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>XIAO JUNWEN</creatorcontrib><title>Multi-modal map construction method and device, information processing method and device, electronic equipment and medium</title><description>The invention provides a multi-modal graph construction method and device, an information processing method and device, electronic equipment and a medium, and relates to the technical field of artificial intelligence, in particular to the technical field of knowledge graphs, natural language processing, computer vision and deep learning. According to the specific implementation scheme, a visual knowledge graph is constructed according to image information of a scene chart; constructing a text knowledge graph according to the text information of the scene chart; constructing a first intermediate multi-modal knowledge graph according to the visual knowledge graph and the text knowledge graph; the first intermediate multi-modal knowledge graph is processed according to similarity relation information, a target multi-modal knowledge graph is obtained, and the similarity relation information represents relation information of at least one of an equivalence relation and an inclusion relation between the two objects</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2023</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNyrsKwkAQheE0FqK-w9ibIipaS1BstLIPy-zEDOzOrHsRfHslWFp4mr8437R6XYrLXHu1xoE3AVAl5Vgwswp4yoNaMGLB0pORVsDSa_RmvENUpJRY7r8kOcIcVRiBHoWDJ8kj8GS5-Hk16Y1LtPh2Vi1Px1t7riloRykYJKHctdem2a23n-0Pm3_MG0JgRwc</recordid><startdate>20230609</startdate><enddate>20230609</enddate><creator>XIAO JUNWEN</creator><scope>EVB</scope></search><sort><creationdate>20230609</creationdate><title>Multi-modal map construction method and device, information processing method and device, electronic equipment and medium</title><author>XIAO JUNWEN</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN116244447A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2023</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>XIAO JUNWEN</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>XIAO JUNWEN</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Multi-modal map construction method and device, information processing method and device, electronic equipment and medium</title><date>2023-06-09</date><risdate>2023</risdate><abstract>The invention provides a multi-modal graph construction method and device, an information processing method and device, electronic equipment and a medium, and relates to the technical field of artificial intelligence, in particular to the technical field of knowledge graphs, natural language processing, computer vision and deep learning. According to the specific implementation scheme, a visual knowledge graph is constructed according to image information of a scene chart; constructing a text knowledge graph according to the text information of the scene chart; constructing a first intermediate multi-modal knowledge graph according to the visual knowledge graph and the text knowledge graph; the first intermediate multi-modal knowledge graph is processed according to similarity relation information, a target multi-modal knowledge graph is obtained, and the similarity relation information represents relation information of at least one of an equivalence relation and an inclusion relation between the two objects</abstract><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | |
ispartof | |
issn | |
language | chi ; eng |
recordid | cdi_epo_espacenet_CN116244447A |
source | esp@cenet |
subjects | CALCULATING COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS |
title | Multi-modal map construction method and device, information processing method and device, electronic equipment and medium |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-17T23%3A30%3A06IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=XIAO%20JUNWEN&rft.date=2023-06-09&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN116244447A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |