Interface element positioning method, device and equipment and computer storage medium

The invention discloses an interface element positioning method, device and equipment and a computer storage medium, and relates to the technical field of artificial intelligence. The interface element positioning method comprises the steps of obtaining window information of a target window in a cur...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: XU PEIYING, FU BINGLAN, ZHONG XIANGYONG, HUANG HAO, ZHOU YUN, REN XIAOJUN, LIU CHUNLIN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator XU PEIYING
FU BINGLAN
ZHONG XIANGYONG
HUANG HAO
ZHOU YUN
REN XIAOJUN
LIU CHUNLIN
description The invention discloses an interface element positioning method, device and equipment and a computer storage medium, and relates to the technical field of artificial intelligence. The interface element positioning method comprises the steps of obtaining window information of a target window in a current display interface, wherein the target window information comprises a target window screenshot; the target window comprises a target element; and matching the target window screenshot with a target element screenshot of the target element in a target process file through a machine vision image processing technology, and determining an element coordinate of the target element. According to the embodiment of the invention, the problems of network bandwidth occupation, time delay and the like can be effectively avoided, and element positioning can be carried out without being influenced by a network environment. 本申请公开了一种界面元素定位方法、装置、设备及计算机存储介质,涉及人工智能技术领域。该界面元素定位方法包括:获取当前显示界面中的目标窗口的窗口信息,所述目标窗口信息包括目标窗口截图;所述目标窗口中包括目标元
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN116188566A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN116188566A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN116188566A3</originalsourceid><addsrcrecordid>eNqNjbEKwjAURbM4iPoPz12HIoauUhRdnMS1hOa2PmjyYpP4_UbxA5wuF865d67uF58w9aYDYYSDTxQkcmLx7AdySA-xG7J4cUGMt4Rn5vAFP60TF3JZoJhkMgOKYTm7pZr1ZoxY_XKh1qfjrTlvEaRFDOXPI7XNtap0Vdd7rQ-7f5g3Tvo5_w</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Interface element positioning method, device and equipment and computer storage medium</title><source>esp@cenet</source><creator>XU PEIYING ; FU BINGLAN ; ZHONG XIANGYONG ; HUANG HAO ; ZHOU YUN ; REN XIAOJUN ; LIU CHUNLIN</creator><creatorcontrib>XU PEIYING ; FU BINGLAN ; ZHONG XIANGYONG ; HUANG HAO ; ZHOU YUN ; REN XIAOJUN ; LIU CHUNLIN</creatorcontrib><description>The invention discloses an interface element positioning method, device and equipment and a computer storage medium, and relates to the technical field of artificial intelligence. The interface element positioning method comprises the steps of obtaining window information of a target window in a current display interface, wherein the target window information comprises a target window screenshot; the target window comprises a target element; and matching the target window screenshot with a target element screenshot of the target element in a target process file through a machine vision image processing technology, and determining an element coordinate of the target element. According to the embodiment of the invention, the problems of network bandwidth occupation, time delay and the like can be effectively avoided, and element positioning can be carried out without being influenced by a network environment. 本申请公开了一种界面元素定位方法、装置、设备及计算机存储介质,涉及人工智能技术领域。该界面元素定位方法包括:获取当前显示界面中的目标窗口的窗口信息,所述目标窗口信息包括目标窗口截图;所述目标窗口中包括目标元</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTING ; COUNTING ; DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES ; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ; PHYSICS ; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR</subject><creationdate>2023</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20230530&amp;DB=EPODOC&amp;CC=CN&amp;NR=116188566A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20230530&amp;DB=EPODOC&amp;CC=CN&amp;NR=116188566A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>XU PEIYING</creatorcontrib><creatorcontrib>FU BINGLAN</creatorcontrib><creatorcontrib>ZHONG XIANGYONG</creatorcontrib><creatorcontrib>HUANG HAO</creatorcontrib><creatorcontrib>ZHOU YUN</creatorcontrib><creatorcontrib>REN XIAOJUN</creatorcontrib><creatorcontrib>LIU CHUNLIN</creatorcontrib><title>Interface element positioning method, device and equipment and computer storage medium</title><description>The invention discloses an interface element positioning method, device and equipment and a computer storage medium, and relates to the technical field of artificial intelligence. The interface element positioning method comprises the steps of obtaining window information of a target window in a current display interface, wherein the target window information comprises a target window screenshot; the target window comprises a target element; and matching the target window screenshot with a target element screenshot of the target element in a target process file through a machine vision image processing technology, and determining an element coordinate of the target element. According to the embodiment of the invention, the problems of network bandwidth occupation, time delay and the like can be effectively avoided, and element positioning can be carried out without being influenced by a network environment. 本申请公开了一种界面元素定位方法、装置、设备及计算机存储介质,涉及人工智能技术领域。该界面元素定位方法包括:获取当前显示界面中的目标窗口的窗口信息,所述目标窗口信息包括目标窗口截图;所述目标窗口中包括目标元</description><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES</subject><subject>IMAGE DATA PROCESSING OR GENERATION, IN GENERAL</subject><subject>PHYSICS</subject><subject>SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2023</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNjbEKwjAURbM4iPoPz12HIoauUhRdnMS1hOa2PmjyYpP4_UbxA5wuF865d67uF58w9aYDYYSDTxQkcmLx7AdySA-xG7J4cUGMt4Rn5vAFP60TF3JZoJhkMgOKYTm7pZr1ZoxY_XKh1qfjrTlvEaRFDOXPI7XNtap0Vdd7rQ-7f5g3Tvo5_w</recordid><startdate>20230530</startdate><enddate>20230530</enddate><creator>XU PEIYING</creator><creator>FU BINGLAN</creator><creator>ZHONG XIANGYONG</creator><creator>HUANG HAO</creator><creator>ZHOU YUN</creator><creator>REN XIAOJUN</creator><creator>LIU CHUNLIN</creator><scope>EVB</scope></search><sort><creationdate>20230530</creationdate><title>Interface element positioning method, device and equipment and computer storage medium</title><author>XU PEIYING ; FU BINGLAN ; ZHONG XIANGYONG ; HUANG HAO ; ZHOU YUN ; REN XIAOJUN ; LIU CHUNLIN</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN116188566A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2023</creationdate><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES</topic><topic>IMAGE DATA PROCESSING OR GENERATION, IN GENERAL</topic><topic>PHYSICS</topic><topic>SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR</topic><toplevel>online_resources</toplevel><creatorcontrib>XU PEIYING</creatorcontrib><creatorcontrib>FU BINGLAN</creatorcontrib><creatorcontrib>ZHONG XIANGYONG</creatorcontrib><creatorcontrib>HUANG HAO</creatorcontrib><creatorcontrib>ZHOU YUN</creatorcontrib><creatorcontrib>REN XIAOJUN</creatorcontrib><creatorcontrib>LIU CHUNLIN</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>XU PEIYING</au><au>FU BINGLAN</au><au>ZHONG XIANGYONG</au><au>HUANG HAO</au><au>ZHOU YUN</au><au>REN XIAOJUN</au><au>LIU CHUNLIN</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Interface element positioning method, device and equipment and computer storage medium</title><date>2023-05-30</date><risdate>2023</risdate><abstract>The invention discloses an interface element positioning method, device and equipment and a computer storage medium, and relates to the technical field of artificial intelligence. The interface element positioning method comprises the steps of obtaining window information of a target window in a current display interface, wherein the target window information comprises a target window screenshot; the target window comprises a target element; and matching the target window screenshot with a target element screenshot of the target element in a target process file through a machine vision image processing technology, and determining an element coordinate of the target element. According to the embodiment of the invention, the problems of network bandwidth occupation, time delay and the like can be effectively avoided, and element positioning can be carried out without being influenced by a network environment. 本申请公开了一种界面元素定位方法、装置、设备及计算机存储介质,涉及人工智能技术领域。该界面元素定位方法包括:获取当前显示界面中的目标窗口的窗口信息,所述目标窗口信息包括目标窗口截图;所述目标窗口中包括目标元</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language chi ; eng
recordid cdi_epo_espacenet_CN116188566A
source esp@cenet
subjects CALCULATING
COMPUTING
COUNTING
DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES
IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
PHYSICS
SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR
title Interface element positioning method, device and equipment and computer storage medium
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-30T19%3A25%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=XU%20PEIYING&rft.date=2023-05-30&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN116188566A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true