Task execution based on real-world text detection for assistant systems
In one embodiment, a method includes accessing a visual signal including an image from a client system associated with a first user, the image depicting textual content in a real-world environment associated with the first user; identifying the text content based on a machine learning model and a vi...
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Patent |
| Sprache: | chi ; eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | |
|---|---|
| container_issue | |
| container_start_page | |
| container_title | |
| container_volume | |
| creator | CHEN YUANHUI WIGDOR DANIEL JOHN JUNJUNWALA, MIKA BELLMAN AMY LAWSON FLORES NICHOLAS JORGE GAN XIN LIU BING VENKATESH, GANESH HILAIRE LLOYD DABAS, LUOXIN LIU BAIYANG HANSEN MICHAEL ROBERT MOON, SEUNG HWAN CUI ZHENHUA MALIK, KASHTIZ ZHOU HAO KITCHENS JESSICA CHALLAND CHRISTOPHE BALMES CHRISTOPHER E GURUNATH PRAMOD GRAVES IAN YU JINSONG ZUO ZHENGPING SAVENKOV DENIS DANE, JUSTIN DE PAOLI, CHRISTOPHE DILLAFSON, ALIREZA SURKOV ALEXEY GENNADIEVICH ARCH, KYLE XU HU GLUCK MICHAEL NORTHUP ERIC ROBERT BLAKELY JOHN JACOB MARTINSEN LEIF HAVEN SHALOWITZ, ILANA, ORLY SRINIVAS, KRISHNA, CHAITANYA, GOPISETTY MOSKEY GABRIEL CATHERINE SETHI, PUJA WU KUAN-HUEI JEFFREY PARENT MARK SANTORO ELIZABETH KELSEY GOEL, SWATI KAHN JEREMY GILMORE PU YIMING LIU HONGLEI MATTHEW DAN FAZLEY TIWARI MEGA SANTOSA, STEPHANIE SRIVASTAVA RUCHIR KAMKAR, PIYUSH MOHAMED AHMED MAGADI HAMID LI JIHANG VINCENT JOSHUA RACINE JACKSON |
| description | In one embodiment, a method includes accessing a visual signal including an image from a client system associated with a first user, the image depicting textual content in a real-world environment associated with the first user; identifying the text content based on a machine learning model and a visual signal; determining a context associated with the first user about a real-world environment based on the visual signal; executing a task for the first user, the task being determined based on the text content and the determined context; and sending an instruction to the client system for presenting the execution result of the task to the first user.
在一个实施例中，一种方法包括从与第一用户相关联的客户端系统访问包括图像的视觉信号，所述图像描绘了与第一用户相关联的真实世界环境中的文本内容；基于机器学习模型和视觉信号识别该文本内容；基于视觉信号确定与第一用户相关联的关于真实世界环境的上下文；为第一用户执行任务，所述任务是基于文本内容和所确定的上下文而确定的；以及向客户端系统发送用于向第一用户呈现任务的执行结果的指令。 |
| format | Patent |
| fullrecord | <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN117396838A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN117396838A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN117396838A3</originalsourceid><addsrcrecordid>eNrjZHAPSSzOVkitSE0uLcnMz1NISixOTVEAMopSE3N0y_OLclIUSlIrShRSUktSk8FK0vKLFBKLizOLSxLzShSKK4tLUnOLeRhY0xJzilN5oTQ3g6Kba4izh25qQX58anFBYnJqXmpJvLOfoaG5saWZhbGFozExagCHpjRj</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Task execution based on real-world text detection for assistant systems</title><source>esp@cenet</source><creator>CHEN YUANHUI ; WIGDOR DANIEL JOHN ; JUNJUNWALA, MIKA ; BELLMAN AMY LAWSON ; FLORES NICHOLAS JORGE ; GAN XIN ; LIU BING ; VENKATESH, GANESH ; HILAIRE LLOYD ; DABAS, LUOXIN ; LIU BAIYANG ; HANSEN MICHAEL ROBERT ; MOON, SEUNG HWAN ; CUI ZHENHUA ; MALIK, KASHTIZ ; ZHOU HAO ; KITCHENS JESSICA ; CHALLAND CHRISTOPHE ; BALMES CHRISTOPHER E ; GURUNATH PRAMOD ; GRAVES IAN ; YU JINSONG ; ZUO ZHENGPING ; SAVENKOV DENIS ; DANE, JUSTIN ; DE PAOLI, CHRISTOPHE ; DILLAFSON, ALIREZA ; SURKOV ALEXEY GENNADIEVICH ; ARCH, KYLE ; XU HU ; GLUCK MICHAEL ; NORTHUP ERIC ROBERT ; BLAKELY JOHN JACOB ; MARTINSEN LEIF HAVEN ; SHALOWITZ, ILANA, ORLY ; SRINIVAS, KRISHNA, CHAITANYA, GOPISETTY ; MOSKEY GABRIEL CATHERINE ; SETHI, PUJA ; WU KUAN-HUEI JEFFREY ; PARENT MARK ; SANTORO ELIZABETH KELSEY ; GOEL, SWATI ; KAHN JEREMY GILMORE ; PU YIMING ; LIU HONGLEI ; MATTHEW DAN FAZLEY ; TIWARI MEGA ; SANTOSA, STEPHANIE ; SRIVASTAVA RUCHIR ; KAMKAR, PIYUSH ; MOHAMED AHMED MAGADI HAMID ; LI JIHANG ; VINCENT JOSHUA ; RACINE JACKSON</creator><creatorcontrib>CHEN YUANHUI ; WIGDOR DANIEL JOHN ; JUNJUNWALA, MIKA ; BELLMAN AMY LAWSON ; FLORES NICHOLAS JORGE ; GAN XIN ; LIU BING ; VENKATESH, GANESH ; HILAIRE LLOYD ; DABAS, LUOXIN ; LIU BAIYANG ; HANSEN MICHAEL ROBERT ; MOON, SEUNG HWAN ; CUI ZHENHUA ; MALIK, KASHTIZ ; ZHOU HAO ; KITCHENS JESSICA ; CHALLAND CHRISTOPHE ; BALMES CHRISTOPHER E ; GURUNATH PRAMOD ; GRAVES IAN ; YU JINSONG ; ZUO ZHENGPING ; SAVENKOV DENIS ; DANE, JUSTIN ; DE PAOLI, CHRISTOPHE ; DILLAFSON, ALIREZA ; SURKOV ALEXEY GENNADIEVICH ; ARCH, KYLE ; XU HU ; GLUCK MICHAEL ; NORTHUP ERIC ROBERT ; BLAKELY JOHN JACOB ; MARTINSEN LEIF HAVEN ; SHALOWITZ, ILANA, ORLY ; SRINIVAS, KRISHNA, CHAITANYA, GOPISETTY ; MOSKEY GABRIEL CATHERINE ; SETHI, PUJA ; WU KUAN-HUEI JEFFREY ; PARENT MARK ; SANTORO ELIZABETH KELSEY ; GOEL, SWATI ; KAHN JEREMY GILMORE ; PU YIMING ; LIU HONGLEI ; MATTHEW DAN FAZLEY ; TIWARI MEGA ; SANTOSA, STEPHANIE ; SRIVASTAVA RUCHIR ; KAMKAR, PIYUSH ; MOHAMED AHMED MAGADI HAMID ; LI JIHANG ; VINCENT JOSHUA ; RACINE JACKSON</creatorcontrib><description>In one embodiment, a method includes accessing a visual signal including an image from a client system associated with a first user, the image depicting textual content in a real-world environment associated with the first user; identifying the text content based on a machine learning model and a visual signal; determining a context associated with the first user about a real-world environment based on the visual signal; executing a task for the first user, the task being determined based on the text content and the determined context; and sending an instruction to the client system for presenting the execution result of the task to the first user.
在一个实施例中，一种方法包括从与第一用户相关联的客户端系统访问包括图像的视觉信号，所述图像描绘了与第一用户相关联的真实世界环境中的文本内容；基于机器学习模型和视觉信号识别该文本内容；基于视觉信号确定与第一用户相关联的关于真实世界环境的上下文；为第一用户执行任务，所述任务是基于文本内容和所确定的上下文而确定的；以及向客户端系统发送用于向第一用户呈现任务的执行结果的指令。</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2024</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20240112&DB=EPODOC&CC=CN&NR=117396838A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,776,881,25542,76516</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20240112&DB=EPODOC&CC=CN&NR=117396838A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>CHEN YUANHUI</creatorcontrib><creatorcontrib>WIGDOR DANIEL JOHN</creatorcontrib><creatorcontrib>JUNJUNWALA, MIKA</creatorcontrib><creatorcontrib>BELLMAN AMY LAWSON</creatorcontrib><creatorcontrib>FLORES NICHOLAS JORGE</creatorcontrib><creatorcontrib>GAN XIN</creatorcontrib><creatorcontrib>LIU BING</creatorcontrib><creatorcontrib>VENKATESH, GANESH</creatorcontrib><creatorcontrib>HILAIRE LLOYD</creatorcontrib><creatorcontrib>DABAS, LUOXIN</creatorcontrib><creatorcontrib>LIU BAIYANG</creatorcontrib><creatorcontrib>HANSEN MICHAEL ROBERT</creatorcontrib><creatorcontrib>MOON, SEUNG HWAN</creatorcontrib><creatorcontrib>CUI ZHENHUA</creatorcontrib><creatorcontrib>MALIK, KASHTIZ</creatorcontrib><creatorcontrib>ZHOU HAO</creatorcontrib><creatorcontrib>KITCHENS JESSICA</creatorcontrib><creatorcontrib>CHALLAND CHRISTOPHE</creatorcontrib><creatorcontrib>BALMES CHRISTOPHER E</creatorcontrib><creatorcontrib>GURUNATH PRAMOD</creatorcontrib><creatorcontrib>GRAVES IAN</creatorcontrib><creatorcontrib>YU JINSONG</creatorcontrib><creatorcontrib>ZUO ZHENGPING</creatorcontrib><creatorcontrib>SAVENKOV DENIS</creatorcontrib><creatorcontrib>DANE, JUSTIN</creatorcontrib><creatorcontrib>DE PAOLI, CHRISTOPHE</creatorcontrib><creatorcontrib>DILLAFSON, ALIREZA</creatorcontrib><creatorcontrib>SURKOV ALEXEY GENNADIEVICH</creatorcontrib><creatorcontrib>ARCH, KYLE</creatorcontrib><creatorcontrib>XU HU</creatorcontrib><creatorcontrib>GLUCK MICHAEL</creatorcontrib><creatorcontrib>NORTHUP ERIC ROBERT</creatorcontrib><creatorcontrib>BLAKELY JOHN JACOB</creatorcontrib><creatorcontrib>MARTINSEN LEIF HAVEN</creatorcontrib><creatorcontrib>SHALOWITZ, ILANA, ORLY</creatorcontrib><creatorcontrib>SRINIVAS, KRISHNA, CHAITANYA, GOPISETTY</creatorcontrib><creatorcontrib>MOSKEY GABRIEL CATHERINE</creatorcontrib><creatorcontrib>SETHI, PUJA</creatorcontrib><creatorcontrib>WU KUAN-HUEI JEFFREY</creatorcontrib><creatorcontrib>PARENT MARK</creatorcontrib><creatorcontrib>SANTORO ELIZABETH KELSEY</creatorcontrib><creatorcontrib>GOEL, SWATI</creatorcontrib><creatorcontrib>KAHN JEREMY GILMORE</creatorcontrib><creatorcontrib>PU YIMING</creatorcontrib><creatorcontrib>LIU HONGLEI</creatorcontrib><creatorcontrib>MATTHEW DAN FAZLEY</creatorcontrib><creatorcontrib>TIWARI MEGA</creatorcontrib><creatorcontrib>SANTOSA, STEPHANIE</creatorcontrib><creatorcontrib>SRIVASTAVA RUCHIR</creatorcontrib><creatorcontrib>KAMKAR, PIYUSH</creatorcontrib><creatorcontrib>MOHAMED AHMED MAGADI HAMID</creatorcontrib><creatorcontrib>LI JIHANG</creatorcontrib><creatorcontrib>VINCENT JOSHUA</creatorcontrib><creatorcontrib>RACINE JACKSON</creatorcontrib><title>Task execution based on real-world text detection for assistant systems</title><description>In one embodiment, a method includes accessing a visual signal including an image from a client system associated with a first user, the image depicting textual content in a real-world environment associated with the first user; identifying the text content based on a machine learning model and a visual signal; determining a context associated with the first user about a real-world environment based on the visual signal; executing a task for the first user, the task being determined based on the text content and the determined context; and sending an instruction to the client system for presenting the execution result of the task to the first user.
在一个实施例中，一种方法包括从与第一用户相关联的客户端系统访问包括图像的视觉信号，所述图像描绘了与第一用户相关联的真实世界环境中的文本内容；基于机器学习模型和视觉信号识别该文本内容；基于视觉信号确定与第一用户相关联的关于真实世界环境的上下文；为第一用户执行任务，所述任务是基于文本内容和所确定的上下文而确定的；以及向客户端系统发送用于向第一用户呈现任务的执行结果的指令。</description><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2024</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZHAPSSzOVkitSE0uLcnMz1NISixOTVEAMopSE3N0y_OLclIUSlIrShRSUktSk8FK0vKLFBKLizOLSxLzShSKK4tLUnOLeRhY0xJzilN5oTQ3g6Kba4izh25qQX58anFBYnJqXmpJvLOfoaG5saWZhbGFozExagCHpjRj</recordid><startdate>20240112</startdate><enddate>20240112</enddate><creator>CHEN YUANHUI</creator><creator>WIGDOR DANIEL JOHN</creator><creator>JUNJUNWALA, MIKA</creator><creator>BELLMAN AMY LAWSON</creator><creator>FLORES NICHOLAS JORGE</creator><creator>GAN XIN</creator><creator>LIU BING</creator><creator>VENKATESH, GANESH</creator><creator>HILAIRE LLOYD</creator><creator>DABAS, LUOXIN</creator><creator>LIU BAIYANG</creator><creator>HANSEN MICHAEL ROBERT</creator><creator>MOON, SEUNG HWAN</creator><creator>CUI ZHENHUA</creator><creator>MALIK, KASHTIZ</creator><creator>ZHOU HAO</creator><creator>KITCHENS JESSICA</creator><creator>CHALLAND CHRISTOPHE</creator><creator>BALMES CHRISTOPHER E</creator><creator>GURUNATH PRAMOD</creator><creator>GRAVES IAN</creator><creator>YU JINSONG</creator><creator>ZUO ZHENGPING</creator><creator>SAVENKOV DENIS</creator><creator>DANE, JUSTIN</creator><creator>DE PAOLI, CHRISTOPHE</creator><creator>DILLAFSON, ALIREZA</creator><creator>SURKOV ALEXEY GENNADIEVICH</creator><creator>ARCH, KYLE</creator><creator>XU HU</creator><creator>GLUCK MICHAEL</creator><creator>NORTHUP ERIC ROBERT</creator><creator>BLAKELY JOHN JACOB</creator><creator>MARTINSEN LEIF HAVEN</creator><creator>SHALOWITZ, ILANA, ORLY</creator><creator>SRINIVAS, KRISHNA, CHAITANYA, GOPISETTY</creator><creator>MOSKEY GABRIEL CATHERINE</creator><creator>SETHI, PUJA</creator><creator>WU KUAN-HUEI JEFFREY</creator><creator>PARENT MARK</creator><creator>SANTORO ELIZABETH KELSEY</creator><creator>GOEL, SWATI</creator><creator>KAHN JEREMY GILMORE</creator><creator>PU YIMING</creator><creator>LIU HONGLEI</creator><creator>MATTHEW DAN FAZLEY</creator><creator>TIWARI MEGA</creator><creator>SANTOSA, STEPHANIE</creator><creator>SRIVASTAVA RUCHIR</creator><creator>KAMKAR, PIYUSH</creator><creator>MOHAMED AHMED MAGADI HAMID</creator><creator>LI JIHANG</creator><creator>VINCENT JOSHUA</creator><creator>RACINE JACKSON</creator><scope>EVB</scope></search><sort><creationdate>20240112</creationdate><title>Task execution based on real-world text detection for assistant systems</title><author>CHEN YUANHUI ; WIGDOR DANIEL JOHN ; JUNJUNWALA, MIKA ; BELLMAN AMY LAWSON ; FLORES NICHOLAS JORGE ; GAN XIN ; LIU BING ; VENKATESH, GANESH ; HILAIRE LLOYD ; DABAS, LUOXIN ; LIU BAIYANG ; HANSEN MICHAEL ROBERT ; MOON, SEUNG HWAN ; CUI ZHENHUA ; MALIK, KASHTIZ ; ZHOU HAO ; KITCHENS JESSICA ; CHALLAND CHRISTOPHE ; BALMES CHRISTOPHER E ; GURUNATH PRAMOD ; GRAVES IAN ; YU JINSONG ; ZUO ZHENGPING ; SAVENKOV DENIS ; DANE, JUSTIN ; DE PAOLI, CHRISTOPHE ; DILLAFSON, ALIREZA ; SURKOV ALEXEY GENNADIEVICH ; ARCH, KYLE ; XU HU ; GLUCK MICHAEL ; NORTHUP ERIC ROBERT ; BLAKELY JOHN JACOB ; MARTINSEN LEIF HAVEN ; SHALOWITZ, ILANA, ORLY ; SRINIVAS, KRISHNA, CHAITANYA, GOPISETTY ; MOSKEY GABRIEL CATHERINE ; SETHI, PUJA ; WU KUAN-HUEI JEFFREY ; PARENT MARK ; SANTORO ELIZABETH KELSEY ; GOEL, SWATI ; KAHN JEREMY GILMORE ; PU YIMING ; LIU HONGLEI ; MATTHEW DAN FAZLEY ; TIWARI MEGA ; SANTOSA, STEPHANIE ; SRIVASTAVA RUCHIR ; KAMKAR, PIYUSH ; MOHAMED AHMED MAGADI HAMID ; LI JIHANG ; VINCENT JOSHUA ; RACINE JACKSON</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN117396838A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2024</creationdate><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>CHEN YUANHUI</creatorcontrib><creatorcontrib>WIGDOR DANIEL JOHN</creatorcontrib><creatorcontrib>JUNJUNWALA, MIKA</creatorcontrib><creatorcontrib>BELLMAN AMY LAWSON</creatorcontrib><creatorcontrib>FLORES NICHOLAS JORGE</creatorcontrib><creatorcontrib>GAN XIN</creatorcontrib><creatorcontrib>LIU BING</creatorcontrib><creatorcontrib>VENKATESH, GANESH</creatorcontrib><creatorcontrib>HILAIRE LLOYD</creatorcontrib><creatorcontrib>DABAS, LUOXIN</creatorcontrib><creatorcontrib>LIU BAIYANG</creatorcontrib><creatorcontrib>HANSEN MICHAEL ROBERT</creatorcontrib><creatorcontrib>MOON, SEUNG HWAN</creatorcontrib><creatorcontrib>CUI ZHENHUA</creatorcontrib><creatorcontrib>MALIK, KASHTIZ</creatorcontrib><creatorcontrib>ZHOU HAO</creatorcontrib><creatorcontrib>KITCHENS JESSICA</creatorcontrib><creatorcontrib>CHALLAND CHRISTOPHE</creatorcontrib><creatorcontrib>BALMES CHRISTOPHER E</creatorcontrib><creatorcontrib>GURUNATH PRAMOD</creatorcontrib><creatorcontrib>GRAVES IAN</creatorcontrib><creatorcontrib>YU JINSONG</creatorcontrib><creatorcontrib>ZUO ZHENGPING</creatorcontrib><creatorcontrib>SAVENKOV DENIS</creatorcontrib><creatorcontrib>DANE, JUSTIN</creatorcontrib><creatorcontrib>DE PAOLI, CHRISTOPHE</creatorcontrib><creatorcontrib>DILLAFSON, ALIREZA</creatorcontrib><creatorcontrib>SURKOV ALEXEY GENNADIEVICH</creatorcontrib><creatorcontrib>ARCH, KYLE</creatorcontrib><creatorcontrib>XU HU</creatorcontrib><creatorcontrib>GLUCK MICHAEL</creatorcontrib><creatorcontrib>NORTHUP ERIC ROBERT</creatorcontrib><creatorcontrib>BLAKELY JOHN JACOB</creatorcontrib><creatorcontrib>MARTINSEN LEIF HAVEN</creatorcontrib><creatorcontrib>SHALOWITZ, ILANA, ORLY</creatorcontrib><creatorcontrib>SRINIVAS, KRISHNA, CHAITANYA, GOPISETTY</creatorcontrib><creatorcontrib>MOSKEY GABRIEL CATHERINE</creatorcontrib><creatorcontrib>SETHI, PUJA</creatorcontrib><creatorcontrib>WU KUAN-HUEI JEFFREY</creatorcontrib><creatorcontrib>PARENT MARK</creatorcontrib><creatorcontrib>SANTORO ELIZABETH KELSEY</creatorcontrib><creatorcontrib>GOEL, SWATI</creatorcontrib><creatorcontrib>KAHN JEREMY GILMORE</creatorcontrib><creatorcontrib>PU YIMING</creatorcontrib><creatorcontrib>LIU HONGLEI</creatorcontrib><creatorcontrib>MATTHEW DAN FAZLEY</creatorcontrib><creatorcontrib>TIWARI MEGA</creatorcontrib><creatorcontrib>SANTOSA, STEPHANIE</creatorcontrib><creatorcontrib>SRIVASTAVA RUCHIR</creatorcontrib><creatorcontrib>KAMKAR, PIYUSH</creatorcontrib><creatorcontrib>MOHAMED AHMED MAGADI HAMID</creatorcontrib><creatorcontrib>LI JIHANG</creatorcontrib><creatorcontrib>VINCENT JOSHUA</creatorcontrib><creatorcontrib>RACINE JACKSON</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>CHEN YUANHUI</au><au>WIGDOR DANIEL JOHN</au><au>JUNJUNWALA, MIKA</au><au>BELLMAN AMY LAWSON</au><au>FLORES NICHOLAS JORGE</au><au>GAN XIN</au><au>LIU BING</au><au>VENKATESH, GANESH</au><au>HILAIRE LLOYD</au><au>DABAS, LUOXIN</au><au>LIU BAIYANG</au><au>HANSEN MICHAEL ROBERT</au><au>MOON, SEUNG HWAN</au><au>CUI ZHENHUA</au><au>MALIK, KASHTIZ</au><au>ZHOU HAO</au><au>KITCHENS JESSICA</au><au>CHALLAND CHRISTOPHE</au><au>BALMES CHRISTOPHER E</au><au>GURUNATH PRAMOD</au><au>GRAVES IAN</au><au>YU JINSONG</au><au>ZUO ZHENGPING</au><au>SAVENKOV DENIS</au><au>DANE, JUSTIN</au><au>DE PAOLI, CHRISTOPHE</au><au>DILLAFSON, ALIREZA</au><au>SURKOV ALEXEY GENNADIEVICH</au><au>ARCH, KYLE</au><au>XU HU</au><au>GLUCK MICHAEL</au><au>NORTHUP ERIC ROBERT</au><au>BLAKELY JOHN JACOB</au><au>MARTINSEN LEIF HAVEN</au><au>SHALOWITZ, ILANA, ORLY</au><au>SRINIVAS, KRISHNA, CHAITANYA, GOPISETTY</au><au>MOSKEY GABRIEL CATHERINE</au><au>SETHI, PUJA</au><au>WU KUAN-HUEI JEFFREY</au><au>PARENT MARK</au><au>SANTORO ELIZABETH KELSEY</au><au>GOEL, SWATI</au><au>KAHN JEREMY GILMORE</au><au>PU YIMING</au><au>LIU HONGLEI</au><au>MATTHEW DAN FAZLEY</au><au>TIWARI MEGA</au><au>SANTOSA, STEPHANIE</au><au>SRIVASTAVA RUCHIR</au><au>KAMKAR, PIYUSH</au><au>MOHAMED AHMED MAGADI HAMID</au><au>LI JIHANG</au><au>VINCENT JOSHUA</au><au>RACINE JACKSON</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Task execution based on real-world text detection for assistant systems</title><date>2024-01-12</date><risdate>2024</risdate><abstract>In one embodiment, a method includes accessing a visual signal including an image from a client system associated with a first user, the image depicting textual content in a real-world environment associated with the first user; identifying the text content based on a machine learning model and a visual signal; determining a context associated with the first user about a real-world environment based on the visual signal; executing a task for the first user, the task being determined based on the text content and the determined context; and sending an instruction to the client system for presenting the execution result of the task to the first user.
在一个实施例中，一种方法包括从与第一用户相关联的客户端系统访问包括图像的视觉信号，所述图像描绘了与第一用户相关联的真实世界环境中的文本内容；基于机器学习模型和视觉信号识别该文本内容；基于视觉信号确定与第一用户相关联的关于真实世界环境的上下文；为第一用户执行任务，所述任务是基于文本内容和所确定的上下文而确定的；以及向客户端系统发送用于向第一用户呈现任务的执行结果的指令。</abstract><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | |
| ispartof | |
| issn | |
| language | chi ; eng |
| recordid | cdi_epo_espacenet_CN117396838A |
| source | esp@cenet |
| subjects | CALCULATING COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS |
| title | Task execution based on real-world text detection for assistant systems |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-21T18%3A29%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=CHEN%20YUANHUI&rft.date=2024-01-12&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN117396838A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |