GROUNDED MULTIMODAL AGENT INTERACTIONS

Aspects of the present disclosure relate to grounded multimodal agent interactions, where a user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to enable a user to con...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: DESGARENNES, Gabriel, A, RAO, Sudha, VOLUM, Ryan, BROCKETT, Christopher, John, DOLAN, William B
Format: Patent
Sprache:eng ; fre ; ger
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator DESGARENNES, Gabriel, A
RAO, Sudha
VOLUM, Ryan
BROCKETT, Christopher, John
DOLAN, William B
description Aspects of the present disclosure relate to grounded multimodal agent interactions, where a user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to enable a user to control the application and/or to facilitate user interactions with a conversational agent, among other examples. In some instances, at least a part of the model output may be executed or parsed, for example to call an application programming interface or function of the application. Thus, use of a multimodal machine learning model according to aspects described herein may enable the use of user-provided natural language input to affect the behavior of an application accordingly.
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_EP4415839A1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>EP4415839A1</sourcerecordid><originalsourceid>FETCH-epo_espacenet_EP4415839A13</originalsourceid><addsrcrecordid>eNrjZFBzD_IP9XNxdVHwDfUJ8fT1d3H0UXB0d_ULUfD0C3ENcnQO8fT3C-ZhYE1LzClO5YXS3AwKbq4hzh66qQX58anFBYnJqXmpJfGuASYmhqYWxpaOhsZEKAEAlfojaw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>GROUNDED MULTIMODAL AGENT INTERACTIONS</title><source>esp@cenet</source><creator>DESGARENNES, Gabriel, A ; RAO, Sudha ; VOLUM, Ryan ; BROCKETT, Christopher, John ; DOLAN, William B</creator><creatorcontrib>DESGARENNES, Gabriel, A ; RAO, Sudha ; VOLUM, Ryan ; BROCKETT, Christopher, John ; DOLAN, William B</creatorcontrib><description>Aspects of the present disclosure relate to grounded multimodal agent interactions, where a user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to enable a user to control the application and/or to facilitate user interactions with a conversational agent, among other examples. In some instances, at least a part of the model output may be executed or parsed, for example to call an application programming interface or function of the application. Thus, use of a multimodal machine learning model according to aspects described herein may enable the use of user-provided natural language input to affect the behavior of an application accordingly.</description><language>eng ; fre ; ger</language><subject>AMUSEMENTS ; CALCULATING ; CARD, BOARD, OR ROULETTE GAMES ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; GAMES ; GAMES NOT OTHERWISE PROVIDED FOR ; HUMAN NECESSITIES ; INDOOR GAMES USING SMALL MOVING PLAYING BODIES ; PHYSICS ; SPORTS ; VIDEO GAMES</subject><creationdate>2024</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20240821&amp;DB=EPODOC&amp;CC=EP&amp;NR=4415839A1$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20240821&amp;DB=EPODOC&amp;CC=EP&amp;NR=4415839A1$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>DESGARENNES, Gabriel, A</creatorcontrib><creatorcontrib>RAO, Sudha</creatorcontrib><creatorcontrib>VOLUM, Ryan</creatorcontrib><creatorcontrib>BROCKETT, Christopher, John</creatorcontrib><creatorcontrib>DOLAN, William B</creatorcontrib><title>GROUNDED MULTIMODAL AGENT INTERACTIONS</title><description>Aspects of the present disclosure relate to grounded multimodal agent interactions, where a user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to enable a user to control the application and/or to facilitate user interactions with a conversational agent, among other examples. In some instances, at least a part of the model output may be executed or parsed, for example to call an application programming interface or function of the application. Thus, use of a multimodal machine learning model according to aspects described herein may enable the use of user-provided natural language input to affect the behavior of an application accordingly.</description><subject>AMUSEMENTS</subject><subject>CALCULATING</subject><subject>CARD, BOARD, OR ROULETTE GAMES</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>GAMES</subject><subject>GAMES NOT OTHERWISE PROVIDED FOR</subject><subject>HUMAN NECESSITIES</subject><subject>INDOOR GAMES USING SMALL MOVING PLAYING BODIES</subject><subject>PHYSICS</subject><subject>SPORTS</subject><subject>VIDEO GAMES</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2024</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZFBzD_IP9XNxdVHwDfUJ8fT1d3H0UXB0d_ULUfD0C3ENcnQO8fT3C-ZhYE1LzClO5YXS3AwKbq4hzh66qQX58anFBYnJqXmpJfGuASYmhqYWxpaOhsZEKAEAlfojaw</recordid><startdate>20240821</startdate><enddate>20240821</enddate><creator>DESGARENNES, Gabriel, A</creator><creator>RAO, Sudha</creator><creator>VOLUM, Ryan</creator><creator>BROCKETT, Christopher, John</creator><creator>DOLAN, William B</creator><scope>EVB</scope></search><sort><creationdate>20240821</creationdate><title>GROUNDED MULTIMODAL AGENT INTERACTIONS</title><author>DESGARENNES, Gabriel, A ; RAO, Sudha ; VOLUM, Ryan ; BROCKETT, Christopher, John ; DOLAN, William B</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_EP4415839A13</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng ; fre ; ger</language><creationdate>2024</creationdate><topic>AMUSEMENTS</topic><topic>CALCULATING</topic><topic>CARD, BOARD, OR ROULETTE GAMES</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>GAMES</topic><topic>GAMES NOT OTHERWISE PROVIDED FOR</topic><topic>HUMAN NECESSITIES</topic><topic>INDOOR GAMES USING SMALL MOVING PLAYING BODIES</topic><topic>PHYSICS</topic><topic>SPORTS</topic><topic>VIDEO GAMES</topic><toplevel>online_resources</toplevel><creatorcontrib>DESGARENNES, Gabriel, A</creatorcontrib><creatorcontrib>RAO, Sudha</creatorcontrib><creatorcontrib>VOLUM, Ryan</creatorcontrib><creatorcontrib>BROCKETT, Christopher, John</creatorcontrib><creatorcontrib>DOLAN, William B</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>DESGARENNES, Gabriel, A</au><au>RAO, Sudha</au><au>VOLUM, Ryan</au><au>BROCKETT, Christopher, John</au><au>DOLAN, William B</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>GROUNDED MULTIMODAL AGENT INTERACTIONS</title><date>2024-08-21</date><risdate>2024</risdate><abstract>Aspects of the present disclosure relate to grounded multimodal agent interactions, where a user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to enable a user to control the application and/or to facilitate user interactions with a conversational agent, among other examples. In some instances, at least a part of the model output may be executed or parsed, for example to call an application programming interface or function of the application. Thus, use of a multimodal machine learning model according to aspects described herein may enable the use of user-provided natural language input to affect the behavior of an application accordingly.</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language eng ; fre ; ger
recordid cdi_epo_espacenet_EP4415839A1
source esp@cenet
subjects AMUSEMENTS
CALCULATING
CARD, BOARD, OR ROULETTE GAMES
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
GAMES
GAMES NOT OTHERWISE PROVIDED FOR
HUMAN NECESSITIES
INDOOR GAMES USING SMALL MOVING PLAYING BODIES
PHYSICS
SPORTS
VIDEO GAMES
title GROUNDED MULTIMODAL AGENT INTERACTIONS
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T18%3A44%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=DESGARENNES,%20Gabriel,%20A&rft.date=2024-08-21&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3EEP4415839A1%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true