NATURAL LANGUAGE INTERFACE FOR VIRTUAL ENVIRONMENT GENERATION

Aspects of the present disclosure relate to grounded multimodal agent interactions, where a natural language user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to ena...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: VOLUM, Ryan, ALLISON, Karmelit Alon
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Aspects of the present disclosure relate to grounded multimodal agent interactions, where a natural language user input is processed using a multimodal machine learning model to generate model output. The model output may then be processed to affect the behavior of an application, for example to enable a user to control the application and/or to facilitate user interactions with a conversational agent, among other examples. In some instances, at least a part of the model output may be executed or parsed, for example to generate three dimensional objects within a coding application. Thus, use of a multimodal machine learning model according to aspects described herein may enable the use of user-provided natural language input to affect the behavior of an application accordingly.