MULTIMODAL TASK EXECUTION AND TEXT EDITING FOR A WEARABLE SYSTEM

A system comprising an outward facing imaging system; a second sensor different from the visual mode of input from the outward facing imaging system; and a hardware processor programmed to receive first user input data from the outward facing imaging system; second user input data from the second se...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: NILES, Savannah, FERNANDES, Ajoy Savio, BABU JD, Praveen, DEVINE, Jennifer M. R, CARLSON, Adam C, POWDERLY, James M, SOMMERS, Jeffrey, SHEEDER, Anthony Robert
Format: Patent
Sprache:eng ; fre ; ger
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:A system comprising an outward facing imaging system; a second sensor different from the visual mode of input from the outward facing imaging system; and a hardware processor programmed to receive first user input data from the outward facing imaging system; second user input data from the second sensor; determine, based on the first user input data, a first portion of a first candidate object of a plurality of candidate objects that is in a field of view of the user with respect to a second portion of the first candidate object that is outside of the field of view of the user; determine a first confidence score associated with the first candidate object based on the first portion and the second portion; determine a second confidence score for the first candidate object based on the second user input data; and cause a user interface operation to be performed on the first candidate object based at least in part on the first confidence score and the second confidence score.