MULTIMODAL TASK EXECUTION AND TEXT EDITING FOR A WEARABLE SYSTEM
A system comprising an outward facing imaging system; a second sensor different from the visual mode of input from the outward facing imaging system; and a hardware processor programmed to receive first user input data from the outward facing imaging system; second user input data from the second se...
Gespeichert in:
Hauptverfasser: | , , , , , , , |
---|---|
Format: | Patent |
Sprache: | eng ; fre ; ger |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | A system comprising an outward facing imaging system; a second sensor different from the visual mode of input from the outward facing imaging system; and a hardware processor programmed to receive first user input data from the outward facing imaging system; second user input data from the second sensor; determine, based on the first user input data, a first portion of a first candidate object of a plurality of candidate objects that is in a field of view of the user with respect to a second portion of the first candidate object that is outside of the field of view of the user; determine a first confidence score associated with the first candidate object based on the first portion and the second portion; determine a second confidence score for the first candidate object based on the second user input data; and cause a user interface operation to be performed on the first candidate object based at least in part on the first confidence score and the second confidence score. |
---|