Method for enabling synthetic autopilot video functions and for publishing a synthetic video feed as a virtual camera during a video call

One variation of a method for enabling autopilot functionality during a video call includes, during an operating period: receiving a sequence of frames from a camera in a first device; detecting a face, of a first user, in the sequence of frames; generating a sequence of facial landmark containers r...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mireles, Matt, Astarabadi, Yousif, Nikkhah, Kristina, Romanus, Emil, Astarabadi, Shaun, Lanctot, Louis
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:One variation of a method for enabling autopilot functionality during a video call includes, during an operating period: receiving a sequence of frames from a camera in a first device; detecting a face, of a first user, in the sequence of frames; generating a sequence of facial landmark containers representing facial actions of the face of the first user; transmitting the sequence of facial landmark containers to a second device for combination with a look model to generate a first synthetic image feed depicting facial actions of the first user; and detecting a trigger event. The method also includes, during an autopilot operating period, entering autopilot mode; retrieving a prerecorded autopilot sequence of facial landmark containers from a memory; and transmitting the prerecorded autopilot sequence of facial landmark containers to the second device for combination with the look model to generate a second synthetic image feed depicting predefined facial actions.