Gaze-driven auto-focus camera for mixed reality unvarnished transmission

The invention relates to a gaze-driven auto-focus camera for mixed reality pass-through. Certain embodiments relate to unvarnished image generation for mixed reality experiences. A device may determine eye tracking data associated with a user of a head-mounted device using an eye tracking system of...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: HU TE, XIONG YIZHI, WANG LAWRENCE CHANGYONG, GUPTA, DEVRAJ, PENG HONGHONG, EKELENS IAN, BRAILOVSKY ILYA, STUKE SEBASTIAN, HUANG LIDU
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a gaze-driven auto-focus camera for mixed reality pass-through. Certain embodiments relate to unvarnished image generation for mixed reality experiences. A device may determine eye tracking data associated with a user of a head-mounted device using an eye tracking system of the head-mounted device. The device may determine a desired scene depth for the user based on the eye movement tracking data. The device may instruct a first auto-focus camera of the head-mounted device to adjust a first focal length based on the desired scene depth and acquire a first image of a real-world environment of the user. The device may generate a first pass-through image based on the first image. The device may display the first pass-through image to a first eye of the user via a first display of the head-mounted device. 本发明涉及混合现实透传用的注视驱动的自动对焦摄像头。特定实施例涉及混合现实体验用的透传图像生成。一种设备可以使用头戴式设备的眼动追踪系统来确定与该头戴式设备的用户相关联的眼动追踪数据。该设备可以基于该眼动追踪数据来确定该用户的期望场景深度。该设备可以指示该头戴式设备的第一自动对焦摄像头基于该期望场景深度调整第一焦距并且采集该用户的真实世界环境的第一图像。该设备可以基于该