OBJECT ENHANCEMENT IN ARTIFICIAL REALITY VIA A NEAR EYE DISPLAY INTERFACE

A system includes a near eye display (NED) that is configured to display images in accordance with display instructions. The system also includes an imaging sensor configured to capture images. The system further includes a controller configured to identify the object in the captured images using one or more recognition patterns, and to determine a pose of the user's hand based on the captured images, with the determined pose indicating a touch gesture with the identified object. The controller also updates the display instructions to cause the electronic display to display a virtual menu in an artificial reality environment, with the virtual menu within a threshold distance of the position of the object in the artificial reality environment. 本发明公开了人工现实中的经由近眼显示器界面的对象增强。一种系统包括被配置为根据显示指令显示图像的近眼显示器(NED)。该系统还包括被配置为捕捉图像的成像传感器。该系统进一步包括控制器，该控制器被配置为使用一个或多个识别图案识别所捕捉的图像中的对象，并且基于所捕捉的图像确定用户的手的姿势，其中所确定的姿势指示对于所识别的对象的触摸姿势。该控制器还更新显示指令以使得电子显示器显示人工现实环境中的虚拟菜单，其中，虚拟菜单在人工现实环境中的对象的位置的阈值距离内。