Virtual reality input system based on gesture recognition

The invention discloses a virtual reality input system based on gesture recognition, which comprises the following steps: firstly, extracting image feature information through a gesture recognition network to generate a gesture position and prediction map, a gesture depth map and a hand Mesh map, co...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: XU BIN, LI JIAXUAN, FAN QUANYONG, ZHANG NAIZONG, LIU TIANXIN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a virtual reality input system based on gesture recognition, which comprises the following steps: firstly, extracting image feature information through a gesture recognition network to generate a gesture position and prediction map, a gesture depth map and a hand Mesh map, constructing an input system in combination with the generated hand joint position information, and selecting fingertip upward input for design; whether the finger is pressed down or not is judged according to the coordinate change of the fingertip key point in the three-dimensional space, meanwhile, a user can select and confirm whether an input result is correct or not, and finally the input result confirmed by the user is output. The invention provides a solution for realizing information input based on the gesture image aiming at complex and rapid hand actions in virtual reality equipment or a scene, so that the accuracy of information input under the abnormal gesture condition is improved, and the user experienc