Pose estimation method and device for hand-object interaction scene

The invention provides a pose estimation method and device for a hand-object interaction scene, and the method comprises the steps: carrying out the regression learning of a target hand-object interaction image, and obtaining an initial interaction potential of a hand and an object; estimating conta...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: MU TAIJIANG, SONG HAOXUAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a pose estimation method and device for a hand-object interaction scene, and the method comprises the steps: carrying out the regression learning of a target hand-object interaction image, and obtaining an initial interaction potential of a hand and an object; estimating contact information of the human hand and the object in the interaction process by using the initial interaction potential and the target hand-object interaction image; extracting high-order two-dimensional features from the target hand-object interaction image; and optimizing the initial interaction potential according to the contact information and the high-order two-dimensional features to obtain the interaction potential of the human hand and the object. According to the method, in the process of optimizing the initial interaction potential, the rationality of physical prior is met by utilizing the contact information of the human hand and the object, and meanwhile, constraint terms corresponding to various high-ord