Man-machine interaction method based on Kincet and voice

The invention discloses a man-machine interaction method based on Kincet and voice. The method comprises the steps that (1) a Kinect sensor is used to acquire an accurate space position and attitude information of each object in a scene in a Kinect coordinate system K, so that a target can be detected and recognized; (2) three-dimensional point cloud data is obtained after fusion processing of depth images and RGB which are collected by the Kinect respectively; (3) a space point cloud object is recognized, wherein the three-dimensional point cloud data is processed, so that a semantic description document can be obtained; (4) coordinate conversion is carried out to an object coordinate system O, so that a three-dimensional scene semantic map description document under a coordinate system R can be obtained; (5) a user's voice input is input, and an input signal is processed, so that text information can be obtained; and (6) the text information and an XML semantic map are input into an intelligent inference en