Front man-machine interaction voice recognition method and system based on computer vision assistance

The invention relates to a front man-machine interaction voice recognition method and a front man-machine interaction voice recognition system based on computer vision assistance. According to the method and the system, video signal input is added in the traditional voice recognition flow, and then the simultaneous recognition with the voice signal is realized; voice assistance is carried out in human face recognition and human face lip movement recognition, and whether a target to be recognized is speaking or not is judged; and meanwhile, through human face recognition and auxiliary positioning, the orientation of a speaker is judged, and in addition, enhancement processing is carried out on a sound source signal in the specified direction by utilizing the corresponding orientation. Withthe method and the system, the recognition accuracy for voice command and voice input information of clients can be effectively enhanced under the specific environments, including the man-machine interaction use situations in