Control method based on audio-visual recognition and system thereof

The invention is a control method based on audio-visual recognition and a system thereof; a display unit is used for displaying a plurality of different project signals for a user to send out an expected instruction based on one of the project signals, then a capturing device is used for capturing the expected instruction of the user and sending to a controller, sequentially, the controller is used for converting the expected instruction captured by the capturing device into a group of instruction binary codes, and the controller searches a database to obtain the project signals correspondingto the instruction binary codes, sends a control signal to an acting device, and the control signal corresponds to the project signals.