A study on human interface system using the direction of eyes and face

Establishing an efficient alternative channel for communication without overt speech and hand movements is important for increasing the quality of life for patients lacking correct limb and facial muscular responses. This paper presents the eye movement tracking system using cross-channel electrooculogram signals. In addition, we used Kinect sensor (RGB-D sensor) for face tracking. Thus, gaze estimation system can be established by both eye movement and face tracking. Simulation experiments were designed in order to confirm the effectiveness of the proposed system. As a result of simulation experiments, gaze position estimation is recognized under high accuracy in our system.