Multiple Face Tracking Using Kalman Estimator Based Color SSD Algorithm

This paper proposes a new tracking algorithm using the Kalman estimator based color SSD algorithm. The Kalman estimator includes the color information as well as the position and size of the face region in its state vector, to take care of the variation of skin color while faces are moving. Based on the estimated face position, the color SSD algorithm finds the face matching with the one in the previous frame even when the color and size of the face region vary. The features of a face region extracted by the color SSD algorithm are used to update the state of the Kalman estimator. In the experiments, it has been shown that the proposed algorithm traces multiple faces successfully even when they are overlapped for a moment.