Robust segment-based object tracking using generalized hyperplane approximation

Tracking based on gradient descent algorithm using image gradient is one of the popular object tracking method. However, it easily fails to track when illumination changes. Although several illumination invariant features have been proposed, applying the invariant feature to the gradient descent method is not easy because the invariant feature is represented as a non-linear function of image pixel values and its Jacobian cannot be calculated in a closed-form. To make it possible, we introduce the generalized hyperplane approximation technique and apply it to histogram of oriented gradient (HOG) feature, one of the well-known illumination invariant feature. In addition, we achieve partial occlusion invariance using image segments. The hyperplanes are calculated from training segment images obtained by perturbing the motion parameter around the target region. Then, it is used to map the difference in non-linear feature of image onto the increment of alignment parameters. This process is mathematically same to the gradient descent method. The information from each segment is integrated by a simple weighted linear combination with confidence weights of segments. Compared to the previous tracking algorithms, our method shows very fast and stable tracking results in experiments on several practical image sequences. ► Illumination invariant tracking is achieved using HOG. ► Generalized hyperplane approximation makes mapping from non-linear feature to motion parameter possible. ► Robustness against partial occlusion is achieved using segment-based approach. ► Very low computational cost is achieved using segment-based approach of generalized hyperplane approximation.