System and method for tracking an input device using a display screen in captured frames of image data

A system and method for tracking an input device 102 uses positional information of a display screen 108 in frames (e.g. 212A, 212B, 212C; figure 2A) of image data captured by an image sensor array included in the input device to determine the relative position of the input device with respect to the display screen. The positional information of the display screen may be extracted by processing image frames to locate corners of the display screen in the frames and the extraction may further include deriving an estimated location of a missing corner of the display screen in the image frames.