Medical devices, systems, and methods using eye gaze tracking for stereo viewer

A teleoperational medical system comprises an eye tracking system, which includes: an image display comprising a first coordinate frame configured to display an image of a surgical field comprising a second coordinate frame to a user in a third coordinate frame; at least one right eye tracker configured to measure data about a first gaze point of a right eye of the user; at least one left eye tracker configured to measure data about a second gaze point of a left eye of the user; and at least one processor configured to process the data about the first and second gaze points to determine a viewing location in the displayed image at which the first and second gaze points are directed. The medical system further comprises a control unit configured to control at least one function of the medical system based upon the determined viewing location.