Augmented reality display sharing

A visualization system provides graphics for presentation on displays of multiple users who may be wearing head-mounted displays (HMDs). In an embodiment, the system determines that a first gaze direction of a first user is directed toward a first display. The system determines user inputs performed by the first user. The user inputs may be hands-free such as gestures of a hand or finger or voice commands. The system generates a graphical annotation using the user inputs. The system provides the graphical annotation to a first HMD for presentation to the first user. The system determines a second display paired to the first display. The system provides the graphical annotation to a second HMD for presentation to a second user looking at the second display. The displays may include a physical display or a virtual display, for example, in an augmented reality environment.