SYSTEM, METHOD, AND APPARATUS FOR TRACKING A TOOL VIA A DIGITAL SURGICAL MICROSCOPE

The present disclosure relates generally to a system, method, and apparatus for tracking a tool via a digital surgical microscope. Cameras on the digital surgical microscope may capture a scene view of a medical procedure in real time, and present the scene view to the surgeon in a digitized video stream with minimal interference from the surgeon. The digital surgical microscope may process image data from each scene view in real time and use computer vision and machine learning models (e.g., neural networks) to detect and track one or more tools used over the course of the medical procedure in real-time. As the digital surgical microscope detects and tracks the tools, and responds accordingly, the surgeon can thus indirectly control, using the tools already in the surgeon's hands, various parameters of the digital surgical microscope, including the position and orientation of the robotic-arm-mounted digital surgical microscope.