SYSTEMS AND METHODS UTILIZING MACHINE-LEARNING FOR IN VIVO NAVIGATION

A method of providing in vivo navigation of a medical device includes: receiving input medical imaging data of a patient's anatomy; receiving input non-optical in vivo image data from a sensor on a distal end of the device in the anatomy; using a trained model to locate the distal end in the input imaging data, wherein: the model is trained, based on (i) training medical imaging data and training non-optical in vivo image data of one or more individuals' anatomy and (ii) registration data associating the training image data with locations in the training imaging data as ground truth, to learn associations between the training image data and the training imaging data; determining an output location of the medical device using the learned associations and the input data; modifying the input imaging data to depict the determined location; and causing a display to output the modified input imaging data.