System and method for catheter detection in fluoroscopic images and updating displayed position of catheter

A method and system implementing a method for detecting a catheter in fluoroscopic data and updating a displayed electromagnetic position of the catheter on a 3D rendering is provided including navigating a catheter to a target area and acquiring fluoroscopic data from a fluoroscopic sweep of the target area. An initial catheter detection is performed to detect catheter tip candidates in each 2D frame of the fluoroscopic data using a shallow neural network. A secondary catheter detection is performed to detect catheter tip candidates in each 2D frame of the fluoroscopic data using a deep neural network. False-positive catheter tip candidates are removed by reconstructing a 3D position of the catheter tip and finding an intersecting point of rays corresponding to each 2D frame.