Visualization of ultrasound images in physical space

Systems and methods of real-time augmented visualization of anatomical features are disclosed herein. The systems and methods can use concurrently collected and/or preexisting data regarding an anatomical structure to present an image of the anatomical structure to an operator in virtual space as overlayed in real space. The systems and methods can include acquiring image data from an anatomical structure of a subject. Visual image data of the subject can then be received, including non-rigid deformation of the subject. The device pose of the ultrasound device in real space can be determined using device pose data. Image pose of the image data can then be determined in virtual space. Then, a perspective pose of the image of at least a portion of the anatomical structure in virtual space can be mapped to the subject in real space.