Biopsy workflow using multimodal imaging

The subject matter discussed herein relates to multi-modal image alignment to facilitate biopsy procedures and post-biopsy procedures. In one such example, prostate structures (or other suitable anatomic features or structures) are automatically segmented in pre-biopsy MR and pre-biopsy ultrasound images. Thereafter, pre-biopsy MR and pre-biopsy ultrasound contours are aligned. To account for non-linear deformation of the imaged anatomic structure, a patient-specific transformation model is trained via deep learning based at least in part on the pre-biopsy ultrasound images. The pre-biopsy ultrasound images that are overlaid with the pre-biopsy MR contours and based off the deformable transformation model are then aligned with the biopsy ultrasound images. Such real-time alignment using multi-modality imaging techniques provides guidance during the biopsy and post-biopsy system.