Deep learning for tooth detection and evaluation

A method includes receiving an image of a face of a patient, the image including a depiction of teeth; processing the image of the face using one or more trained machine learning model, wherein the one or more trained machine learning model outputs a pixel-level classification of pixels in the image, the pixel level classification comprising a first set of pixels classified as being inside of a bounding shape that bounds a first plurality of teeth depicted in the image and a second set of pixels classified as being outside of the first bounding shape; cropping the image of the face of the patient, wherein the cropped image comprises depictions of the first plurality of teeth; and performing one or more operations on the cropped image of the face of the patient.