Deep learning approaches for image cytometry: assessing cellular morphological responses to drug perturbations

Image cytometry is the analysis of cell properties from microscopy image data and is used ubiquitously in basic cell biology, medical diagnosis and drug development. In recent years deep learning has shown impressive results for many image cytometry tasks, including image processing, segmentation, classification and detection. Deep learning enables a more data-driven and end-to-end approach than was previously possible with conventional methods. This thesis investigates deep learning-based approaches for assessing cellular morphological responses to drug perturbations. In paper I we demonstrated the benefit of combining convolutional neural networks and transfer learning for predicting mechanism of action and nucleus translocation. In paper II we showed, using convolutional and recurrent neural networks applied to time-lapse microscopy data, that it is possible to predict if mRNA delivery via nanoparticles has been effective based on cell morphology changes at time points prior to the protein production evidence of successful delivery. In paper III we used convolutional neural networks, adversarial training and privileged information to faithfully generate fluorescence imaging channels of adipocyte cells from their corresponding z-stack of brightfield images. Our models were both faithful at the fluorescence image level and at the level of the features extracted from these images, features that are commonly used for downstream analysis, including the design of effective drug therapies. In paper IV we showed that convolutional neural networks trained on brightfield image data provide similar, and in some cases superior, performance to models trained on fluorescence image data for predicting mechanism of action, due to the brightfield images possessing additional information not available in the fluorescence images. In paper V we applied deep learning models to brightfield time-lapse image data to explore the evolution of cellular morphological changes after drug administration for a diverse set of compounds, compounds that are often used as positive controls in image-based assays.