Predicting mental conditions based on “history of present illness” in psychiatric notes with deep neural networks

[Display omitted] •Psychiatric conditions are predicted based on the “history of present illness” text field.•Deep neural networks resulted in a 3% improvement in micro F-score over linear models.•Recurrent neural networks (RNNs) with attention helped in model interpretation.•CNNs and RNNs complemented each other in per-condition evaluations. Background: Applications of natural language processing to mental health notes are not common given the sensitive nature of the associated narratives. The CEGS N-GRID 2016 Shared Task in Clinical Natural Language Processing (NLP) changed this scenario by providing the first set of neuropsychiatric notes to participants. This study summarizes our efforts and results in proposing a novel data use case for this dataset as part of the third track in this shared task. Objective: We explore the feasibility and effectiveness of predicting a set of common mental conditions a patient has based on the short textual description of patient’s history of present illness typically occurring in the beginning of a psychiatric initial evaluation note. Materials and methods: We clean and process the 1000 records made available through the N-GRID clinical NLP task into a key-value dictionary and build a dataset of 986 examples for which there is a narrative for history of present illness as well as Yes/No responses with regards to presence of specific mental conditions. We propose two independent deep neural network models: one based on convolutional neural networks (CNN) and another based on recurrent neural networks with hierarchical attention (ReHAN), the latter of which allows for interpretation of model decisions. We conduct experiments to compare these methods to each other and to baselines based on linear models and named entity recognition (NER). Results: Our CNN model with optimized thresholding of output probability estimates achieves best overall mean micro-F score of 63.144% for 11 common mental conditions with statistically significant gains (p