Detection of emotional and behavioural changes after traumatic brain injury: A comprehensive survey

Traumatic brain injury (TBI) can affect normal brain function and may be caused by a vehicle accident, falling, and so on. The purpose of this survey is to provide clear knowledge of TBI, the causes of TBI, the impacts of TBI, and the role of family members and friends in recovery. TBI affects the daily life of the patients, both physically and mentally. After TBI, the patients may experience many emotional and behavioural changes because of a lack of certain brain functions. These changes affect their personal and social relationships. On the other hand, these changes depend on the severity of the TBI (i.e. mild, moderate, or severe), which is measured using the Glasgow coma score. Generally, three processes are used for emotion recognition: preprocessing, feature extraction, and emotion recognition. Preprocessing is performed for landmark detection and pose normalisation, which improves the performance of emotion detection. Feature extraction and emotion recognition are performed by various deep learning techniques, such as convolution neural networks and long short‐term memory. These techniques recognise the behavioural and emotional changes (depression, anxiety, anger, personality changes etc.) of TBI patients using facial expressions. Family members and friends play an important role in TBI patients' recovery, the extent of which is based on the severity of the TBI. The care of family members and friends leads to quick recovery and rehabilitation of patients from TBI. Finally, testing is performed using Computed Tomography images, Magnetic Resonance Imaging images, Electroencephalography signals, and patient demographics, which together show that the deep learning methods achieve better performance in terms of accuracy, precision, recall, and F‐measure in recognising emotional and behavioural changes after TBI. The authors conclude with a summary of the future of emotional and behavioural change prediction methods for TBI patients.