A multimodal learning machine framework for Alzheimer’s disease diagnosis based on neuropsychological and neuroimaging data

Alzheimer’s disease (AD) is the most prevalent form of dementia, with no current cure. Early screening and intervention are vital. In multimodal AD data, besides neuroimaging dimensions, neuropsychological tests based on cognitive domains also provide the clinical information for diagnosing AD. However, previous multimodal methods often fuse these neuropsychological test scores with other data, losing the rich clinical details inherent in each test, including videos, speech, images, and text. To address this, we propose a novel framework with an entropy-based polynomial dimension expansion function that restores this critical information by accurately calculating the optimal polynomial degree. Additionally, the proposed framework offers a series of cognitive-based Extreme Learning Machine (ELM) models to better utilize the detailed clinical insights from neuropsychological tests, reducing diagnostic redundancy and noise. Finally, we design a boosting ensemble strategy that combines diagnostic models from various dimensions and cognitive domains, automatically optimizing weights to enhance diagnostic accuracy. Tested on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset, our approach achieves over 98% accuracy and F1 scores, with no observed bias between mild cognitive impairment (MCI) and AD groups. Therefore, our framework can offer clinicians more logical recommendations for diagnosing and managing the disease. •Pioneering polynomial-based method restores rich clinical info from scale test.•Cognitive-based ELMs reduce noise in cognitive domains, optimizing scale usage.•Boosting ensemble integrates multimodal models, achieving high accuracy.