Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease

Topic: Brain imaging, connectivity and assessment

Many machine learning and pattern classification methods have been applied to the diagnosis of Alzheimer's disease (AD) and its prodromal stage, i.e., mild cognitive impairment (MCI). Recently, rather than predicting categorical variables as in classification, several pattern regression methods have also been used to estimate continuous clinical variables from brain images. However, most existing regression methods focus on estimating multiple clinical variables separately and thus cannot utilize the intrinsic useful correlation information among different clinical variables. On the other hand, in those regression methods, only a single modality of data (usually only the structural MRI) is often used, without considering the complementary information that can be provided by different modalities. In this paper, we propose a general methodology, namely multi-modal multi-task (M3T) learning, to jointly predict multiple variables from multi-modal data. Here, the variables include not only the clinical variables used for regression but also the categorical variable used for classification, with different tasks corresponding to prediction of different variables. Specifically, our method contains two key components, i.e., (1) a multi-task feature selection which selects the common subset of relevant features for multiple variables from each modality, and (2) a multi-modal support vector machine which fuses the above-selected features from all modalities to predict multiple (regression and classification) variables. To validate our method, we perform two sets of experiments on ADNI baseline MRI, FDG-PET, and cerebrospinal fluid (CSF) data from 45 AD patients, 91 MCI patients, and 50 healthy controls (HC). In the first set of experiments, we estimate two clinical variables such as Mini Mental State Examination (MMSE) and Alzheimer's Disease Assessment Scale-Cognitive Subscale (ADAS-Cog), as well as one categorical variable (with value of 'AD', 'MCI' or 'HC'), from the baseline MRI, FDG-PET, and CSF data. In the second set of experiments, we predict the 2-year changes of MMSE and ADAS-Cog scores and also the conversion of MCI to AD from the baseline MRI, FDG-PET, and CSF data. The results on both sets of experiments demonstrate that our proposed M3T learning scheme can achieve better performance on both regression and classification tasks than the conventional learning methods.

Key findings

• The results on both sets of experiments demonstrate that our proposed M3T learning scheme can achieve better performance on both regression and classification tasks than the conventional learning methods.

New to this subject? Start with our plain-English guide: Brain scans & tests →

Study details

• Evidence strengthLow

Read the original

• DOI: 10.1016/j.neuroimage.2011.09.069
• PubMed: 21992749
• Original source →

Free copy unknown: no free-copy check has an answer for this record yet. That does not mean it is paywalled.

@article{zhang2012-21992749,
  author  = {Zhang, D. and Shen, D. and {Alzheimer's Disease Neuroimaging Initiative}},
  title   = {{Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease}},
  journal = {NeuroImage},
  year    = {2012},
  doi     = {10.1016/j.neuroimage.2011.09.069},
  pmid    = {21992749},
  url     = {https://doi.org/10.1016/j.neuroimage.2011.09.069}
}

Related studies in Brain scans and imaging

• Interpretable Frequency-Aware Deep Learning for Multi-Class EEG Classification of Neurological Disorders Preprints.org · 2026-10-12 · usefulness score 16/100
• Small-animal PET imaging of amyloid-beta plaques with [11C]PiB and its multi-modal validation in an APP/PS1 mouse model of Alzheimer's disease PloS one · 2012-03-09 · usefulness score 56/100
• Prediction and classification of Alzheimer disease based on quantification of MRI deformation PloS one · 2017-03-06 · usefulness score 53/100
• Transfer deep learning and explainable AI framework for brain tumor and Alzheimer's detection across multiple datasets Frontiers in Medicine · 2025-06-19 · usefulness score 41/100
• ALZENET: Deep learning-based early prediction of Alzheimer's disease through magnetic resonance imaging analysis Telematics and Informatics Reports · 2025-02-14 · usefulness score 48/100
• A Deep Siamese Convolution Neural Network for Multi-Class Classification of Alzheimer Disease Brain sciences · 2020-02-05 · usefulness score 49/100

Similar studies

• Multivariate data analysis and machine learning in Alzheimer's disease with a focus on structural magnetic resonance imaging 2014 · Digital health tools
• Random forest-based similarity measures for multi-modal classification of Alzheimer's disease 2013 · Digital health tools
• Joint Classification and Regression via Deep Multi-Task Multi-Channel Learning for Alzheimer's Disease Diagnosis 2019 · Digital health tools
• Machine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects 2015 · Digital health tools
• Accurate multimodal probabilistic prediction of conversion to Alzheimer's disease in patients with mild cognitive impairment 2013 · Digital health tools
• Early-Stage Identification and Pathological Development of Alzheimer's Disease Using Multimodal MRI 2019 · Brain scans and imaging

More on Brain scans and imaging

• A review that covers this ground Mind the gap: from neurons to networks to outcomes in multiple sclerosis Nature reviews. Neurology · 2021-01-12 · usefulness score 56/100
• Newest in this subject Large-scale head-to-head comparison of on- and off-target profiles of [18F]Tauvid and [18F]MK6240 tau-PET in aging and Alzheimer’s disease Research Square · 2026-11-01 · Preprint — not yet peer-reviewed · usefulness score 16/100
• Newest in this subject Repetitive negative thinking is associated with amyloid accumulation over 3 years in cognitively healthy adults medRxiv · 2026-10-31 · Preprint — not yet peer-reviewed · usefulness score 16/100

See all studies in Brain scans and imaging →