Multimodal◆ AI-generated · Sourced

Imputation-free transformer learning enables robust Alzheimer's disease prediction and calibrated uncertainty quantification across heterogeneous clinical cohorts

Imputation-free transformer learning enables robust Alzheimer's disease prediction and calibrated uncertainty quantification across heterogeneous clinical cohorts
TL;DR

NITROGEN, an imputation-free transformer leveraging masked and intersample attention to jointly model intra-patient feature dependencies and inter-patient relational structure, achieves robust diagnostic classification and cognitive score prediction with well-calibrated uncertainty across ADNI (N=7858), OASIS-3 (N=2675), and AIBL (N=1286)—outperforming imputation-based tree ensembles in calibration while maintaining competitive discriminative performance.

Core Problem: Data incompleteness and cohort heterogeneity undermine reliability of Alzheimer’s disease modeling

  • Real-world clinical data suffer from pervasive missingness and heterogeneity, impeding trustworthy disease modeling and effective clinical evaluation;
  • Conventional imputation strategies (e.g., mean/multiple imputation) introduce systematic bias, distort inter-feature correlations, and yield overconfident predictions—especially hazardous in diagnostic settings.

Methodological Innovation: NITROGEN enables end-to-end imputation-free multimodal learning

  • Introducing NITROGEN: the first transformer architecture explicitly designed for partially observed clinical records without imputation;
  • Key mechanisms:
  • Masked attention: captures dynamic intra-patient dependencies among multimodal features (e.g., MRI, CSF, cognitive scales);
  • Intersample attention: explicitly models inter-patient relational structure (e.g., shared progression patterns or biomarker profiles), mitigating cohort heterogeneity;
  • Accepts raw, non-imputed, partially observed records—eliminating preprocessing-induced contamination.

Empirical Validation: Cross-cohort generalization and superior uncertainty calibration

  • Training cohort: ADNI (N=7858 scans);
  • Independent test cohorts: OASIS-3 (N=2675 scans) and AIBL (N=1286 scans);
  • Tasks evaluated:
  • Diagnostic classification (CN/MCI/AD);
  • Continuous cognitive score prediction (e.g., MMSE, CDR-SB);
  • Key results:
  • Competitive discriminative performance vs. state-of-the-art imputation + tree ensembles (e.g., XGBoost): comparable AUC and MAE;
  • Superior uncertainty quantification: coverage probabilities closer to nominal levels, lower quantile loss, and 37–52% reduction in Expected Calibration Error (ECE);
  • Strong cross-cohort robustness—no catastrophic performance drop during out-of-distribution evaluation.

Significance and positioning

  • Establishes a new paradigm for clinical AI: decoupling modeling from fragile imputation pipelines, enhancing trustworthiness and interpretability;
  • Lies at the intersection of multimodal learning and uncertainty-aware deep learning;
  • Published on arXiv:2607.11656v2 (replace-cross version), representing cutting-edge methodology research.
Sources (compliance trail)
https://arxiv.org/abs/2607.11656
Umi Intelligence · Enroll / Contact

Turn “understanding the frontier” into “putting it to work”

A free public class maps your AI adoption path; the offline bootcamp takes you further. Reach out anytime.

✉ hello@umi6.comWeekdays 9:00–18:00
Join the communityLeave your contact and we'll add you to the group to discuss frontier signals with peers.