Background
Rare autoimmune diseases — adult-onset Still disease (AOSD), IgG4-related disease (IgG4-RD), relapsing polychondritis, eosinophilic granulomatosis with polyangiitis (EGPA) — collectively affect millions yet individually lack sufficient cohort sizes for robust predictive modeling. Traditional supervised learning requires thousands of labeled trajectories, rendering these conditions perpetually under-modeled.
Recent rheumatology foundation models (RFMs) pre-trained on large multi-site datasets of common diseases (RA, SLE, SpA) learn generalizable representations of inflammatory dynamics, lab trajectory patterns, and treatment response phenotypes. We hypothesize that these learned representations transfer to rare conditions with minimal fine-tuning.
Hypothesis
A GPT-2-architecture foundation model pre-trained on ≥500,000 longitudinal rheumatology encounters (OMOP-tokenized: labs, diagnoses, medications, disease activity scores, temporal tokens) can be fine-tuned with fewer than 200 labeled cases per rare autoimmune condition to predict 6-month disease activity trajectories with discriminative performance (AUROC ≥ 0.78) comparable to disease-specific models trained on 2,000+ cases.
Mechanistic Rationale
The key insight is that inflammatory autoimmune diseases share deep mechanistic structure:
- Shared cytokine grammar: IL-6, TNF-α, IFN-γ trajectory patterns learned from RA/SLE generalize because the same signaling cascades drive AOSD (IL-18/IL-6) and EGPA (IL-5/IL-13 with IL-6 co-activation)
- Treatment response homology: Corticosteroid





























