Multimodal Foundation Models in Clinical Triage: Validating EHR and Imaging Fusion

The research team constructed a cross-attention transformer network that simultaneously ingests raw unstructured emergency physician notes, longitudinal lab trajectories, continuous vital sign telemetry, and 3D non-contrast CT volumes. Rather than processing text and imaging in isolated silos, the multimodal model fuses visual embeddings from spatial vision transformers with tokenized clinical narratives. This architecture allows the algorithm to contextualize subtle radiological findings (such as borderline ground-glass opacities, minor retroperitoneal stranding, or subtle intracranial hyperdensities) against real-time clinical indices like lactic acidosis, leukocytosis, or acute hypoxia. The end-to-end inference takes less than 90 seconds on standard hospital GPU servers.

Emergency departments worldwide operate under unprecedented overcrowding, physician burnout, and acute triage bottlenecks where critical diagnostic clues get lost across disparate systems. Occult sepsis, non-massive pulmonary embolism, and evolving intracranial hemorrhage frequently present with non-specific vitals. By synthesizing temporal EHR trends with immediate imaging scans within minutes of acquisition, this system prevents catastrophic diagnostic delays and gives triage teams pre-test probability estimates before specialist consultation.

Physicians and emergency department directors can deploy multimodal foundation models as continuous background copilots. The system flags occult high-risk trajectories and prepares structured clinical pre-populates without requiring manual data re-entry. However, clinical governance policies must establish that all AI-generated escalation alerts function as advisory decision support: human-in-the-loop sign-off remains mandatory before ordering stat interventions, invasive lines, or emergency surgical consults.

The training and validation cohorts were derived exclusively from academic tertiary centers with fully integrated Epic and Cerner EHR infrastructures and high-speed multi-slice CT scanners. Generalizability across rural community hospitals, lower-resolution imaging suites, and non-standardized multilingual physician dictations requires prospective validation.