Daily ICU surveillance gets a structured pneumonia dataset

Severe pneumonia rarely behaves like a single snapshot. In the ventilated ICU, organ failure, microbiology, imaging, bronchoalveolar lavage results, and bedside response can shift from day to day, and the biologic signal often emerges only when those changes are tracked over time. A new Pneumonia data resource was built around that reality rather than around admission and discharge alone.

The SCRIPT CarpeDiem Dataset assembles 21,931 patient-hospital-days from 704 critically ill patients enrolled between June 2018 and May 2023. Every patient was mechanically ventilated and underwent bronchoalveolar lavage to establish the etiology of pneumonia or to identify an alternative diagnosis. The result is not a narrow outcomes file, but a longitudinal clinical record that mirrors daily multidisciplinary rounds and preserves the clinical context in which pneumonia is actually adjudicated.

One sentence captures the practical value of the dataset: it follows the illness as it unfolds, not as it is remembered at admission or summarized at discharge.

Why daily adjudication changes the value of ICU data

Pneumonia in the critically ill is syndromic, often heterogeneous, and difficult to classify cleanly without expert review. In routine retrospective analyses, a patient’s course can be flattened into a few static variables, leaving out intercurrent complications, changing ventilatory support, evolving laboratory data, and the clinician judgment required to interpret a worsening oxygen requirement or a new microbiologic result. A daily structure addresses that gap by aligning the dataset with how intensivists actually reason at the bedside.

The dataset includes patient demographics, daily vital signs, laboratory results, mechanical support data, adjudicated pneumonia episode results, and outcomes. Those layers matter because respiratory failure in severe infection is rarely governed by one variable alone. Ventilator dependence, inflammatory burden, and treatment response interact over time, and that interaction can only be studied if the underlying data preserve chronology. For investigators developing phenotypes, prediction models, or therapeutic response frameworks, a day-by-day record is much closer to the underlying clinical biology than a static discharge abstract.

Bronchoalveolar lavage anchors the diagnostic framework

The cohort was built around patients who underwent bronchoalveolar lavage, a procedure that can clarify the microbial cause of pneumonia and sometimes reveal a different diagnosis altogether. In mechanically ventilated patients, that distinction is decisive. Broad-spectrum antimicrobials, ventilator management, and escalation decisions depend on whether the lung injury reflects bacterial pneumonia, another infectious process, or a noninfectious mimic.

By pairing lavage-based etiologic assessment with daily physiologic data, the dataset creates a framework for studying how bedside diagnostics intersect with illness trajectory. It also offers a way to examine why some patients stabilize while others remain trapped in progressive respiratory failure despite intensive support. The clinical value comes from the combination: microbiology without longitudinal context is incomplete, and physiologic trend data without diagnostic adjudication are equally limited.

The dataset is designed for trajectory science, not just archival storage

This is the kind of resource that can support questions clinicians ask every day but rarely answer cleanly from routine records. Which patterns of deterioration precede respiratory collapse? How do laboratory shifts align with mechanical support changes? When do adjudicated pneumonia episodes diverge from alternative diagnoses in a way that matters for outcome modeling?

Because the data are de-identified under HIPAA Safe Harbor guidelines, they are positioned for broad secondary use while preserving patient privacy. That balance matters in ICU research, where rich longitudinal data are especially valuable but privacy risks are high. The structure also makes the resource useful for reproducible machine learning work, causal modeling, and prospective hypothesis generation. Models trained on day-level data can account for temporal dependency, which is essential in a disease where clinical course can change rapidly over a few ventilator days.

Open data can reshape pneumonia research methods

The release lands in a field that has long struggled with outcome adjudication in critical illness. Many datasets capture who was sick, what happened at admission, and whether the patient survived, but they miss the sequence of events that leads to deterioration or recovery. In pneumonia, that sequence is often the entire story. Fever, gas exchange, pressor requirement, renal dysfunction, and radiographic progression do not simply coexist; they accumulate, overlap, and sometimes contradict each other before the diagnosis becomes clear.

The dataset’s design reflects that complexity. It is meant to be mined by clinicians and data scientists who need a clinically grounded benchmark for trajectory analysis. For investigators building predictive tools, the daily format reduces reliance on crude endpoints and gives algorithms a chance to learn from evolving states rather than from one-time measurements. For intensivists, it offers a more faithful record of the decisions and physiologic transitions that define severe pneumonia at the bedside.

A resource like this does not by itself answer whether one therapeutic strategy is superior to another. It does, however, make it easier to study the patients in whom that question arises.

What the current release makes possible

The authors frame the dataset as a resource for analyzing clinical trajectories in severe pneumonia, and that is the right emphasis. The largest limitation of many pneumonia analyses is not sample size alone; it is missingness in the clinical narrative. A patient may look similar to another at admission and diverge completely by day 3 or day 5 because of evolving host response, ventilatory mechanics, pathogen burden, or a noninfectious mimic that only becomes apparent later. A dataset that preserves those changes can support more precise subphenotyping and more careful outcome adjudication.

The immediate consequence is methodological. Researchers now have access to a curated, de-identified ICU resource that tracks daily parameters alongside expert-adjudicated pneumonia episodes in a cohort of 704 ventilated patients. The next step is not to ask whether severe pneumonia is complex; it is. The more relevant question is how well future analyses can use this structure to separate disease biology from bedside noise, and how much additional signal emerges once daily course is treated as a core clinical variable rather than an afterthought.


Reporting by Dr. A. Nikhil Krishnan, MBBS for Medicine World Foundation, with additional data provided by Nature Medicine.