CC BY 4.0 · ACI open 2022; 06(01): e34-e38
DOI: 10.1055/s-0042-1749193
Original Article

Vitals are Vital: Simpler Clinical Data Model Predicts Decompensation in COVID-19 Patients

Joanna Schneider Cavalier
1   Department of Medicine, Duke University, Durham, North Carolina, United States
,
Cara L. O'Brien
1   Department of Medicine, Duke University, Durham, North Carolina, United States
,
Benjamin A. Goldstein
2   Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina, United States
,
Congwen Zhao
2   Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina, United States
,
Armando Bedoya
1   Department of Medicine, Duke University, Durham, North Carolina, United States
› Author Affiliations

Abstract

Objective Several risk scores have been developed and tested on coronavirus disease 2019 (COVID-19) patients to predict clinical decompensation. We aimed to compare an institutional, automated, custom-built early warning score (EWS) to the National Early Warning Score (NEWS) in COVID-19 patients.

Methods A retrospective cohort analysis was performed on patients with COVID-19 infection who were admitted to an intermediate ward from March to December 2020. A machine learning–based customized EWS algorithm, which incorporates demographics, laboratory values, vital signs, and comorbidities, and the NEWS, which uses vital signs only, were calculated at 12-hour intervals. These patients were retrospectively assessed for decompensation in the subsequent 12 or 24 hours, defined as death or transfer to an intensive care unit.

Results Of 709 patients, 112 (15.8%) had a decompensation event. Using the custom EWS, decompensation within 12 and 24 hours was predicted with areas under the receiver operating curve (AUC) of 0.81 and 0.79, respectively. The NEWS score applied to the same population yielded AUCs of 0.83 and 0.81, respectively. The 24-hour negative predictive values (NPV) of the NEWS and EWS in patients identified as low risk were 99.6 and 99.2%, respectively.

Conclusion The NEWS score performs as well as a customized EWS in COVID-19 patients, demonstrating the significance of vital signs in predicting outcomes. The relatively high positive predictive value and NPV of both scores are indispensable for optimally allocating clinical resources. In this relatively young, healthy population, a more complex score incorporating electronic health record data beyond vital signs does not add clinical benefit.

Protection of Human and Animal Subjects

Given the retrospective nature of this work using deidentified clinical data, this work was exempt from human subjects' protections.




Publication History

Received: 31 May 2021

Accepted: 03 February 2022

Article published online:
27 May 2022

© 2022. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution License, permitting unrestricted use, distribution, and reproduction so long as the original work is properly cited. (https://creativecommons.org/licenses/by/4.0/)

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 
  • References

  • 1 Hu H, Yao N, Qiu Y. Predictive value of 5 early warning scores for critical COVID-19 patients. Disaster Med Public Health Prep 2020; DOI: 10.1017/dmp.2020.324.
  • 2 Prytherch DR, Smith GB, Schmidt PE, Featherstone PI. ViEWS–Towards a national early warning score for detecting adult inpatient deterioration. Resuscitation 2010; 81 (08) 932-937
  • 3 Wynants L, Van Calster B, Collins GS. et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ 2020; 369: m1328
  • 4 Bedoya AD, Clement ME, Phelan M, Steorts RC, O'Brien C, Goldstein BA. Minimal impact of implemented early warning score and best practice alert for patient deterioration. Crit Care Med 2019; 47 (01) 49-55
  • 5 O'Brien C, Goldstein BA, Shen Y. et al. Development, implementation, and evaluation of an in-hospital optimized early warning score for patient deterioration. MDM Policy Pract 2020; 5 (01) 2381468319899663
  • 6 Subbe C, Thorpe C. Finally good NEWS: something simple is working in COVID-19!. Resuscitation 2021; 159: 168-169
  • 7 Villar SS, Machiwenyika JMT, Zhu Y, Mackay JH. The performance of the National Early Warning Score in hospitalised patients infected by Covid-19. Resuscitation 2021; 162: 441-442
  • 8 Steyerberg EW, Vickers AJ, Cook NR. et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010; 21 (01) 128-138
  • 9 Xia J, Zhang Y, Ni L. et al. High-flow nasal oxygen in coronavirus disease 2019 patients with acute hypoxemic respiratory failure: a multicenter, retrospective cohort study. Crit Care Med 2020; 48 (11) e1079-e1086
  • 10 Choi KJ, Hong HL, Kim EJ. The association between mortality and the oxygen saturation and fraction of inhaled oxygen in patients requiring oxygen therapy due to COVID-19-associated pneumonia. Tuberc Respir Dis (Seoul) 2021; 84 (02) 125-133
  • 11 Dillon K, Hook C, Coupland Z, Avery P, Taylor H, Lockyer A. Pre-hospital lowest recorded oxygen saturation independently predicts death in patients with COVID-19. Br Paramed J 2020; 5 (03) 59-65