- Published
- 21 January 2021
- Journal article
Evaluation and Improvement of the National Early Warning Score (NEWS2) for COVID-19: a multi-hospital study
- Authors
-
- Source
- BMC Medicine
Abstract
Background
The National Early Warning Score (NEWS2) is currently recommended in
the United Kingdom for risk-stratification of COVID patients, but little is
known about its ability to detect severe cases. We aimed to evaluate NEWS2
for prediction of severe COVID outcome and identify and validate a set of
blood and physiological parameters routinely-collected at hospital admission
to improve upon use of NEWS2 alone for medium-term risk stratification.
Methods
Training cohorts comprised 1276 patients admitted to King’s College
Hospital NHS Foundation Trust with COVID-19 disease from 1st March to
30th April 2020. External validation cohorts included 6237 patients from five
UK NHS Trusts (Guys and St Thomas’ Hospitals, University Hospitals
Southampton, University Hospitals Bristol and Weston NHS Foundation
Trust, University College London Hospitals, University Hospitals
Birmingham), one hospital in Norway (Oslo University Hospital), and two
hospitals in Wuhan, China (Wuhan Sixth Hospital and Taikang Tongji
Hospital). The outcome was severe COVID disease (transfer to intensive care
unit or death) at 14 days after hospital admission. Age, physiological
measures, blood biomarkers, sex, ethnicity and comorbidities (hypertension,
diabetes, cardiovascular, respiratory and kidney diseases) measured at
hospital admission were considered in the models.
Results
A baseline model of ‘NEWS2 + age’ had poor-to-moderate discrimination for
severe COVID infection at 14 days (area under receiver operating
characteristic curve (AUC) in training cohort = 0.700; 95% CI: 0.680, 0.722;
Brier score = 0.192; 95% CI: 0.186, 0.197). A supplemented model adding
eight routinely-collected blood and physiological parameters (supplemental
oxygen flow rate, urea, age, oxygen saturation, CRP, estimated GFR,
neutrophil count, neutrophil/lymphocyte ratio) improved discrimination
(AUC = 0.735; 95% CI: 0.715, 0.757) and these improvements were
replicated across seven UK and non-UK sites. However, there was evidence
of miscalibration with the model tending to underestimate risks in most sites.
Conclusions
NEWS2 score had poor-to-moderate discrimination for medium-term COVID
outcome which raises questions about its use as a screening tool at hospital
admission. Risk stratification was improved by including readily available
blood and physiological parameters measured at hospital admission, but there
was evidence of miscalibration in external sites. This highlights the need for a
better understanding of the use of early warning scores for COVID.
Cite as
Carr, E., Bendayan, R., Bean, D., Stammers, M., Wang, W., Zhang, H., Searle, T., Kraljevic, Z., Shek, A., Phan, H., London, K., Gupta, R., Shinton, A., Wyatt, M., Shi, T., Zhang, X., Pickles, A., Stahl, D., Zakeri, R., Noursadeghi, M., O'Gallagher, K., Rogers, M., Folarin, A., Karwath, A., Wickstrom, K., Kohn-Luque, A., Slater, L., Cardoso, V., Bourdeaux, C., Holten, A., Ball, S., McWilliams, C., Roguski, L., Borca, F., Bachelor, J., Amundsen, E., Wu, X., Gkoutos, G., Sun, J., Pinto, A., Guthrie, B., Breen, C., Douiri, A., Wu, H., Curcin, V., Teo, J., M Shah, A. & Dodson, R. 2021, 'Evaluation and Improvement of the National Early Warning Score (NEWS2) for COVID-19: a multi-hospital study', BMC Medicine, 19, article no: 23. https://doi.org/10.1186/s12916-020-01893-3