Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Risk factors for in-hospital mortality in laboratory-confirmed COVID-19 patients in the Netherlands: A competing risk survival analysis

  • Gerine Nijman,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – original draft

    Affiliations Department of Internal Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands, Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands

  • Maike Wientjes,

    Roles Conceptualization, Formal analysis, Supervision, Writing – review & editing

    Affiliation Department of Research, Sint Maartenskliniek, Nijmegen, The Netherlands

  • Jordache Ramjith,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Department of Health Evidence, Section Biostatistics, Radboud University Medical Centre, Nijmegen, The Netherlands

  • Nico Janssen,

    Roles Data curation, Writing – review & editing

    Affiliations Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands, Centre of Expertise in Mycology, Radboud University Medical Centre, Canisius Wilhelmina Hospital, Nijmegen, The Netherlands

  • Jacobien Hoogerwerf,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliations Department of Internal Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands, Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands

  • Evertine Abbink,

    Roles Data curation, Project administration, Writing – review & editing

    Affiliation Department of Internal Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands

  • Marc Blaauw,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Internal Medicine, Bernhoven Hospital, Uden, The Netherlands

  • Ton Dofferhoff,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Internal Medicine, Canisius Wilhelmina Hospital, Nijmegen, The Netherlands

  • Marjan van Apeldoorn,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Internal Medicine, Jeroen Bosch Hospital, Den Bosch, The Netherlands

  • Karin Veerman,

    Roles Data curation, Writing – review & editing

    Affiliation Department of Internal Medicine, Sint Maartenskliniek, Nijmegen, The Netherlands

  • Quirijn de Mast,

    Roles Supervision, Writing – review & editing

    Affiliations Department of Internal Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands, Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands

  • Jaap ten Oever,

    Roles Supervision, Writing – review & editing

    Affiliations Department of Internal Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands, Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands

  • Wouter Hoefsloot,

    Roles Writing – review & editing

    Affiliations Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands, Department of Pulmonary Diseases, Radboud University Medical Centre, Nijmegen, The Netherlands

  • Monique H. Reijers,

    Roles Supervision, Writing – review & editing

    Affiliations Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands, Department of Pulmonary Diseases, Radboud University Medical Centre, Nijmegen, The Netherlands

  • Reinout van Crevel,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliations Department of Internal Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands, Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands

  •  [ ... ],
  • Josephine S. van de Maat

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Supervision, Writing – review & editing

    Josephine.vandemaat@radboudumc.nl

    Affiliations Department of Internal Medicine, Radboud University Medical Centre, Nijmegen, The Netherlands, Radboud Centre for Infectious Diseases (RCI), Radboud University Medical Centre, Nijmegen, The Netherlands

  • [ view all ]
  • [ view less ]

Abstract

Background

To date, survival data on risk factors for COVID-19 mortality in western Europe is limited, and none of the published survival studies have used a competing risk approach. This study aims to identify risk factors for in-hospital mortality in COVID-19 patients in the Netherlands, considering recovery as a competing risk.

Methods

In this observational multicenter cohort study we included adults with PCR-confirmed SARS-CoV-2 infection that were admitted to one of five hospitals in the Netherlands (March to May 2020). We performed a competing risk survival analysis, presenting cause-specific hazard ratios (HRCS) for the effect of preselected factors on the absolute risk of death and recovery.

Results

1,006 patients were included (63.9% male; median age 69 years, IQR: 58–77). Patients were hospitalized for a median duration of 6 days (IQR: 3–13); 243 (24.6%) of them died, 689 (69.9%) recovered, and 74 (7.4%) were censored. Patients with higher age (HRCS 1.10, 95% CI 1.08–1.12), immunocompromised state (HRCS 1.46, 95% CI 1.08–1.98), who used anticoagulants or antiplatelet medication (HRCS 1.38, 95% CI 1.01–1.88), with higher modified early warning score (MEWS) (HRCS 1.09, 95% CI 1.01–1.18), and higher blood LDH at time of admission (HRCS 6.68, 95% CI 1.95–22.8) had increased risk of death, whereas fever (HRCS 0.70, 95% CI 0.52–0.95) decreased risk of death. We found no increased mortality risk in male patients, high BMI or diabetes.

Conclusion

Our competing risk survival analysis confirms specific risk factors for COVID-19 mortality in a the Netherlands, which can be used for prediction research, more intense in-hospital monitoring or prioritizing particular patients for new treatments or vaccination.

Introduction

The pandemic of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) associated coronavirus disease 2019 (COVID-19) causes significant morbidity and mortality worldwide. The first laboratory-confirmed case of COVID-19 in the Netherlands was reported on February 27, 2020 [1]. The disease initially spread across the southern provinces and rapidly disseminated further throughout the country. Currently, the Netherlands is amidst a second wave of infections and >350 thousand confirmed cases have been reported, including >7 thousand deaths [2, 3].

Studies describing the clinical features of COVID-19 and risk factors associated with incidence and timing of poor outcome have been extensively published [4], but survival data regarding risk factors for COVID-19 mortality in north-western Europe is limited. Furthermore, to our knowledge, none of the published survival studies have considered recovery as competing risk for mortality. Not taking competing risks into account leads to biased mortality estimates and to overestimation of survival curves [5, 6]. Analyzing mortality data with a more accurate competing risk analysis adds to the growing body of evidence on disease course and risk factors of a poor COVID-19 outcome. More robust knowledge about these risk factors is crucial to inform international prediction research [4]. In the current phase of the pandemic, now specific vaccines are underway, correct identification of patients at risk of severe disease and mortality is essential to prioritize patients for vaccination. In addition, while the virus still circulates in the population, it can guide clinical decisions on close monitoring, ICU admission or selection for new treatments. Therefore, this study aims to identify risk factors for in-hospital mortality in laboratory-confirmed COVID-19 patients in the Netherlands, using a competing risk approach.

Materials and methods

In this observational, multicenter cohort study, we consecutively included adult patients with PCR-confirmed infection with SARS-CoV-2, who were admitted to one of five collaborating hospitals in the region of Gelderland and North-Brabant for at least 24 hours between March and May 2020. For the current analysis, we excluded patients if data regarding duration of hospital admission were missing for patients who died or recovered. A flow chart of inclusion is shown in S1 Fig. The study was approved by the institutional review board (IRB) of the Radboud university medical center (number 2020–2923 and 2020–6344). According to the IRB, only oral consent was required. Oral consent was obtained from all patients or their family and documented in the electronic medical records.

Data collection and definitions

We extracted routine data from the electronic medical records, including baseline patient characteristics, information on clinical presentation, diagnostics, disease course, treatment and outcome. All patient data were entered anonymously into a web-based electronic case report form (using Castor Electronic Data Capture), only using a study identifier. The key linking patient information to study ID was saved in a local, protected file in the participating hospitals and not available to the researchers performing data analyses. Detailed methods on data collection and definitions are described in our parallel publication in this issue. For the current analysis, we used the Modified Early Warning Score (MEWS) as a summary measure of abnormal vital signs, based on body temperature, blood pressure, heart rate, respiratory rate, and the Alert Voice Pain Unresponsive (AVPU) score [7]. The AVPU score was not reported in the electronic medical records, so we used ‘level of consciousness’ as a proxy in the MEWS, with ‘conscious’ indicating Alert, and ‘reduced level of consciousness’ substituting Verbal, Pain and Unresponsive. We totaled duration of intensive care unit (ICU) admission for patients who were admitted to the ICU more than once. Readmissions within 4 weeks after initial discharge were considered extensions of the initial hospitalization. Follow-up duration was set to the duration until database lock for patients still admitted at the end of the study (n = 6). We defined death as in-hospital death or palliative discharge. Patients who were discharged due to clinical improvement, for medical rehabilitation, or transfer to a nursing home were considered ‘recovered’. Patients who were transferred to a non-study hospital, who were lost to follow-up because of other reasons, or whose reason of discharge was unknown or missing were censored.

Statistical analysis

Descriptive analyses were performed. Furthermore, we used a competing risks survival analysis approach to evaluate the effect of risk factors on the time from admission to death and on the time from admission to recovery [8, 9]. According to Noordzij et al, a competing risk occurs ‘when subjects can experience one or more events or outcomes which ‘compete’ with the outcome of interest’ [9]. In our study, recovery is considered a competing risk for mortality and is taken into account as an extra outcome, whereas in standard survival analyses, patients who recover are censored. However, the latter violates the assumption of noninformative censoring, i.e. the recovered patients are not representative of those who are still admitted to the hospital in terms of their risk of dying. Censoring recovered patients induces bias and overestimation of survival curves, i.e. Kaplan Meier will estimate incidence of death with upwards biases [8, 9]. For the competing risk analysis, we estimated univariable and multivariable cause-specific hazard ratios (HRCS) for death and recovery for selected risk factors [5, 8]. These risk factors were pre-selected based on literature and expert opinion to be clinically relevant and routinely available at time of presentation, rather than based on statistical significance [10]. Furthermore, cumulative incidence probabilities were estimated using the Fine & Gray approach [5, 8]. Gray’s test was used to compare equality of cumulative incidence curves (CIFs) across subgroups [11, 12]. The proportional hazards assumption was checked by an evaluation of the Schoenfeld residuals, as shown in S2 Fig.

Multivariable HRCS were also estimated for a subpopulation of patients with a ‘non ICU admission policy’. The Netherlands executes a restrictive policy for ICU admission for patients who do not wish to be admitted to the ICU, or for whom the expected chance of recovery is thought to be too low or their overall prognosis too poor (e.g. because of comorbidity) to outweigh the potential harm of an ICU admission. The cause-specific hazard (CSH) model was fitted again for this subpopulation, to assess the influence of risk factors on the outcome in these patients. Statistical analyses were conducted in R (v1.2.1578), using the ‘survival’, ‘survminer’ and ‘cmprsk’ packages for time-to-event analyses. Laboratory values were log-transformed to adjust for their skewed distribution.

Missing data

Missing data in the variables ‘non ICU admission policy, ‘COVID treatment’, ‘oxygen supplementation’ and ‘ventilatory support’ were considered as ‘no’ or ‘none’, assuming that it would be reported in the medical records if the concerning variable applied to the patient. Furthermore, missing values in the variables ‘X-ray’, ‘CT-scan’, and ‘blood culture’ were considered as ‘not performed’, assuming that the results would be reported if patients had one of these tests. Missing values in all other variables were assumed to be missing at random (MAR) and were imputed using multiple imputation in ten datasets with the ‘MICE’ package. Analyses were performed on all ten imputed datasets and the results were pooled.

Results

We included 1,006 PCR-confirmed COVID-19 patients (see flowchart of inclusion in S1 Fig). Their median age of 69 years (IQR: 58–77), most were male and presented with fever, cough and dyspnea, as shown in Table 1. Nearly all patients had one or more comorbidities. Of all patients, 243 (24.6%) died in-hospital or were discharged for palliative care, 689 (69.9%) recovered, and 74 (7.4%) were censored. The median duration of hospital admission until death and recovery was 6 days (IQR: 3–11) and 7 days (IQR: 4–13), respectively.

Cumulative incidence curves

The CIF curves of the total population show that the probability of death after one, two and three weeks of hospital admission was 15.4% (95% 13.1–17.6), 20.5% (95% CI 18.0–23.0), and 22.4% (95% CI 19.8–25.0), respectively (Fig 1). The probabilities of recovery were 38.6% (95% CI 35.5–41.6), 54.1% (95% CI 51.0–57.2), and 60.3% (95% CI 57.3–63.3), respectively. Patients aged ≥70 years had a higher chance of death (p<0.001) and a lower chance of recovery (p<0.001) than patients aged <70 years (Fig 2). Males had a lower probability of recovery (p = 0.003) than females, but there was no statistical difference between both groups for death (p = 0.05) (Fig 3).

thumbnail
Fig 1. Cumulative incidence plot of death and recovery in the total population.

The probability of death conditional on not having recovered after one, two and three weeks of hospital admission was 15.4% (95% 13.1–17.6), 20.5% (95% CI 18.0–23.0), and 22.4% (95% CI 19.8–25.0), respectively. The probability of recovery conditional on not having died after one, two and three weeks of hospital admission was 38.6% (95% CI 35.5–41.6), 54.1% (95% CI 51.0–57.2), and 60.3% (95% CI 57.3–63.3).

https://doi.org/10.1371/journal.pone.0249231.g001

thumbnail
Fig 2. Cumulative incidence plot of death and recovery in the total population, separated by age group.

Gray’s test indicated a significant difference between two groups for both death (p<0.001) and recovery (p<0.001). The probability of death for patients aged <70 years after one, two and three weeks of hospital admission was 3.6% (95% CI 2–5.2), 5.4% (95% CI 3.4–7.4), and 6.5% (95% CI 4.3–8.6), respectively, whereas for patients aged ≥70 years, the probability of death was 27.8% (95% CI 23.8–31.8), 36.4% (95% CI 32.1–40.7), and 39.2% (95% CI 34.8–43.5), respectively.

https://doi.org/10.1371/journal.pone.0249231.g002

thumbnail
Fig 3. Cumulative incidence plot of death and recovery in the total population, separated by sex.

Gray’s test indicated a statistically significant difference between both groups for recovery (p = 0.003), but not for death (p = 0.050). The probability of death for females after one, two and three weeks of hospital admission was 12.5% (95% CI 10.0–17.1), 17.6% (95% CI 13.7–21.6), and 19.1% (95% CI 15.0–23.2), respectively, whereas for males the probability of death was 16.4% (95% CI 13.5–19.3), 22.1% (95% CI 18.9–25.4), and 24.3% (95% CI 20.9–27.6), respectively.

https://doi.org/10.1371/journal.pone.0249231.g003

Univariable and multivariable SH model

HRCS from univariable and multivariable SH models are reported in Table 2. Univariable analyses showed that older age increased the risk of death: with every year increase in age, the risk of death increased with 9% (HRCS 1.09, 95% CI 1.08–1.11), and the chances of recovery decreased with 1% (HRCS 0.99, 95% CI 0.98–0.99). Of the comorbidities, cardiovascular disease, hypertension and pulmonary diseased increased risk of death. Patients with cardiovascular disease had a 99% increase in the risk of death (HRCS 1.99, 95% CI 1.50–2.65), and a 17% decrease in the chances of recovery (HRCS 0.83, 95% CI 0.72–0.97). Patients with hypertension had a 39% increase in the risk of death (HRCS 1.39, 95% CI 1.07–1.79), and a 130% increase in chances of recovery (HRCS 2.30, 95% CI 1.98–2.68). Furthermore, patients with pulmonary disease had a 42% increase in risk of death (HRCS 1.42, 95% CI 1.08–1.88).

thumbnail
Table 2. Univariable and multivariable cause-specific hazard ratios (HRCS) including 95% confidence intervals for death and recovery.

https://doi.org/10.1371/journal.pone.0249231.t002

In terms of medication, both chronic use of anticoagulants or antiplatelet medication as well as ACE inhibitors or angiotensin-II receptor blockers were associated with an increased risk of death (HRCS 2.23, 95% CI 1.73–2.87, and HRCS 1.38, 95% CI 1.07–1.79, respectively). For symptoms, both fever and dyspnea decreased risk of death. Patients with fever had a 45% decrease in risk of death (HRCS 0.55, 95% CI 0.42–0.72) and patients with dyspnea a 25% decrease in risk of death (HRCS 0.75, 95% CI 0.57–0.98). In terms of diagnostics, neutrophil-to-lymphocyte rate, creatinine levels and ferritin levels at time of admission were associated with risk of death and risk of recovery. A ten-fold increase in the neutrophil-to-lymphocyte rate was associated with a 58% increase in risk of death (HRCS 1.58, 95% CI 1.02–2.42) and a 35% decrease in the chance of recovery (HRCS 0.65, 95% CI 0.50–0.85). Furthermore, a ten-fold increase in creatinine levels at time of admission were associated with a 444% increased risk of death (HRCS 5.44, 95% CI 3.13–9.44) and a 37% decrease in chances of recovery (HRCS 0.63, 95% CI 0.40–0.99). Finally, a ten-fold increase in ferritin levels at time of admission was associated with a 31% decrease in risk of death (HRCS 0.69, 95% CI 0.50–0.96), and a 42% decrease in chances of recovery (HRCS 0.58, 95% CI 0.49–0.70).

In multivariable analyses, the following factors were associated with risk of death: age, immunocompromised state, chronic use of anticoagulants or antiplatelet medication, fever, MEWS, lactate dehydrogenase values at time of admission, and ferritin values at time of admission. Firstly, with every year increase in age, the risk of death increased with 10% (HRCS 1.10, 95% CI 1.08–1.12), and the chances of recovery decreased with 1% (HRCS 0.99, 95% CI 0.98–0.99). In other words, if in two patients all variables except for age are the same, the patient who is one year older has a 10% higher risk of dying. Furthermore, patients with immunocompromised state had a 46% increased risk of death (HRCS 1.46, 95% CI 1.08–1.98), and 24% decrease in chances of recovery (HRCS 0.76, 95% CI 0.62–0.93). Moreover, patients that used anticoagulants or antiplatelet medication had a 38% increase in risk of death (HRCS 1.38, 95% CI 1.01–1.88). Furthermore, patients with fever had a 30% decrease in risk of death (HRCS 0.70, 95% CI 0.52–0.95). In terms of diagnostics, with every unit increase of MEWS, the risk of death increased with 9% (HRCS 1.09, 95% CI 1.01–1.18). Moreover, a ten-fold increase in lactate dehydrogenase values at time of admission was associated with a 568% increase in risk of death (HRCS 6.68, 95% CI 1.95–22.8), and a 75% decrease in chances of recovery (HRCS 0.25, 95% CI 0.13–0.48). Finally, a ten-fold increase in ferritin values at time of admission was associated with a 23% decrease in chances of recovery (HRCS 0.77, 95% CI 0.60–0.99).

Non ICU admission policy

In this study, 318 (31.5%) patients had a non ICU admission policy, of whom 199 (62.6%) were male, with a median age of 79 years (IQR 74–83), and a median MEWS of 2 (IQR 2–4). Of these patients, 151 (47.5%) recovered, 158 (49.7%) died and 9 (2.8%) were censored. Multivariable analyses revealed no statistically significant associations with risk of death, but that patients with longer symptom duration had an increased chance of recovery (HRCS 1.02, 95% CI 1.00–1.04) and patients with symptoms of dyspnea had a decreased chance of recovery (HRCS 0.65, 95% CI 0.44–0.96).

Discussion

Summary of findings

In this Dutch hospital population, approximately a quarter of all COVID-19 patients died after a median hospital admission of six days during the first wave of the epidemic. Using a competing risk approach, we identified age, comorbidities, such as cardiovascular diseases, symptoms, and abnormal laboratory values as the most important risk factors in univariate analyses. After adjusting for all relevant factors at baseline, we found that higher age, immunocompromised state, chronic use of anticoagulants or antiplatelet medication, higher MEWS, and higher values of LDH at time of hospital admission were associated with increased risk of death. On the other hand, fever at time of admission was associated with lower mortality. Male sex was not a significant risk factor for mortality.

Interpretation of results and comparison to literature

Conventional survival analyses do not take competing risks into account, which leads to biased mortality estimates and to overestimation of survival curves. Using the competing risk approach, we took into account that patients who recovered were no longer at the same risk of dying than those who remained hospitalized, resulting in less biased mortality estimates. Even though death or recovery are the two possible final outcomes of the disease, the time to death and time to recovery may not the same (i.e. time to death was generally shorter than time to recovery). In addition, 10% of our patients were censored due to transfer to other hospitals. As a result, the risk factors influencing death may differ from risk factors for recovery [13]. For example, we identified strong risk factors that both increased the risk of dying and reduced the recovery risk, namely higher age, immunosuppression and high LDH values at admission. At the same time, use of anticoagulant or antiplatelet medication and a high MEWS were only associated with an increased risk of dying. Fever at admission reduced this risk, and ferritin showed equivocal results, reducing the risk of death as well as the risk of recovery.

In our study population, approximately 25% of all patients died, which is consistent with other studies [14, 15]. Our study showed that age and higher MEWS at time of admission were risk factors for in-hospital mortality, which is in line with results of many other studies [4, 1618]. Higher blood LDH levels at time of admission increased the probability of death and decreased the chance of recovery, which is in line with a growing body of evidence [4, 19, 20]. We included both cardiovascular disease and hypertension in our model, which may be subject to collinearity. However, a sensitivity analyses excluding hypertension from the model did not change our estimates and standard errors, showing that our reported estimates are valid. We found immunosuppression as a risk factor for mortality. This has been reported previously, although the exact role of the immune system in COVID-19 is complex [16, 21, 22]. Poor outcome could be determined by a declining immune system less able to clear the virus, but lung tissue damage in severe cases could also be caused by an exaggerated immune response, rather than damage inflicted by the virus itself [2326]. Consequently, immunocompromised patients may be protected from this type of hyperinflammation [21, 27]. We found that chronic use of anticoagulants or antiplatelet medication was associated with increased risk of death. Although this may be partially explained by the fact that these medications are used by patients with cardiovascular disease, which has been reported as an individual risk factor for in-hospital mortality [4], anticoagulant and/or antiplatelet medication remained an independent risk factor for death in our multivariable analyses. Thromboembolic events are frequently reported in association with severe COVID-19 disease and mortality [28, 29], and current guidelines suggest prophylactic anticoagulants in all hospitalized COVID-19 patients if not contraindicated. However, studies have reported conflicting results regarding the effect of anticoagulants/antiplatelet medication on COVID-19 mortality [30], ranging from a protective effect [31] to a harmful effect [32, 33], or no association [31, 34]. Prospective studies and RCTs are needed to explore the true effects of these medications in hospitalized COVID-19 patients.

Findings of a living systematic review of 23 prognostic studies about COVID-19 mortality indicated that age, immunocompromising comorbidities, composite scores of vital parameters and blood LDH are frequently reported predictors of in-hospital mortality, similar to our findings [4]. Blood ferritin levels and anticoagulants or antiplatelet medication were scarcely reported [4]. On the other hand, male sex and comorbidities, such as cardiovascular and pulmonary diseases, that were significantly associated with in-hospital mortality in our univariable but not multivariable analyses, were frequently reported in other prognostic studies. This is an important finding and shows that many of these risk factors are interacting with each other. Last, we found no increased risk of dying in patients with male sex, high BMI or diabetes, which are also risk factors that have been reported previously. Larger studies may be needed to reveal additional risk factors of clinical importance.

Strengths and limitations

A strength of this study is the large, multicenter population in an area in which infections were clustered. We analyzed mortality in COVID-19 patients using a competing risk approach, leading to more accurate risk estimates for mortality than when using conventional survival analysis. As previously explained, conventional survival analyses may have resulted in biased estimates and Kaplan-Meier curves presenting overestimated incidence of death. There were some limitations to this study. First, approximately 10% of patients in our study were censored, mainly due to frequent transfer of patients. However, this was considered within acceptable limits [3537]. Second, our data consisted of routinely collected data, resulting in missing values in several variables. We used multiple imputation to minimize associated bias. The advantage of routinely collected data is that the study’s predictors are readily available and be used in clinical practice without extra effort. All reported predictors are variables measured at time of hospital admission, which means that these factors can be used to identify patients in need of more intensive care and monitoring in an early stage of hospitalization. Finally, data were collected in multiple centers with differences in manner of reporting in medical records and differences in clinical management. The advantage of this multicenter approach is that it increased the generalizability of our findings.

Conclusion

Using a robust, competing risk survival analysis, our study confirmed specific risk factors for in-hospital COVID-19 mortality, adding rigor to the current knowledge of risk factors. We confirmed that age, immunocompromised state, use of anticoagulants or antiplatelet medication, MEWS, blood LDH are important risk factors for death in hospitalized COVID-19 patients. The risk factors we identified are mostly in line with the growing body of evidence on COVID-19, although we did not find evidence for increased mortality risk in male patients or those with high BMI or diabetes. All identified risk factors are routinely available at time of admission. They can be used to guide clinical decisions on intense monitoring of patients in-hospital, or to select patients that may benefit most from new treatments. In addition, the more general risk factors like age and comorbidities could be used to prioritize patients for vaccinations in current times where vaccines are still scarce. Lastly, our risk factor analysis provides further input for international prediction research for mortality of COVID-19.

Supporting information

S1 Checklist. STROBE statement—checklist of items that should be included in reports of cohort studies.

https://doi.org/10.1371/journal.pone.0249231.s001

(PDF)

S2 Fig. Schoenfeld residuals plots.

A. Plots of the Schoenfeld residuals for the multivariable CSH model for death. B. Plots of the Schoenfeld residuals for the multivariable CSH model for recovery.

https://doi.org/10.1371/journal.pone.0249231.s003

(PDF)

Acknowledgments

We thank the RCI-COVID-19 study group for clinical input and critical feedback. Furthermore, we thank all students and nurses that helped to extract data from electronic records.

References

  1. 1. Dutch National Institute for Public Health and the Environment (RIVM). Patient with novel coronavirus COVID-19 in the Netherlands 2020 [updated 27-02-2020. Available from: https://www.rivm.nl/en/news/patient-with-novel-coronavirus-covid-19-in-netherlands.
  2. 2. Dutch National Institute for Public Health and the Environment (RIVM). Current information about the novel coronavirus (COVID-19) 2020 [updated 06-04-2020. Available from: https://www.rivm.nl/en/current-information-about-novel-coronavirus-covid-19.
  3. 3. World Health Organization (WHO. Coronavirus (COVID-19), global situation dashboard: WHO; 2020 [Available from: https://covid19.who.int/.
  4. 4. Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ. 2020;369:m1328. pmid:32265220
  5. 5. Schuster NA, Hoogendijk EO, Kok AAL, Twisk JWR, Heymans MW. Ignoring competing events in the analysis of survival data may lead to biased results: a nonmathematical illustration of competing risk analysis. Journal of clinical epidemiology. 2020;122:42–8. pmid:32165133
  6. 6. Oulhaj A, Ahmed LA, Prattes J, Suliman A, Alsuwaidi A, Al-Rifai RH, et al. Preprint: The competing risk between in-hospital mortality and recovery: A pitfall in COVID-19 survival analysis research. medRxiv. 2020.
  7. 7. Subbe CP, Kruger M, Rutherford P, Gemmel L. Validation of a modified Early Warning Score in medical admissions. QJM: An International Journal of Medicine. 2001;94(10):521–6.
  8. 8. Austin PC, Lee DS, Fine JP. Introduction to the Analysis of Survival Data in the Presence of Competing Risks. Circulation. 2016;133(6):601–9. pmid:26858290
  9. 9. Noordzij M, Leffondré K, van Stralen KJ, Zoccali C, Dekker FW, Jager KJ. When do we need competing risks methods for survival analysis in nephrology? Nephrology Dialysis Transplantation. 2013;28(11):2670–7. pmid:23975843
  10. 10. Steyerberg EW. Clinical prediction models: a practical approach to development, validation, and updating.: Springer US; 2019.
  11. 11. Gray RJ. A Class of K-Sample Tests for Comparing the Cumulative Incidence of a Competing Risk. The Annals of Statistics. 1988;16(3):1141–54.
  12. 12. Scrucca L, Santucci A, Aversa F. Competing risk analysis using R: an easy guide for clinicians. Bone marrow transplantation. 2007;40(4):381–7. pmid:17563735
  13. 13. Dignam JJ, Zhang Q, Kocherginsky M. The use and interpretation of competing risks regression models. Clin Cancer Res. 2012;18(8):2301–8. pmid:22282466
  14. 14. Wiersinga WJ, Rhodes A, Cheng AC, Peacock SJ, Prescott HC. Pathophysiology, Transmission, Diagnosis, and Treatment of Coronavirus Disease 2019 (COVID-19): A Review. JAMA. 2020;324(8):782–93. pmid:32648899
  15. 15. Goel S, Jain T, Hooda A, Malhotra R, Johal G, Masoomi R, et al. Clinical Characteristics and In-Hospital Mortality for COVID-19 Across The Globe. Cardiology and Therapy. 2020;9(2):553–9. pmid:32683639
  16. 16. Parohan M, Yaghoubi S, Seraji A, Javanbakht MH, Sarraf P, Djalali M. Risk factors for mortality in patients with Coronavirus disease 2019 (COVID-19) infection: a systematic review and meta-analysis of observational studies. The Aging Male. 2020:1–9. pmid:32508193
  17. 17. Lu L, Zhong W, Bian Z, Li Z, Zhang K, Liang B, et al. A comparison of mortality-related risk factors of COVID-19, SARS, and MERS: A systematic review and meta-analysis. Journal of Infection. 2020;81(4):e18–e25.
  18. 18. Hu H, Yao N, Qiu Y. Comparing Rapid Scoring Systems in Mortality Prediction of Critically Ill Patients With Novel Coronavirus Disease. Academic Emergency Medicine. 2020;27(6):461–8. pmid:32311790
  19. 19. Henry BM, Aggarwal G, Wong J, Benoit S, Vikse J, Plebani M, et al. Lactate dehydrogenase levels predict coronavirus disease 2019 (COVID-19) severity and mortality: A pooled analysis. Am J Emerg Med. 2020;38(9):1722–6. pmid:32738466
  20. 20. Erez A, Shental O, Tchebiner JZ, Laufer-Perl M, Wasserman A, Sella T, et al. Diagnostic and prognostic value of very high serum lactate dehydrogenase in admitted medical patients. The Israel Medical Association journal: IMAJ. 2014;16(7):439–43. pmid:25167691
  21. 21. Fung M, Babik JM. COVID-19 in Immunocompromised Hosts: What We Know So Far. Clin Infect Dis. 2020:ciaa863.
  22. 22. Gao Y, Chen Y, Liu M, Shi S, Tian J. Impacts of immunosuppression and immunodeficiency on COVID-19: A systematic review and meta-analysis. The Journal of infection. 2020:S0163-4453(20)30294–2. pmid:32417309
  23. 23. Mehta P, McAuley DF, Brown M, Sanchez E, Tattersall RS, Manson JJ, et al. COVID-19: consider cytokine storm syndromes and immunosuppression. Lancet (London, England). 2020;395(10229):1033–4. pmid:32192578
  24. 24. Coperchini F, Chiovato L, Croce L, Magri F, Rotondi M. The cytokine storm in COVID-19: An overview of the involvement of the chemokine/chemokine-receptor system. Cytokine & growth factor reviews. 2020;53:25–32. pmid:32446778
  25. 25. Abdulamir AS, Hafidh RRJEJoGM. The Possible Immunological Pathways for the Variable Immunopathogenesis of COVID—19 Infections among Healthy Adults, Elderly and Children. 2020;17(4).
  26. 26. Prompetchara E, Ketloy C, Palaga T. Immune responses in COVID-19 and potential vaccines: Lessons learned from SARS and MERS epidemic. Asian Pacific journal of allergy and immunology. 2020;38(1):1–9. pmid:32105090
  27. 27. Minotti C, Tirelli F, Barbieri E, Giaquinto C, Donà D. How is immunosuppressive status affecting children and adults in SARS-CoV-2 infection? A systematic review. J Infect. 2020;81(1):e61–e6. pmid:32335173
  28. 28. Bavaro DF, Poliseno M, Scardapane A, Belati A, De Gennaro N, Stabile Ianora AA, et al. Occurrence of Acute Pulmonary Embolism in COVID-19-A case series. Int J Infect Dis. 2020;98:225–6. pmid:32585286
  29. 29. Malas MB, Naazie IN, Elsayed N, Mathlouthi A, Marmor R, Clary B. Thromboembolism risk of COVID-19 is high and associated with a higher risk of mortality: A systematic review and meta-analysis. EClinicalMedicine. 2020;29. pmid:33251499
  30. 30. Salah HM, Naser JA, Calcaterra G, Bassareo PP, Mehta JL. The Effect of Anticoagulation Use on Mortality in COVID-19 Infection. Am J Cardiol. 2020;134:155–7. pmid:32892991
  31. 31. Wijaya I, Andhika R, Huang I. The Use of Therapeutic-Dose Anticoagulation and Its Effect on Mortality in Patients With COVID-19: A Systematic Review. Clinical and Applied Thrombosis/Hemostasis. 2020;26:1076029620960797. pmid:33079569
  32. 32. Chen F, Sun W, Sun S, Li Z, Wang Z, Yu L. Clinical characteristics and risk factors for mortality among inpatients with COVID-19 in Wuhan, China. Clinical and translational medicine. 2020;10(2):e40. pmid:32508024
  33. 33. Giacomelli A, Ridolfo AL, Milazzo L, Oreni L, Bernacchia D, Siano M, et al. 30-day mortality in patients hospitalized with COVID-19 during the first wave of the Italian epidemic: A prospective cohort study. Pharmacol Res. 2020;158:104931–. pmid:32446978
  34. 34. Klok FA, Kruip MJHA, van der Meer NJM, Arbous MS, Gommers D, Kant KM, et al. Confirmation of the high cumulative incidence of thrombotic complications in critically ill ICU patients with COVID-19: An updated analysis. Thromb Res. 2020;191:148–50. pmid:32381264
  35. 35. Qin J, Shen Y. Statistical methods for analyzing right-censored length-biased data under cox model. Biometrics. 2010;66(2):382–92. pmid:19522872
  36. 36. Demler OV, Paynter NP, Cook NR. Reclassification calibration test for censored survival data: performance and comparison to goodness-of-fit criteria. Diagnostic and Prognostic Research. 2018;2(1):16. pmid:30984876
  37. 37. Zhu X, Zhou X, Zhang Y, Sun X, Liu H, Zhang Y. Reporting and methodological quality of survival analysis in articles published in Chinese oncology journals. Medicine (Baltimore). 2017;96(50):e9204–e. pmid:29390340