Introduction

Coronavirus disease 2019 (COVID-19) [1, 2] caused by the novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has evolved into a global pandemic with devastating morbidity and mortality. The widespread outbreaks with recent spikes across the globe and the likelihood of recurrences have strained and will continue to strain healthcare resources. COVID-19 infection causes disproportional inflammatory responses and cytokine storm that often result in multiple organ failure. Acute kidney injury (AKI) has become a hallmark of COVID-19 infection and is associated with high incidence of critical illness and mortality in COVID-19 patients [1,2,3,4,5,6,7,8,9,10,11,12]. Kidneys could be damaged directly by the virus per se or indirectly by host-immune responses (i.e., hypoxia, thrombosis, cytotropic and cytokine-mediated immune responses, amongst others) [13,14,15]. Whether direct damage of the kidney and whether renal infection is common in patients with less severe COVID-19 is not yet established [13].

Although a few studies have found some clinical variables, usually at hospital admission, to be associated with high likelihood of in-hospital AKI [16,17,18], predicting AKI using only clinical variables at admission is likely inaccurate because patients came into hospitals at different stages of disease severity or they might already have community-acquired AKI. To our knowledge, there has been no systematic evaluation of the temporal characteristics of clinical variables leading up to in-hospital AKI in COVID-19 and how these temporal characteristics are judiciously used to inform clinical decision-making. The association of AKI evolution with respect to other clinical laboratory variables in the context of COVID-19 disease remains poorly understood. The ability to recognize AKI early and anticipate AKI development could improve patient management that include hemodynamic support, renal replacement therapy, and avoid non-steroidal anti-inflammatory drugs, nephrotoxins, and contrast [6,7,8,9,10,11,12], ultimately improving clinical outcomes.

The goal of this study was thus to investigate the temporal characteristics of clinical variables associated with hospital-acquired AKI in COVID-19 patients and to predict hospital-acquired AKI onset. We analyzed the temporal progression of different clinical variables with time lock to AKI onset and developed a mathematical model to predict hospital-acquired AKI at different days prior to onset. Association of treatments (invasive mechanical ventilation, anticoagulant, and steroids) with hospital-acquired AKI was also explored. This study was done using data from two hospital systems. To our knowledge, this is the first systematic documentation of the longitudinal clinical variables leading up to AKI onset and the first longitudinal prediction of AKI onset in COVID-19.

Methods

Study population and data collection

Our study followed the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD). All methods were carried out in accordance with relevant guidelines and regulations, including those of stated in the “Declaration of Helsinki.” Data came from two sites: The Stony Brook University Hospital (Stony Brook, New York, USA) data were used for training, while the Tongji Hospital (Wuhan, China) data were used for testing purposes.

Stony Brook data

The Stony Brook data came from Stony Brook University Hospital (Stony Brook, NY), a 624-bed facility, for exempted informed consent and HIPAA waiver from the Institutional Research Board (IRB 2020-00207). Figure 1 shows the patient selection. Our COVID-19 Persons Under Investigation Registry of patients through the Emergency Department consisted of 6,678 persons clinically suspected of COVID-19 infection from February 7, 2020 to June 30, 2020, of which 2892 were tested positive using real-time polymerase chain reaction test for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) on a nasopharyngeal swab specimen. Data of these cohort have been used previously for studies of different research questions [19,20,21,22,23,24,25,26,27]. All COVID-19 patients in this study were in-patient.

Fig. 1
figure 1

Flowchart of patient selection of acute kidney injury (AKI) patients and non-AKI (NAKI) patients of the Stony Brook data. Pts patients, ICU intensive care unit, Cr creatinine, C-AKI community-acquired AKI)

AKI was defined by KDIGO criteria [28, 29] with either a 0.3 mg/dl increase in serum creatinine within 48 h or 1.5 times the lowest reading during hospitalization due to lack of data prior to hospitalization, which served as a baseline [11, 30]. Patients in our cohort did not declare ESRD and, therefore, to our knowledge, we excluded all ESRD patients on dialysis. Non-AKI COVID-19 patients were those whose blood creatinine level did not rise above the threshold defined by KDIGO criteria during the entire time of their hospital stays.

Exclusion included patients with no creatinine reading (N = 73), < 18 years old (N = 23), still in the hospital at the time of this analysis (N = 21) and had community-acquired AKI (N = 295) defined as patients who had AKI within 24 h of admission by KDIGO standards [28, 29]. The final sample size used in this analysis was 1029 patients meeting the inclusion/exclusion criteria. Urine output was not used due unavailable urine data.

Demographics and chronic comorbidities, longitudinal vital signs, laboratory blood tests, and blood gases were extracted from electronic medical records. Demographic data included age, gender, ethnicity and race. Chronic comorbidities included smoking, diabetes, hypertension, asthma, chronic obstructive pulmonary disease (COPD), coronary artery disease, heart failure, cancer, immunosuppression and chronic kidney disease. Longitudinal laboratory tests included creatinine (Cr), procalcitonin (PROCAL), aspartate transaminase (AST), alanine aminotransferase (ALT), ferritin (FERR), lactate dehydrogenase (LDH), white blood cell count (WBC), C-reactive protein (CRP), lymphocytes count (LYMPH), D-dimer (DDIM), brain natriuretic peptide (BNP), estimated glomerular filtration rate (eGFR), and albumin concentration. Longitudinal vital signs included heart rate (HR), diastolic blood pressure (DBP), systolic blood pressure (SBP), respiratory rate (RR), pulse oxygen saturation (SpO2), and temperature (temp). Longitudinal blood gas variables include pO2, pCO2, and pH. In addition, we also collected the treatment onset of invasive mechanical ventilation (IMV), prophylactic and therapeutic anticoagulants and steroids relative to AKI onset.

We time-locked the time-series laboratory test variables to the day of AKI onset. Laboratory test variables were plotted across time with time lock (t = 0) to AKI onset, along with data 3 days before and 3 days after AKI onset. For comparison, time-series data for NAKI patients were time locked (t = 0) to 3 days after ED admission, along with data 3 days before and 3 days after that time point. The 3 days post-ED admission was chosen because COVID-19 patients on average developed AKI 3.3 days after ED admission (see Results). For ease of comparison, individual laboratory test values were also normalized to the NAKI group at t = 0 for individual patients.

Note that many patients developed AKI after 1, 2 or 3 days post-admission and thus these patients did not contribute to − 3, − 2, or − 1 day prior to onset. Removing data of patients with onset of 1, 2 or 3 days post-admission did not alter the temporal characteristics of the time courses of all clinical variables.

Tongji Hospital data

The Tongji Hospital (Wuhan, China) data were obtained from Jan 10, 2020 to Feb 24, 2020 (N = 485, of which 375 met the inclusion and exclusion criteria) with approval of their institutional review board and waiver of informed consent [27, 31]. This dataset was used for “testing.”

Prediction model

We built logistic regression models to predict outcomes at each day prior to AKI onset. Prediction was performed using individual variables and combination of a few top predictors, and at a few time points prior to AKI onset. We time-locked to the day of onset. We performed prediction up to 3 days prior because AUC performance dropped close to chance at and beyond 3 days prior. Prediction performance was evaluated by the area under the curve (AUC) of the receiver operating characteristic (ROC) curve.

Statistical analysis

All statistical analyses were performed using Python packages (Sklearn and Statsmodels, Python Software Foundation, Wilmington, DE) and SAS software (Analytics Software and Solution, Cary, NC). Frequencies and percentages for categorical variables between the AKI and NAKI groups were compared using χ2 tests. Continuous variables, expressed as median (IQR), were compared between groups using nonparametric Mann–Whitney U tests. Mortality rates were compared between groups with χ2 tests adjusted with covariates. Differences between AKI and NAKI group for clinical variables in time series graphs was analyzed via linear mixed model and least squares means test with Tukey’s adjustment. P values < 0.05 were considered statistically significant unless otherwise specified. P values and odd ratios for mortality were adjusted for age, ethnicity, and significant comorbidities.

Results

Stony Brook data

In the Stony Brook data, the general floor cohort, had 197 AKI and 681 NAKI patients (22.4% AKI prevalence), with the mortality rate of 14.7% and 6.0%, respectively. The ICU cohort had 111 AKI and 40 NAKI patients (73.5% AKI prevalence), with the mortality rate of 61.3% and 22.5%, respectively. Overall, AKI patients had a markedly higher mortality rate than NAKI patients (31.5% vs 6.9%, adjusted p < 0.001, adjusted OR of 4.67 [95% CI 3.1, 7.0]. The overall AKI prevalence rate was 23.0%.

Table 1 summarizes patient demographics and comorbidities of the Stony Brook data. The median age of hospital-acquired AKI cohort was older than that of the NAKI cohort (p < 0.001). Sex was not significantly different between groups. Ethnicity (p = 0.003), but not race (p = 0.66), was significantly different between groups. Smoking, diabetes, hypertension, coronary artery disease, cancer, chronic kidney disease (p < 0.05), but not asthma, COPD, and immunosuppression (p > 0.05), were significantly between groups. AKI patients generally had more comorbidities.

Table 1 Demographic information of the Stony Brook dataset

The majority of patients developed AKI within a few days of hospital admission, averaging 3.3 days (median = 2 days). There were 36.2%, 21.4%, 15.5%, 6.6%, 5.3%, 3.6%, 3.3%, and 8.2% of COVID-19 patients developed AKI after 1, 2, 3, 4, 5, 6, 7, > 7 days of hospitalization, respectively (Fig. 2).

Fig. 2
figure 2

Histogram of patients developed AKI after hospitalization in days of Stony Brook data

Figure 3 depicts the time series of laboratory tests relative to AKI onset of the Stony Brook data. Laboratory values were normalized to the NAKI group at t = 0 by individual patients. In the NAKI cohort, Cr remained low and time invariant. In the AKI cohort, Cr spiked 4.5 times from baseline at t = 0 and returned toward baseline but above NAKI level.

Fig. 3
figure 3

Time courses of normalized laboratory tests of HAKI and NAKI COVID-19 patients of the Stony Brook data. Normalization was relative to No AKI at t = 0 for individual patient. For HA-AKI patients, t = 0 represents day of AKI onset (Cr first peaked), and for No AKI patients 3 days after hospital admission. Abbreviations: Cr, creatinine. BNP, brain natriuretic peptide. ALT, alanine aminotransferase. AST, aspartate transaminase. PROCAL, procalcitonin. CRP, C-reactive protein. LDH, lactate dehydrogenase. WBC, white blood cell. DBP, diastolic blood pressure. SBP, systolic blood pressure. FERR, ferritin. LYMPH, lymphocyte count. DDIM, d-dimer. HR, heart rate. RR, respiratory rate. SpO2, pulse oxygen saturation. PO2, arterial oxygen pressure. PCO2, arterial carbon dioxide pressure. The * represents a significant difference based on the linear mixed model in mean measures between two groups at each time point. Error bars are SEM

Procalcitonin was elevated one day prior to AKI onset, peaked the same time as Cr and remained elevated. AST, ALT, ferritin, LDH showed similar temporal patterns as Cr. CRP, WBC, lymphocyte, eGFR showed divergence between groups starting − 2 days prior. Note that lymphocyte counts and eGFR of AKI were below those of NAKI, in contrast to most other variables. d-Dimer elevated − 1 day prior but peaked a day later than Cr. BNP peak lagged Cr by 1 day.

Most vitals and blood gases (HR, DBP pressure, SBP, SpO2, temperature, pO2, pCO2 and pH) and albumin were similar between groups across these time points, except that RR was consistently elevated and pH was consistently lower in the AKI group.

Table 2 shows the ORs of the top five individual variables for developing AKI for − 1 day prior of the Stony Brook data. Creatinine and procalcitonin concentrations had the largest ORs by far, followed by white blood cell count, lactate dehydrogenase and lymphocyte count.

Table 2 The top five individual variables with highest odds ratios (ORs) and 95% confidence level [95% CI] for hospital-acquired AKI at -1 day prior to AKI onset of the Stony Brook dataset

We performed prediction of AKI onset at multiple time points. Figure 4 shows ROC curves of individual top variables and the combined five top variables at different days prior to AKI onset of the Stony Brook data. Figure 5 shows the prediction performance indices (AUCs) of individual top variables and the combined five top variables at different days prior to AKI onset of the Stony Brook data. AUCs were high at 0 and − 1 day before AKI onset, and decreased − 2 and − 3 days before AKI onset. The combined five top variables yielded the best AUC compared to individual predictors across all time points studied.

Fig. 4
figure 4

ROC curves at different days prior to AKI onset for individual and top earliest predictors of AKI of the Stony Brook data

Fig. 5
figure 5

AUC at different days prior to AKI onset for individual and top earliest predictors of AKI of the Stony Brook data

Table 3A summarizes the other performance metrics of the predictive model using the combined top five variables. The best model using the combined five top variables predicted AKI onset with AUC of 0.78, 0.66, and 0.56 at 0, − 1, and − 2 days prior, respectively.

Table 3 Performance metrics of the combined top five predictors of hospital-acquired AKI patients at different days prior to AKI onset on the (A) Stony Brook Hospital dataset and (B) Tongji Hospital data

For external validation, a logistic regression model trained on the Stony Brook hospital data were tested on the Tongji Hospital data using the significant variables: procalcitonin, creatinine, white blood cells, lactate dehydrogenase lymphocytes. Of the 375 patients, 201 survived and 174 died (46.4% mortality rate) and 72 had hospital-acquired AKI (19.2% AKI prevalence rate). The results are shown in Table 3B. The AUC for predicting AKI onset were 0.93, 0.80, and 0.88 at 0, − 1, and − 2 days prior to onset.

AKI onset association with treatments

We also explored the possible association of treatments with AKI onset in the Stony Brook data. More AKI patients had IMV (32.1% vs 2.4%, p < 0.001), noninvasive mechanical ventilation (12.0% vs 4.2%, p = 0.006), prophylactic (p < 0.001) and therapeutic anticoagulants (p = 0.002) and steroids (32.1% vs 9.6%, p = 0.006) than NAKI patients (Table 4). A total of 16.2% of AKI patients needed continuous renal replacement therapy (1.6%) or hemodialysis (9.4%), with 5.2% needing both.

Table 4 Treatments for AKI and NAKI patient cohorts

We also analyzed the differences in onset times between AKI development and the initiation of IMV, anticoagulant, steroid and dialysis treatment (Fig. 6). For most patients, IMV was initiated − 1 day prior to AKI onset. Anticoagulant treatment was initiated − 1 to − 3 days prior to AKI onset. Steroid treatment was initiated − 2 to 0 days before AKI onset but were comparatively more spread out. For all treatments, treatment initiation day is not significantly associated with mortality (p > 0.05).

Fig. 6
figure 6

Histogram of the treatment initiation prior to AKI onset for A invasive mechanical ventilation, B anticoagulants and C steroids of the Stony Brook data. For example, most of the patients were treated with invasive mechanical ventilation − 1 day prior to AKI onset. For all treatments, treatment initiation day is not significantly associated with mortality (p > 0.05)

The eGFR was 78.3 ± 5.5 (SEM) mL/min/1.73m2 for AKI and 99.1 ± 1.9 mL/min/1.73m2 for NAKI patients for survivors at discharge.

Discussion

This study investigated the temporal characteristics of clinical variables associated with AKI development during hospitalization in COVID-19 patients at two hospitals. The key findings are: (1) COVID-19 patients with hospital-acquired AKI acquired it within 3.3 days after hospitalization on average, and patients with hospital-acquired AKI showed a markedly higher mortality rate than NAKI patients. (2) Creatinine peaked 4.5 times from baseline and returned toward baseline but remained above NAKI level. (3) Procalcitonin elevated prior to AKI onset, peaked the same time as creatinine and remained elevated. AST, ALT, ferritin, LDH peaked the same time as Cr, whereas d-dimer and BNP lagged by a day. CRP, WBC, lymphocyte and eGRF showed differences between groups starting − 2 days prior. (4) Abnormal creatinine and procalcitonin had the highest odds ratios for developing AKI, followed by white blood cells, lactate dehydrogenase and lymphocytes. (5) The best predictive model using the combined five top variables predicted AKI onset with AUCs of 0.78, 0.66, and 0.56 at 0, − 1, and − 2 days prior, respectively (Stony Brook Hospital data). When tested on an external validation data (Tongji Hospital data), the AUCs were 0.93, 0.80, and 0.88 at 0, − 1, and − 2 days prior to onset, respectively.

Our incidence of AKI and mortality odds ratio for patients with hospital-acquired AKI is in general agreement with the literature [6,7,8,9,10,11,12]. Procalcitonin elevated prior to AKI onset, peaked the same time as Cr and remained elevated. Elevated procalcitonin is known to be a sign of a serious infection, including sepsis [32] and its elevation prior to AKI onset suggests it might be an early predictor of AKI in COVID-19. AST, ALT, ferritin, LDH peaked the same time as Cr. Elevated AST, ALT and ferritin are suggestive of liver damage. Increased levels in AST and ALT in COVID-19 are associated with the need for escalated care and higher rate of mortality [33]. Elevated ferritin is indicative of inflammation and cytokine storm, amongst others [34]. Lactate dehydrogenase is a marker of cell death and multi-organ failure [35,36,37]. Taken together, these temporal profiles are consistent with multi-organ failure [35,36,37] that occurred at roughly the same time.

CRP, WBC and lymphocyte concentrations showed divergence between groups very early on starting − 2 days prior and these variables could have predictive values. CRP is made by the liver and elevated level of CRP is a sign of inflammation [38]. Elevated white blood cell count is indicative of cytokine and immune response, including in COVID-19 infection [39]. Lymphocyte count is known to be lower in more severe COVID-19 patients and is associated with high mortality rate [20, 24, 40,41,42] and is associated with hospital-acquired AKI [43].

Interestingly, d-dimer concentration, an indicator of blood clots [44], elevated − 1 day prior but peaked a day later than Cr concentration, suggesting that potential embolic event might be present early but peaked in the later stage [10]. d-Dimer has been reported to be associated with COVID-19 and high mortality. BNP, an indicator of heart damage, lagged Cr by 1 day. It is not surprising that most vitals and blood gases were not different between groups across time points because they were actively maintained within normal physiological ranges. The exceptions were RR which was consistently elevated and pH which was consistently lower in the AKI group, indicative of respiratory distress and acidosis.

Taken together, time-locked longitudinal data offered insights into disease pathophysiology. If the clinical variables at ED admission were averaged across patients without time lock, most of these clinically significant effects could likely be averaged out. It is important to emphasize that most of the clinical variables of NAKI patients were also abnormal compared to normative healthy controls.

Predictive models

Abnormal creatinine (OR = 8.08), procalcitonin (OR = 1.92), white blood cell count (OR = 1.35), lactate dehydrogenase (OR = 1.21), and lymphocyte count (OR = 0.79) at − 1 day prior were associated with higher likelihood of AKI development. The temporal progression of these clinical variables suggests some of these variables could predict AKI onset. We found that creatinine, procalcitonin, white blood cell, lactate dehydrogenase and lymphocyte levels individually predicted AKI onset moderately well, and their combination outperformed individual predictors. The overall prediction performance by AUC was good at day 0, and moderate at day − 1 and − 2. The moderate performance of the training dataset could be due to data asymmetry, low sensitivity, small sample size and unpredictability of AKI. Interestingly, AUCs of the validation data showed better performance than those of the training data. A possible explanation is that the Tongji Hospital cohort had worse disease severity where laboratory variables were more consistently abnormal. Further validation studies are needed. Both datasets had low sensitivity and accuracy, but high specificity. The low sensitivity could be due to data asymmetry and small sample size.

Although creatinine was used to define AKI onset, we decided to include it in the model for the purpose of comparison. While these clinical variables have previously been associated with critical illness and mortality in COVID-19 patients [45], this is the first time that these clinical variables were used to predict AKI onset in a longitudinal fashion. These findings could help frontline physicians to identify patients needing early interventions to prevent AKI. Taken together, these findings suggest that AKI is likely a result of multi-organ failure contributing to higher mortality rate. Time-locked longitudinal data can provide insight into AKI progression that may lead to earlier recognition of AKI, intervention and improvement in clinical outcomes.

Association with treatments

Significantly more AKI patients had IMV, anticoagulants and steroids than NAKI patients. For most patients, IMV was initiated − 1 day prior to AKI onset. Anticoagulant treatment was initiated − 1 to − 3 days prior to AKI onset. Although glomerular hemorrhage could lead to AKI [46], over-anticoagulation has also been associated with AKI [47, 48] and thus it is possible that higher dose of anticoagulant could unintentionally contribute to AKI in COVID-19 patients. The use therapeutic anticoagulants in COVID-19 patients warrant further study [48, 49]. Steroid treatment was initiated − 2 to 0 days before AKI onset but were comparatively more spread out. A recent post hoc analysis of a placebo-controlled, randomized trial suggests that intraoperative steroids might lower the risk of renal replacement therapy for AKI after cardiac surgery [50]. It is important to note that these observations are associations, not cause and effect. For example, IMV and higher dose of anticoagulant might be needed in more severe COVID-19 patients and thus they were also more likely to develop AKI in the hospital. Other explanations are possible.

Finally, the eGFR was 78.3 ± 5.5 (SEM) mL/min/1.73m2 for AKI and 99.1 ± 1.9 mL/min/1.73m2 for NAKI patients for survivors at discharge, where normal eGFR for adults is > 90 mL/min/1.73m2 according to the National Kidney Foundation. This observation suggests kidney function had not yet returned to normal at discharge.

The strengths and novelties of our study include large sample size and the use of longitudinal variables with time-locked to AKI onset to characterize the progression of relevant clinical variables between AKI and non-AKI COVID-19 patients. The comparison of the temporal dynamics of various clinical variables is important because it reveals insights into leading indicators of AKI onset in the context of COVID-19, which has not been previously studied. We also developed and tested longitudinal predictive models to predict AKI onset a few days prior to onset using data from two hospitals, in contrast to essentially all published papers to date that reported AKI data in COVID-19 patients at a single time point at admission.

Limitations

This study had several limitations. We did not have data on proteinuria and hematuria, which have been associated with in-hospital mortality. Future studies should include urine analysis in the predictive modeling. As with all observational studies, other residual confounders may exist that were not accounted for in our analysis. Note that many patients developed AKI after 1 day post-admission and thus they did not contribute to − 3 and − 2 day prior to onset. Removing data of patients with onset of 1 or 2 days post-admission did not significantly affect the temporal characteristics of all time courses. Some of the performance indices of prediction were moderate and further testing on larger and independent datasets are needed. Future prospective studies are warranted.

Conclusions

This study compared the clinical profiles between COVID-19 patients with and without hospital-acquired AKI with respect to temporal progression of clinical variables, demographics, comorbidities, escalated care, mortality, and association with treatments. It also identified the top early predictors of in-hospital AKI and provided a mathematical model to predict AKI onset a few days prior, with cross-validation using an independent dataset from another hospital. This approach has the potential to provide frontline physicians with an objective tool to risk stratification and prediction of in-hospital AKI in COVID-19 patients in time-sensitive and potentially resource-constrained environments.