A Nomogram-Based Model to Predict Respiratory Dysfunction at 6 Months in Non-Critical COVID-19 Survivors
Rebecca De Lorenzo1 
Cristiano Magnaghi2 Elena Cinel1 Giordano Vitali2 Sabina Martinenghi2 Mario G. Mazza1,3 
Luigi Nocera1 Marta Cilla2 Sarah Damanti4 Nicola Compagnone1 Marica Ferrante1 
Caterina Conte2 
Francesco Benedetti1,3 
Fabio Ciceri1,2 
Patrizia Rovere-Querini1,2*- 1Medical Residency Program, Vita-Salute San Raffaele University, Milan, Italy
- 2Division of Immunology, Transplantation and Infectious Diseases, San Raffaele Hospital, Milan, Italy
- 3Unit of Psychiatry and Clinical Psychobiology, Division of Neuroscience, San Raffaele Hospital, Milan, Italy
- 4Unit of General Medicine and Advanced Care, San Raffaele Hospital, Milan, Italy
Objective: To assess the prevalence of respiratory sequelae of Coronavirus disease 2019 (COVID-19) survivors at 6 months after hospital discharge and develop a model to identify at-risk patients.
Patients and Methods: In this prospective cohort study, hospitalized, non-critical COVID-19 patients evaluated at 6-month follow-up between 26 August, 2020 and 16 December, 2020 were included. Primary outcome was respiratory dysfunction at 6 months, defined as at least one among tachypnea at rest, percent predicted 6-min walking distance at 6-min walking test (6MWT) ≤ 70%, pre-post 6MWT difference in Borg score ≥ 1 or a difference between pre- and post-6MWT oxygen saturation ≥ 5%. A nomogram-based multivariable logistic regression model was built to predict primary outcome. Validation relied on 2000-resample bootstrap. The model was compared to one based uniquely on degree of hypoxemia at admission.
Results: Overall, 316 patients were included, of whom 118 (37.3%) showed respiratory dysfunction at 6 months. The nomogram relied on sex, obesity, chronic obstructive pulmonary disease, degree of hypoxemia at admission, and non-invasive ventilation. It was 73.0% (95% confidence interval 67.3–78.4%) accurate in predicting primary outcome and exhibited minimal departure from ideal prediction. Compared to the model including only hypoxemia at admission, the nomogram showed higher accuracy (73.0 vs 59.1%, P < 0.001) and greater net-benefit in decision curve analyses. When the model included also respiratory data at 1 month, it yielded better accuracy (78.2 vs. 73.2%) and more favorable net-benefit than the original model.
Conclusion: The newly developed nomograms accurately identify patients at risk of persistent respiratory dysfunction and may help inform clinical priorities.
Introduction
Coronavirus disease 2019 (COVID-19) has caused substantial morbidity and mortality globally, leading to an unprecedented burden on healthcare systems. Although being a systemic disease, the respiratory system is the front-line of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, with the pattern and extent of lung involvement being the major determinants of clinical outcome (1–3). Mechanisms of lung injury, including diffuse alveolar damage, microvascular thrombosis and immune-mediated damage, may lead to fatal outcome or, if the patient survives the acute phase of disease, to permanent respiratory sequelae (4–7). The post-acute effects of COVID-19 have become an increasing concern and a non-negligible proportion of patients presents lung or respiratory abnormalities at radiological, functional and clinical assessments (8–11), with patients necessitating transfer to the intensive care unit (ICU) being at higher risk of long-term pulmonary complications (11–13). In light of these observations, it is now widely accepted that care for COVID-19 patients may not conclude at the time of hospital discharge (10, 14–16). While long-term clinical monitoring is imperative for ICU patients (17), questions remain on whether prolonged follow-up programs should be extended to all hospitalized patients with COVID-19.
Directing health resources toward post-acute care may be precarious in a time when the large number of acute cases continues to put pressure on health care systems1. On the other hand, the global scale of the pandemic suggests that the healthcare needs for COVID-19 survivors will continue to rise1. These observations imply that patient prioritization strategies are needed to ensure sustainability of care delivery while guaranteeing the appropriate assistance to most vulnerable patients.
In the current study, we aimed to develop an easy-to-use model to predict reduced respiratory function at 6 months after discharge. Moreover, we examined the discriminant abilities of the model by assessing accuracy, calibration and decision curve analyses (DCA), and compared it with a model based uniquely on the severity of respiratory insufficiency during acute disease. Finally, we tested whether data on respiratory function at 1 month after discharge could increase the prediction accuracy of the newly developed model.
Materials and Methods
Study Population
After Institutional Review Board approval (COVID-BioB study, protocol no. 34/int/2020), we prospectively collected data on patients hospitalized for COVID-19 during the first wave of the pandemic at San Raffaele University Hospital in Milan, Italy, and evaluated them at 6 months after hospital discharge at the COVID-19 follow-up outpatient clinic of the same institution. Adult (age ≥ 18 years) individuals, who were not transferred to the intensive care unit (ICU) were included in the present analysis.
COVID-19 was diagnosed based on a positive test result of real-time reverse-transcriptase polymerase chain reaction (RT-PCR) from a nasal swab in the presence of radiological findings of COVID-19 pneumonia. A comprehensive description of the follow-up program and patient assessment protocols are reported elsewhere (10, 16). All participants gave written informed consent. The study was conducted in accordance with the provisions of the Declaration of Helsinki.
Respiratory Function Assessment and Testing Endpoint
Respiratory function was evaluated using the 6-min walking test (6MWT), as performed according to the guidelines provided by the American Thoracic Society (ATS) (18). A validated reference equation, developed in healthy subjects from seven different countries, was used to derive predictive values of the 6-min walk distance (6MWD) in patients with no history of chronic pulmonary disease (19). A different equation specific for chronic obstructive pulmonary disease (COPD) patients was instead used to calculate COPD-predicted values of the 6MWD (20). Pre- and post-6MWT dyspnea was quantified using Borg scale (18). Respiratory rate (RR) was measured, prior to test initiation, by counting respiratory chest movements over a period of 60 s. A RR > 20 breaths/min defined tachypnea at rest (21).
The endpoint of interest was the ability to predict the presence of decreased respiratory function at 6 months after hospital discharge, defined as the presence of at least one among tachypnea at rest, percent predicted 6MWD ≤ 70%, a difference between pre- and post-6MWT Borg score ≥ 1 or a difference between pre- and post-6MWT oxygen saturation ≥ 5%.
Variables
Characteristics of the patients, including age, sex, ethnicity, active smoking, pre-existing comorbidities [body mass index (BMI) ≥ 30, arterial hypertension, coronary artery disease, COPD, diabetes mellitus, chronic kidney disease, active neoplasia] and of the disease, including ratio of arterial oxygen partial pressure in mmHg to fractional inspired oxygen expressed as a fraction (PaO2/FiO2) at hospital admission, length of hospital stay, therapy and non-invasive ventilation (NIV) administration during hospital stay clinical, were used as covariates. The modified Medical Research Council (mMRC) scale for dyspnea (22) and RR (21) were used as a measure of respiratory function at 1 month post-discharge.
Statistical Analyses
Non-normally distributed continuously-coded variables were expressed as medians and interquartile ranges (IQR). Absolute counts and proportions (%) were reported for categorical variables. The Mann–Whitney and the Chi-squared tests were used to compare medians and proportions, respectively.
Several statistical steps were performed. First, multivariable logistic regression analysis was performed to identify independent predictors of decreased respiratory function at 6 months among all available variables. Then, a logistic regression model was fitted using all identified independent predictors of the outcome. The discriminant properties of the resulting model were examined using ROC-derived area under the curve (AUC). The contribution of the remaining variables to the model was subsequently tested by verifying the AUC of the model when adding each other variable as covariate. Variables proving a benefit > 1% on AUC were included in the final model. Due to non-normal distribution of PaO2/FiO2, log-transformed values were used in nomogram development. Comparisons between predicted and observed misclassification probabilities for the nomogram were performed. Furthermore, decision curve analysis (DCA) assessed the net-benefit of the nomogram application. Finally, several possible nomogram cut-offs were systematically analyzed (23).
The nomogram was then compared to a model based exclusively on the degree of hypoxia, quantified as PaO2/FiO2, at hospital admission, using DeLong et al. methodology (24) and DCA analyses. Subgroup analyses were performed on patients who had also undergone the 1-month post-discharge follow-up. Specifically, an additional logistic regression model was fitted using RR and mMRC score at 1 month, in addition to the variables included in the original model. Subsequently, this extended model was compared to the original nomogram, by assessing AUC, calibration plot and DCA. Statistical significance of differences in the resulting AUC values obtained within the same cohort, for, respectively, the original vs. the extended nomogram, was tested according to DeLong et al. methodology (24). For both the original and extended nomograms, 95% confidence interval (CI) of AUC was obtained through 2000-resample bootstrap-based internal validation, which simulated the application of our model to 2000 newly created patient cohorts derived from random resampling of the original population (25, 26). All statistical tests were performed using the R statistical package v.4.0.0 (R Project for Statistical Computing, www.r-project.org). All tests were two sided, with a significance level set at p < 0.05.
Results
A total of 641 COVID-19 survivors who had been previously hospitalized and subsequently discharged from our institution were eligible for follow-up. Of these, 377 underwent the 6-month evaluation between 26 August, 2020 and 16 December, 2020. Sixty-one patients had been transferred to the ICU and were thus excluded. Three-hundred and sixteen COVID-19 survivors were included in the present analyses, and their characteristics are shown in Table 1. Median age was 61.8 (53.9–72.3) years and most patients were males (67.7%). All patients were evaluated after a median time of 187 (180–195) days from hospital discharge.
Table 1. Descriptive characteristics of 316 non-critical hospitalized COVID-19 patients, stratified according to the presence of reduced respiratory function at 6 months after hospital discharge.
Overall, 118 patients (37.3%) had decreased respiratory function, defined as the presence of tachypnea at rest, percent predicted 6MWD ≤ 70%, a difference between pre- and post-6MWT Borg score ≥ 1 or a difference between pre- and post-6MWT oxygen saturation ≥ 5%, at the 6-month follow-up assessment. These patients were more commonly females (44.1 vs. 25.3%, P < 0.001) and had a higher BMI than those with normal respiratory function [median (IQR) of 28.3 (24.8–31.9) vs. 27.0 (25.3–29.4), P = 0.02]. History of COPD was more frequently recorded in patients with decreased respiratory function (9.3 vs. 1.0%, P < 0.001). The two groups did not differ in terms of age, additional comorbidities or steroid treatment during hospital stay.
The multivariable logistic model used to build the nomogram predicting decreased respiratory function at 6 months relied on sex, baseline BMI ≥ 30, COPD, PaO2/FiO2 at hospital admission, and NIV administration during hospital stay. All included variables were independent predictors and were used for nomogram development (Supplementary Table 1; Figure 1). An exception was NIV administration that, while not an independent predictor (Supplementary Table 1), increased the accuracy of the model (71.8 vs. 73.0%). Within the overall population, the newly developed nomogram yielded an AUC of 73.0% (95% CI 67.3–78.4%). Comparisons between nomogram-predicted and observed probabilities of decreased respiratory function at 6 months showed minimal departure from ideal prediction (Figure 2A). Moreover, in DCA greater degree of net-benefit was recorded for the nomogram compared to the model relying only on PaO2/FiO2 at hospital admission (Figure 2B). The nomogram also yielded greater accuracy than the model based only on PaO2/FiO2 at hospital admission (73.0 vs. 59.1%, P < 0.001). Additionally, we tested numbers and proportions of patients with reduced respiratory function at 6 months according to several nomogram cut-offs (Table 2). The systematic analysis of nomogram cut-offs revealed that using, for example, a cut-off of 20, 260 (82.3%) patients would be classified as being at risk of developing decreased respiratory function at 6 months (above nomogram cut-off) and should thus be evaluated at follow-up. On the other hand, 56 (17.7%) should not be evaluated, being below the cut-off. Of these 56 patients, 7 (12.5%) would be misclassified.
Figure 1. Nomogram predicting respiratory dysfunction at 6 months post-discharge (Original nomogram). BMI, body mass index; COPD, chronic obstructive pulmonary disease; PaO2/FiO2, ratio of arterial oxygen partial pressure in mmHg to fractional inspired oxygen expressed as a fraction; NIV, non-invasive ventilation.
Figure 2. Calibration plot of observed vs. predicted rates of reduced respiratory function at 6 months post-discharge for the newly developed nomogram-based model (A). Decision curve analyses (DCA) demonstrating the net benefit associated with the use of the nomogram on the discrimination of patients with and without reduced respiratory function at 6 months after hospital discharge (B).
Table 2. Analyses of novel nomogram cut-offs in 316 non-critical hospitalized COVID-19 patients.
In the subgroup analyses focusing on patients that had also been evaluated at 1-month follow-up, an additional logistic regression model was fitted, relying on the same covariates as the original nomogram (sex, obesity, COPD, PaO2/FiO2 at hospital admission and NIV administration) in addition to RR and mMRC for dyspnea score at 1 month (Figure 3). Overall, 220 patients assessed after a median time of 34 (25–40) days after hospital discharge were included. Of these, 77 (35%) had reduced respiratory function at 6 months. Median RR (breaths/min) at 1 month was 20 (16–21) in patients with reduced respiratory function at 6 months and 16 (15–20) in patients without (P = 0.002). Similarly, patients with reduced 6-month respiratory function had higher degrees of dyspnea according to mMRC score compared to patients without (P < 0.001). For example, severe and very severe dyspnea were reported in, respectively, 11 (14.3%) and 8 (10.4%) patients with reduced respiratory function at 6 months and in, respectively, 4 (2.8%) and 1 (0.7%) patients without.
Figure 3. Extended nomogram predicting respiratory dysfunction at 6 months post-discharge, including also respiratory rate (breaths/min) and degree of dyspnea, quantified through the modified Medical Research Council score (mMRC), at 1 month post-discharge. mMRC scores: 0, no dyspnea; 1, mild dyspnea; 2, moderate dyspnea; 3, severe dyspnea; 4, very severe dyspnea. BMI, body mass index; COPD, chronic obstructive pulmonary disease; PaO2/FiO2, ratio of arterial oxygen partial pressure in mmHg to fractional inspired oxygen expressed as a fraction; NIV, non-invasive ventilation; RR, respiratory rate.
The extended nomogram yielded an AUC of 78.2% (95% CI 72.0–84.1%) vs. 73.2 (95% CI 66.4–79.8%) for the original nomogram in the sub-cohort (P = 0.03). Comparisons between nomogram-predicted and observed probabilities of decreased respiratory function at 6 months showed a good calibration for both the original and the extended nomograms (Supplementary Figures 1A,B). Moreover, in DCA a greater degree of net-benefit was recorded for the extended nomogram across all threshold probabilities, with the exception of the interval between 0.51 and 0.64, where the net-benefit was greater for the original nomogram (Supplementary Figure 1C). Numbers and proportions of patients with reduced respiratory function at 6 months according to several cut-offs are reported in Supplementary Table 2.
Discussion
In our cohort of non-critical COVID-19 survivors, more than one third of patients had respiratory dysfunction at 6-month follow-up. Here, we developed an accurate and easy-to-use model to discriminate patients deserving prolonged monitoring due to an increased risk of respiratory sequelae.
Respiratory function and lung abnormalities including dyspnea, reduced exercise tolerance, decreased diffusion lung capacity (DLCO) and parenchymal changes frequently develop during acute COVID-19 and persist after patients discharge (9, 11, 15, 27). This evidence has led to the increasing recognition of post-discharge care of COVID-19 survivors as a clinical and research priority. Prolonged monitoring for ICU patients is considered appropriate (11). However, respiratory sequelae also occur in hospitalized patients who did not need ICU transfer. Data on the prevalence of this event are scarce and consequently it is unclear whether these patients should be included in long-term follow-up programs (28).
To address this unmet need, we developed a model, in the form of a nomogram, for the identification of patients with reduced respiratory function at 6 months after hospital discharge. Exercise tolerance and respiratory rate at rest are informative clinical surrogates of respiratory function (21, 29–32), and have been suggested as tools for respiratory follow-up in post-acute COVID-19 patients (16, 17). Indeed, the distance walked during the 6MWT was shown to be closely linked to disease severity in diffuse parenchymal lung diseases (33) and to faithfully mirror respiratory function in interstitial lung diseases (34). Similarly, RR was found to be a valid and clinically useful indicator of respiratory dysfunction in both acute and chronic lung disorders (35, 36).
Several reference equations exist to define predicted values of normality for 6MWD (19, 37–41). The one we used, by Casanova et al. was developed in adult patients from seven countries and, differently from other equations (37, 40, 41), takes into account the intensity of effort during the test, which may otherwise bias the results (19).
The nomogram, which rested on sex, obesity, COPD, PaO2/FiO2 at hospital admission, and NIV administration during hospital stay, yielded an AUC of 73.0%, above the ideal accuracy threshold of 70%. Several other testing benchmarks were applied to this novel nomogram-based model, namely calibration, DCA, and detailed analysis of misclassified patients according to specific cut-offs. Calibration analyses showed only minimal departures of the model from ideal predictions. Importantly, the newly developed model demonstrated statistically significant superiority of performance compared to the one based uniquely on PaO2/FiO2 at hospital admission (AUC 59.1%), as reflected also by the greater net-benefit in DCA analyses. Indeed, PaO2/FiO2 is a more objective surrogate marker of disease severity than the oxygenation or ventilation strategy used, as it directly reflects the oxygen need (42, 43), without being influenced by subjective clinical judgment. The ability of disease severity to predict decreased exercise capacity at follow-up has been previously reported (11). However, we here demonstrate that disease severity, although extremely important, may not be sufficient to accurately predict the risk of long-term respiratory sequelae. Indeed, in line with a previous study reporting an increased risk of reduced DLCO at 4 months in female patients (9, 44), female sex importantly contributed to nomogram accuracy. Similarly, in accordance with our model, COPD was shown to increase the risk of post-acute lung function impairment (9).
The use of COPD-specific reference equations in our study minimized the risk of bias related to the potential pre-existing reduction in exercise capacity in COPD patients. Age did not emerge as an independent predictor of decreased respiratory function at 6 months and was thus not included in the nomogram. A higher in-hospital mortality rate was recorded in the elderly (3, 45), probably due to a greater baseline comorbidity burden. However, in survivors, the ability to revert the previous health state may align with that of younger patients. We have also found that NIV administration, although not being an independent predictor per se, improved the nomogram accuracy when added as covariate. Therefore, it is tempting to speculate that in non-critical COVID-19 patients NIV contributes to limit acute lung damage, thus protecting from long-term respiratory sequelae, consistent with the evidence of its efficacy during acute disease (46).
Subgroup analyses revealed that by adding respiratory measures (RR and degree of dyspnea) at 1 month post-discharge to the original nomogram, the prediction accuracy of the model improved significantly (AUC 78.2%). Thus, early clinical assessment of respiratory function after patient discharge might aid in the prediction of those patients warranting more prolonged medical care.
Our study has limitations. First, not all patients discharged from our Institution underwent follow-up assessment, due to several reasons including reluctance to attend extra-visits, perception of full recovery, inability to reach the outpatient clinic, death due to COVID-19 or other causes, etc. However, the homogeneity of standards of care for patient monitoring and the uniform healthcare access of the cohort minimized the risk of ascertainment bias. Second, only patients who were evaluated at both the 1- and 6-month visits were included in subgroup analyses. Third, multiple factors such as myopathy, depression or neuropathy may have influenced exercise performance. However, the 6MWT captures the global functional capacity of a patient (30), which, independent of contributing elements to exercise limitation, imparts important prognostic implications and should guide clinical decision-making. Moreover, data on pre-existing respiratory diseases other than COPD were not available. Also, few patients with severe disease who had not been admitted to the ICU due to non-clinical reasons (refusal, limited ICU capacity, etc.) may have been included. However, the proportion of these patients is supposed to be very low, considering the high mortality rate of patients who received less intensive care than needed. Finally, the relatively small sample size and the lack of an external validation cohort may hamper result generalizability, although internal validation confirmed model accuracy.
Conclusion
We developed the first nomogram-based model to identify patients at higher risk of reduced respiratory function at 6 months after hospital discharge. The nomogram displayed good performance, based on AUC, calibration and DCA. Moreover, the flexible format of nomogram-based predictions allows for the use of the cut-off that best suits the clinical need and available resources, balancing the number of patients classified as at risk of persistently reduced respiratory function vs. the proportion, within those patients, that are misclassified. Thus, the developed nomogram is an evidence-based, easy-to-use tool that could be readily implemented in clinical practice to prioritize care delivery for non-critical COVID-19 patients, with the ultimate aim of preserving valuable resources while minimizing the long-term effects of this devastating disorder.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The study was reviewed and approved by Institutional Review Board of San Raffaele Hospital. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
RD: conception and design, acquisition of data, analysis and interpretation of data, statistical analyses, and drafting of manuscript. CM, EC, GV, SM, MM, MC, SD, NC, and MF: acquisition of data and critical revision of the manuscript. LN: analysis and interpretation of data, statistical analyses, and critical revision of the manuscript. CC, FB, and FC: critical revision of the manuscript and supervision. PR-Q: conception and design, analysis and interpretation of data, drafting of the manuscript, and supervision. All authors contributed to manuscript revision, read, and approved the submitted version.
Funding
This work was funded by Ministero della Salute, Italy; COVID-19 donations.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
The authors wish to thank all other members of the COVID-19 BioB Outpatient Clinic Study group that includes: Bollettini Irene, Bosio Sara, Bravi Beatrice, Bussolari Cecilia, Calvisi Stefania, Canti Valentina, Caselani Elisa, Castellani Jacopo, Colombo Federica, D'Orsi Greta, Di Pasquasio Camilla, Fiore Paola, Mazza Elena Beatrice, Melloni Elisa Maria Teresa, Merolla Aurora, Palladini Mariagrazia, Poletti Sara, Pomaranzi Chiara, Santini Chiara, and Vai Benedetta.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2022.781410/full#supplementary-material
Supplementary Figure 1. Calibration plot of observed vs. predicted rates of reduced respiratory function at 6 months post-discharge for the original nomogram-based model (A). Calibration plot of observed vs. predicted rates of reduced respiratory function at 6 months post-discharge for the extended nomogram-based model (B). Decision curve analyses (DCA) demonstrating the net benefit associated with the use of the original nomogram vs. the extended nomogram on the discrimination of patients with and without reduced respiratory function at 6 months after hospital discharge (C).
Supplementary Table 1. Selection criteria for covariates included in the nomogram.
Supplementary Table 2. Analyses of the extended nomogram cutoffs in 220 non-critical hospitalized COVID-19 patients.
Abbreviations
COVID-19, Coronavirus Disease 2019; SARS-CoV-2, Severe acute respiratory syndrome coronavirus 2; DCA, decision curve analyses; ICU, intensive care unit; RT-PCR, real-time reverse-transcriptase polymerase chain reaction; 6MWT, 6-min walking test; 6MWD, 6-min walk distance; COPD, chronic obstructive pulmonary disease; RR, respiratory rate; BMI, body mass index; PaO2/FiO2, ratio of arterial oxygen partial pressure in mmHg to fractional inspired oxygen expressed as a fraction; NIV, non-invasive ventilation; mMRC, modified Medical Research Council; IQR, interquartile range; AUC, ROC-derived area under the curve.
Footnotes
1. ^Available online at: https://www.who.int/emergencies/diseases/novel-coronavirus-2019 (accessed April 5, 2021).
References
1. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. (2020) 20:533–4. doi: 10.1016/S1473-3099(20)30120-1
2. Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72314 cases from the chinese center for disease control and prevention. JAMA. (2020) 323:1239–42. doi: 10.1001/jama.2020.2648
3. Ciceri F, Castagna A, Rovere-Querini P, De Cobelli F, Ruggeri A, Galli L, et al. Early predictors of clinical outcomes of COVID-19 outbreak in Milan, Italy. Clin Immunol. (2020) 217:108509. doi: 10.1016/j.clim.2020.108509
4. Xu Z, Shi L, Wang Y, Zhang J, Huang L, Zhang C, et al. Pathological findings of COVID-19 associated with acute respiratory distress syndrome. Lancet Respir Med. (2020) 8:420–2. doi: 10.1016/S2213-2600(20)30076-X
5. Rendeiro AF, Ravichandran H, Bram Y, Chandar V, Kim J, Meydan C, et al. The spatial landscape of lung pathology during COVID-19 progression. Nature. (2021) 593:564–9. doi: 10.1038/s41586-021-03475-6
6. Ciceri F, Beretta L, Scandroglio AM, Colombo S, Landoni G, Ruggeri A, et al. Microvascular COVID-19 lung vessels obstructive thromboinflammatory syndrome (MicroCLOTS): an atypical acute respiratory distress syndrome working hypothesis. Crit Care Resusc. (2020) 22:95–7. doi: 10.51893/2020.2.pov2
7. Calabrese F, Pezzuto F, Fortarezza F, Hofman P, Kern I, Panizo A, et al. Pulmonary pathology and COVID-19: lessons from autopsy. The experience of European Pulmonary Pathologists. Virchows Arch. (2020) 477:359–72. doi: 10.1007/s00428-020-02886-6
8. Writing Committee for the CSG, Morin L, Savale L, Pham T, Colle R, Figueiredo S. Four-month clinical status of a cohort of patients after hospitalization for COVID-19. JAMA. (2021) 325:1525–34. doi: 10.1001/jama.2021.3331
9. Bellan M, Soddu D, Balbo PE, Baricich A, Zeppegno P, Avanzi GC, et al. Respiratory and psychophysical sequelae among patients with COVID-19 four months after hospital discharge. JAMA Netw Open. (2021) 4:e2036142. doi: 10.1001/jamanetworkopen.2020.36142
10. De Lorenzo R, Conte C, Lanzani C, Benedetti F, Roveri L, Mazza MG, et al. Residual clinical damage after COVID-19: a retrospective and prospective observational cohort study. PLoS ONE. (2020) 15:e0239570. doi: 10.1371/journal.pone.0239570
11. Huang C, Huang L, Wang Y, Li X, Ren L, Gu X, et al. 6-month consequences of COVID-19 in patients discharged from hospital: a cohort study. Lancet. (2021) 397:220–32. doi: 10.1016/S0140-6736(20)32656-8
12. Inoue S, Hatakeyama J, Kondo Y, Hifumi T, Sakuramoto H, Kawasaki T, et al. Post-intensive care syndrome: its pathophysiology, prevention, and future directions. Acute Med Surg. (2019) 6:233–46. doi: 10.1002/ams2.415
13. Herridge MS, Tansey CM, Matte A, Tomlinson G, Diaz-Granados N, Cooper A, et al. Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med. (2011) 364:1293–304. doi: 10.1056/NEJMoa1011802
14. D'Cruz RF, Waller MD, Perrin F, Periselneris J, Norton S, Smith LJ, et al. Chest radiography is a poor predictor of respiratory symptoms and functional impairment in survivors of severe COVID-19 pneumonia. ERJ Open Res. (2021) 7:00655–2020. doi: 10.1183/23120541.00655-2020
15. Nalbandian A, Sehgal K, Gupta A, Madhavan MV, McGroder C, Stevens JS, et al. Post-acute COVID-19 syndrome. Nat Med. (2021) 27:601–15. doi: 10.1038/s41591-021-01283-z
16. Rovere Querini P, De Lorenzo R, Conte C, Brioni E, Lanzani C, Yacoub MR, et al. Post-COVID-19 follow-up clinic: depicting chronicity of a new disease. Acta Biomed. (2020) 91:22–8. doi: 10.23750/abm.v91i9-S.10146
17. George PM, Barratt SL, Condliffe R, Desai SR, Devaraj A, Forrest I, et al. Respiratory follow-up of patients with COVID-19 pneumonia. Thorax. (2020) 75:1009–16. doi: 10.1136/thoraxjnl-2020-215314
18. Laboratories ATSCoPSfCPF. ATS statement: guidelines for the six-minute walk test. Am J Respir Crit Care Med. (2002) 166:111–7. doi: 10.1164/ajrccm.166.1.at1102
19. Casanova C, Celli BR, Barria P, Casas A, Cote C, de Torres JP, et al. The 6-min walk distance in healthy subjects: reference standards from seven countries. Eur Respir J. (2011) 37:150–6. doi: 10.1183/09031936.00194909
20. Reis DO, Oliveira P, Gomes J, Lima R, Guimarães M, Ladeira I. Applying reference equations for 6-minute walking test in COPD and ILD patients. Eur Respir J. (2020) 56 (Suppl. 64):540. doi: 10.1183/13993003.congress-2020.540
21. Strauss R, Ewig S, Richter K, Konig T, Heller G, Bauer TT. The prognostic significance of respiratory rate in patients with pneumonia: a retrospective analysis of data from 705,928 hospitalized patients in Germany from 2010-2012. Dtsch Arztebl Int. (2014) 111:503–8, i–v. doi: 10.3238/arztebl.2014.0503
22. Bestall JC, Paul EA, Garrod R, Garnham R, Jones PW, Wedzicha JA. Usefulness of the Medical Research Council (MRC) dyspnoea scale as a measure of disability in patients with chronic obstructive pulmonary disease. Thorax. (1999) 54:581–6. doi: 10.1136/thx.54.7.581
23. Nocera L, Colla Ruvolo C, Stolzenbach LF, Deuker M, Tian Z, Gandaglia G, et al. Improving the stratification of intermediate risk prostate cancer. Minerva Urol Nephrol. (2021). doi: 10.23736/S2724-6051.21.04314-7. [Epub ahead of print].
24. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. (1988) 44:837–45. doi: 10.2307/2531595
25. Nocera L, Stolzenbach LF, Ruvolo CC, Wenzel M, Tian Z, Rosiello G, et al. Predicting the risk of pT3a stage in cT1 clear cell renal cell carcinoma. Eur J Surg Oncol. (2020) 47:1187–90. doi: 10.1016/j.ejso.2020.10.040
26. Stolzenbach LF, Deuker M, Colla-Ruvolo C, Nocera L, Mansour M, Tian Z, et al. External beam radiation therapy improves survival in low-volume metastatic prostate cancer patients: a North American population-based study. Prostate Cancer Prostatic Dis. (2021) 24:253–60. doi: 10.1038/s41391-020-00276-2
27. Wang F, Kream RM, Stefano GB. Long-term respiratory and neurological sequelae of COVID-19. Med Sci Monit. (2020) 26:e928996. doi: 10.12659/MSM.928996
28. Moreno-Perez O, Merino E, Leon-Ramirez JM, Andres M, Ramos JM, Arenas-Jimenez J, et al. Post-acute COVID-19 syndrome. Incidence and risk factors: a Mediterranean cohort study. J Infect. (2021) 82:378–83. doi: 10.1016/j.jinf.2021.01.004
29. Agrawal MB, Awad NT. Correlation between six minute walk test and spirometry in chronic pulmonary disease. J Clin Diagn Res. (2015) 9:OC01–4. doi: 10.7860/JCDR/2015/13181.6311
30. Brown AW, Nathan SD. The value and application of the 6-minute-walk test in idiopathic pulmonary fibrosis. Ann Am Thorac Soc. (2018) 15:3–10. doi: 10.1513/AnnalsATS.201703-244FR
31. Chen H, Liang BM, Tang YJ, Xu ZB, Wang K, Yi Q, et al. Relationship between 6-minute walk test and pulmonary function test in stable chronic obstructive pulmonary disease with different severities. Chin Med J. (2012) 125:3053–8. doi: 10.3760/cma.j.issn.0366-6999.2012.17.016
32. Cretikos MA, Bellomo R, Hillman K, Chen J, Finfer S, Flabouris A. Respiratory rate: the neglected vital sign. Med J Aust. (2008) 188:657–9. doi: 10.5694/j.1326-5377.2008.tb01825.x
33. Holland AE, Hill CJ, Conron M, Munro P, McDonald CF. Small changes in six-minute walk distance are important in diffuse parenchymal lung disease. Respir Med. (2009) 103:1430–5. doi: 10.1016/j.rmed.2009.04.024
34. Chetta A, Aiello M, Foresi A, Marangio E, D'Ippolito R, Castagnaro A, et al. Relationship between outcome measures of six-minute walk test and baseline lung function in patients with interstitial lung disease. Sarcoidosis Vasc Diffuse Lung Dis. (2001) 18:170–5.
35. Browning IB, D'Alonzo GE, Tobin MJ. Importance of respiratory rate as an indicator of respiratory dysfunction in patients with cystic fibrosis. Chest. (1990) 97:1317–21. doi: 10.1378/chest.97.6.1317
36. Gravelyn TR, Weg JG. Respiratory rate as an indicator of acute respiratory dysfunction. JAMA. (1980) 244:1123–5. doi: 10.1001/jama.1980.03310100041029
37. Enright PL, Sherrill DL. Reference equations for the six-minute walk in healthy adults. Am J Respir Crit Care Med. (1998) 158:1384–7. doi: 10.1164/ajrccm.158.5.9710086
38. Zou H, Zhang J, Chen X, Wang Y, Lin W, Lin J, et al. Reference equations for the six-minute walk distance in the healthy Chinese Han population, aged 18-30 years. BMC Pulm Med. (2017) 17:119. doi: 10.1186/s12890-017-0461-z
39. Jenkins S, Cecins N, Camarri B, Williams C, Thompson P, Eastwood P. Regression equations to predict 6-minute walk distance in middle-aged and elderly adults. Physiother Theory Pract. (2009) 25:516–22. doi: 10.3109/09593980802664711
40. Camarri B, Eastwood PR, Cecins NM, Thompson PJ, Jenkins S. Six minute walk distance in healthy subjects aged 55-75 years. Respir Med. (2006) 100:658–65. doi: 10.1016/j.rmed.2005.08.003
41. Alameri H, Al-Majed S, Al-Howaikan A. Six-min walk test in a healthy adult Arab population. Respir Med. (2009) 103:1041–6. doi: 10.1016/j.rmed.2009.01.012
42. Sarkar M, Niranjan N, Banyal PK. Mechanisms of hypoxemia. Lung India. (2017) 34:47–60. doi: 10.4103/0970-2113.197116
43. Force ADT, Ranieri VM, Rubenfeld GD, Thompson BT, Ferguson ND, Caldwell E, et al. Acute respiratory distress syndrome: the Berlin definition. JAMA. (2012) 307:2526–33. doi: 10.1001/jama.2012.5669
44. Olfert IM, Balouch J, Kleinsasser A, Knapp A, Wagner H, Wagner PD, et al. Does gender affect human pulmonary gas exchange during exercise? J Physiol. (2004) 557:529–41. doi: 10.1113/jphysiol.2003.056887
45. Shahid Z, Kalayanamitra R, McClafferty B, Kepko D, Ramgobin D, Patel R, et al. COVID-19 and older adults: what we know. J Am Geriatr Soc. (2020) 68:926–9. doi: 10.1111/jgs.16472
46. Faraone A, Beltrame C, Crociani A, Carrai P, Lovicu E, Filetti S, et al. Effectiveness and safety of noninvasive positive pressure ventilation in the treatment of COVID-19-associated acute hypoxemic respiratory failure: a single center, non-ICU setting experience. Intern Emerg Med. (2020) 16:1183–1190. doi: 10.1007/s11739-020-02562-2
Keywords: COVID-19, long-term, respiratory sequelae, follow-up, prediction algorithm
Citation: De Lorenzo R, Magnaghi C, Cinel E, Vitali G, Martinenghi S, Mazza MG, Nocera L, Cilla M, Damanti S, Compagnone N, Ferrante M, Conte C, Benedetti F, Ciceri F and Rovere-Querini P (2022) A Nomogram-Based Model to Predict Respiratory Dysfunction at 6 Months in Non-Critical COVID-19 Survivors. Front. Med. 9:781410. doi: 10.3389/fmed.2022.781410
Received: 22 September 2021; Accepted: 28 January 2022;
Published: 23 February 2022.
Edited by:
Farid Rahimi, Australian National University, AustraliaReviewed by:
Ashwin Sawant, Icahn School of Medicine at Mount Sinai, United StatesErwin Chiquete, Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán (INCMNSZ), Mexico
Copyright © 2022 De Lorenzo, Magnaghi, Cinel, Vitali, Martinenghi, Mazza, Nocera, Cilla, Damanti, Compagnone, Ferrante, Conte, Benedetti, Ciceri and Rovere-Querini. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Patrizia Rovere-Querini, rovere.patrizia@hsr.it