Hostname: page-component-586b7cd67f-tf8b9 Total loading time: 0 Render date: 2024-11-26T10:14:09.312Z Has data issue: false hasContentIssue false

Nomogram prediction of severe risk in patients with COVID-19 pneumonia

Published online by Cambridge University Press:  09 December 2021

Wei Tang
Affiliation:
Department of Infectious Diseases, The First Hospital of Changsha, Changsha, Hunan, China
Run Yao
Affiliation:
Department of Blood Transfusion, Xiangya Hospital, Clinical Transfusion Research Center, Central South University, Changsha, Hunan, China National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, Hunan Province, China
Fang Zheng
Affiliation:
Department of Infectious Diseases, The First Hospital of Changsha, Changsha, Hunan, China
Yaxiong Huang
Affiliation:
Department of Infectious Diseases, The First Hospital of Changsha, Changsha, Hunan, China
Guoqiang Zhou
Affiliation:
Department of Infectious Diseases, The First Hospital of Changsha, Changsha, Hunan, China
Ruochan Chen*
Affiliation:
National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, Hunan Province, China Department of Infectious Diseases, Xiangya Hospital, Central South University, Changsha, Hunan, China Key Laboratory of Viral Hepatitis, Hunan Province, Changsha, China
Ning Li*
Affiliation:
Department of Blood Transfusion, Xiangya Hospital, Clinical Transfusion Research Center, Central South University, Changsha, Hunan, China National Clinical Research Center for Geriatric Disorders, Xiangya Hospital, Central South University, Changsha, Hunan Province, China
*
Author for correspondence: Ning Li, E-mail: [email protected]; Ruochan Chen, E-mail: [email protected]
Author for correspondence: Ning Li, E-mail: [email protected]; Ruochan Chen, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Coronavirus disease-2019 (COVID-19) elicits a range of different responses in patients and can manifest into mild to very severe cases in different individuals, depending on many factors. We aimed to establish a prediction model of severe risk in COVID-19 patients, to help clinicians achieve early prevention, intervention and aid them in choosing effective therapeutic strategy. We selected confirmed COVID-19 patients who were admitted to First Hospital of Changsha city between 29 January and 15 February 2020 and collected their clinical data. Multivariate logical regression was used to identify the factors associated with severe risk. These factors were incorporated into the nomogram to establish the model. The ROC curve, calibration plot and decision curve were used to assess the performance of the model. A total of 228 patients were enrolled and 33 (14.47%) patients developed severe pneumonia. Univariate and multivariate analysis showed that shortness of breath, fatigue, creatine kinase, lymphocytes and h CRP were independent factors for severe risk in COVID-19 patients. Incorporating age, chronic obstructive pulmonary disease (COPD) and these factors, the nomogram achieved good concordance indexes of 0.89 [95% confidence interval (CI) 0.832–0.949] and well-fitted calibration plot curves (Hosmer–Lemeshow test: P = 0.97). The model provided superior net benefit when clinical decision thresholds were between 15% and 85% predicted risk. Using the model, clinicians can intervene early, improve therapeutic effects and reduce the severity of COVID-19, thus ensuring more targeted and efficient use of medical resources.

Type
Original Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press

Introduction

First reported in Wuhan in December 2019, coronavirus disease-2019 (COVID-19), caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has rapidly spread throughout China and all over the world [Reference Wang1Reference Peng3]. Viral genome sequencing revealed SARS-CoV-2 to be a member of the β-coronavirus family, which also includes the Middle East syndrome coronavirus (MERS-CoV) and severe acute respiratory syndrome coronavirus (SARS-CoV) [Reference Wang4, Reference Wang5]. As a result of its rapid global spread and high infectiousness, the World Health Organization (WHO) declared the COVID-19 outbreak a ‘Public Health Emergency of International Concern’ (PHEIC) on 30 January 2020.

COVID-19 has the characteristics of strong infectivity and complex clinical manifestations. Despite most COVID-19 patients presenting with mild symptoms, acute lung injury, respiratory distress syndrome, multiple organ dysfunction and even death can occur in severe cases [Reference Chen2Reference Zhu6]. Initial clinical and epidemiological data have shown that around 26–33% of patients need intensive care, and the mortality rate was 4–15% [Reference Wang4, Reference Huang7, Reference Zhu8]. A large-scale case study including 72 314 patients infected with COVID-19 revised the initial estimates from China, and it reported that 14% developed into severe cases, with a fatality rate of 2.3% [Reference Wu and McGoogan9]. Considering the huge population of COVID-19 cases globally, the number of severe cases has been enormous as well. Therefore, exploring risk factors to predict severe cases is crucial for early intervention and treatment. Currently, there are few reports on the evaluation of COVID-19 related risk factors at home and abroad [Reference Zhu6, Reference Al-Najjar and Al-Rousan10Reference Zhou13]. Our study retrospectively analysed the clinical data of 228 patients admitted to the first hospital of Changsha City and constructed a predictive model to assess severe risks for patients with COVID-19. It aimed to offer a better understanding of the disease progression occurring after SARS-CoV-2 infection and establish a basis for optimising the current therapeutic strategies.

Methods

Patients

All confirmed patients with COVID-19 admitted to The First Hospital of Changsha from 29 January to 15 February 2020 were included in our study. Exclusion criteria: Patients diagnosed as severe cases at admission. The First Hospital of Changsha was designated as ‘the specific hospital for the treatment of patients with COVID-19 in Changsha’ by the government during the epidemic. All patients are required to undergo SARS-CoV-2 RNA screening when they were in a medical institution of Changsha, and once positive patients are found, they will be immediately transferred to designated hospitals for follow-up treatment. All COVID-19 patients will be stayed and followed up in the hospital until cured and the nucleic acid turn negative.

Definitions

The diagnosis was confirmed by detecting SARS-CoV-2 RNA in nasopharyngeal swab samples using a virus nucleic acid detection kit according to the manufacturer's protocol (Shanghai Bio Germ Medical Biotechnology Co., Ltd). All confirmed COVID-19 patients were sent to COVID-19 designated hospitals (First Hospital of Changsha) for treatment. Patients were classified into non-severe (asymptomatic, mild and moderate) and severe types based on the severity of symptoms [Reference Ji11]. The severe type was defined according to the following criterion: (1) Respiratory distress with the respiratory rate over 30 per minute; (2) Pulse oximeter oxygen saturation ⩽93% in the resting state while breathing ambient air; (3) Arterial blood oxygen partial pressure (PaO2)/oxygen concentration (FiO2) ⩽300 mmHg (1 mmHg = 0.133 kPa).

Data collection

We retrospectively collected the information of all patients including demographic data, clinical characteristics and laboratory parameters. The demographic data included age, gender and epidemiology (Patients exposed to Wuhan or close contact with a confirmed COVID-19 patient.). The clinical characteristics included time between onset and hospitalisation, underlying diseases (hypertension, diabetes, coronary heart disease, chronic obstructive pulmonary disease (COPD), kidney disease, cerebral infarction and liver disease) and symptom (fever, cough, shortness of breath, muscle ache, headache, dizziness, diarrhoea, fatigue, nausea and sore throat). As in the published study [Reference Lauer14], we defined the disease onset as the earliest possible time of symptom onset, such as fever, cough, shortness of breath, muscle ache, headache, dizziness, diarrhoea, fatigue, nausea, sore throat and so on. When the earliest possible time of symptom onset could not be determined, we assumed it to be the earliest time of possible exposure. The laboratory parameters included creatine kinase isoenzyme, creatine kinase, lactate dehydrogenase, triglyceride, total cholesterol, high-density lipoprotein, low-density lipoprotein, D-dimer, leucocytes, haemoglobin, platelet count, lymphocytes, neutrophils, eosinophils, high-sensitivity C-reactive protein (h CRP), alanine aminotransferase, aspartate aminotransferase, total bilirubin, albumin, albumin /globulin, creatinine and urea nitrogen. Two medical staff independently reviewed the data to ensure the accuracy of the collected data.

Statistical analyses

Continuous variables were described as means ± s.d. or median [interquartile range (IQR)] and categorical data were presented as numbers and percentages. The difference between the non-severe group and severe group was compared using Mann–Whitney test or t-test for continuous data and χ 2 tests for categorical variables. When frequency in one of the groups was less than 5 Fisher's exact test was used.

Univariate and multivariate logistic regressions were performed to explore the association of clinical characteristics and laboratory parameters with the severe risk in patients with COVID-19. A backward step-down process was used to select variables in the final model for the nomogram. The receiver operating characteristic (ROC) curve was used to evaluate the discriminatory ability of the model. The calibration plot measured the relationship between the model's predicted probability and the actual probability. The Hosmer–Lemeshow (H–L) test was used to assess model calibration. Calibration of risk predictions was often visualised in calibration plots. These plots showed the observed proportion of events associated with a model's predicted risk. The observed proportions per level of predicted risk could not be directly observed. The observed event rates could be obtained after categorising the predicted risks, for example, using deciles. This was commonly done for the Hosmer–Lemeshow test. Firstly, according to the prediction model, the predicted probability of the outcome event of each individual was calculated. Secondly, the predicted probabilities were sorted from small to large, and were divided into 10 groups according to decile. Thirdly, the actual observation number and model prediction number of each group were calculated respectively. Fourthly, a graph was drawn according to the actual observations and model predictions for each group, and the χ 2 value was calculated to obtain the corresponding P value. The P value >0.05 (H–L goodness-of-fit test) indicated that there was no statistical difference between the current model and the ideal perfect model, which was acceptable [Reference Alba15, Reference Van Calster16]. Decision curve analysis was used to determine the clinical usefulness of the model, and the true-positive (TP) and false-positive (FP) classifications were considered at increasing decision thresholds. This methodology evaluated prediction models for their potential to improve clinical decision making. A decision curve showed the net benefit (NB) of using a model at different thresholds. The NB summed the TPs minus a weighted number of FPs: NB = (TP−wFP)/n (n was the total sample size; w was the relative weight of the harm of unnecessary testing vs. the benefit of identification of a carrier). The NB of the model and two reference strategies – test none or test all – was calculated. When the prediction model curve was closer to two curves (none and all), the clinical application value was smaller [Reference Kastrinos17].

The statistical analyses were 2-tailed and P value <0.05 was considered statistically significant. All the statistical analyses were performed with R (http://www.R-project.org) and EmpowerStats software (www.empowerstats.com, X&Y solutions, Inc Boston, Boston, Massachusetts).

Results

Study participants

Overall, 239 consecutive confirmed patients with COVID-19 were admitted to the First Hospital of Changsha from 29 January to 15 February 2020. Of these 239 patients with COVID-19, 11 patients diagnosed as severe cases at admission were excluded. There were 228 patients enrolled in this study finally. 33 (14.47%) of these developed into severe cases by 6–15 days after admission. Among the 239 patients, 2 severe patients died before discharge and the remaining 237 patients completely recovered and were discharged (the clinical symptoms disappeared, and three nucleic acid tests were negative).

Clinical characteristics and laboratory findings of patients

The average age in the severe group was significantly higher than in the non-severe group (54.39 ± 14.65 vs. 43.25 ± 16.71, P < 0.001). There were higher percentages of the patients in the severe group than in the non-severe group in hypertension (30.3% vs. 9.23%, P < 0.001), COPD (9.09% vs. 1.03%, P = 0.023), fever (93.94% vs. 61.54%, P < 0.001), shortness of breath (42.42% vs. 6.67%, P < 0.001), headache (18.18% vs. 6.15%, P = 0.018) and fatigue (57.58% vs. 27.69%, P < 0.001) (Table 1).

Table 1. Demographics and clinical features in patients with COVID-19

COPD, Chronic obstructive pulmonary disease.

Epidemiology: patients exposed to Wuhan or close contact with confirmed COVID-19 patients.

a Calculated with Fisher's exact test.

Compared to the patients in the non-severe group, laboratory indicators significantly increased in the severe group including creatine kinase, lactate dehydrogenase, D-dimer, neutrophils percentage, h CRP, aspartate aminotransferase, creatinine and urea nitrogen. Additionally, laboratory indicators that significantly decreased in the severe group included lymphocyte percentage, eosinophils percentage, lymphocyte count, eosinophils count, albumin and albumin/globulin (Table 2).

Table 2. Laboratory findings in patients with COVID-19

h CRP, High-sensitivity C-reactive protein.

Risk factors associated with severe in patients with COVID-19

All demographic data, clinical presentation and laboratory parameters, listed in Tables 1 and 2, are evaluated the association with the severe risk by univariate analysis. Our analysis showed variables that displayed statistical significance with P < 0.05 are listed in Table 3. These variables included age, hypertension, COPD, headache, shortness of breath, fever, fatigue, urea nitrogen, albumin /globulin, albumin, aspartate aminotransferase, h CRP, eosinophils, lymphocytes, D-dimer, creatinine, lactate dehydrogenase and creatine kinase were associated with the severe risk of patients with COVID-19 pneumonia (Table 3). We further processed the above 18 variables with multivariate logistic regression analysis and found these five variables including shortness of breath, fatigue, creatine kinase, lymphocytes and h CRP were independent risk factors of the severe risk of patients with COVID-19 (Table 3).

Table 3. Odd ratio and 95% confidence interval (CI) in univariate and multivariate analysis of severe risk factors for patients with COVID-19

COPD, Chronic obstructive pulmonary disease, h CRP, High-sensitivity C-reactive protein; OR, odd ratio; CI, confidence interval.

* Indicated P < 0.05.

Construction and assessment of a novel predictive model

The predict factors selected to formulate a predictive nomogram included age, COPD, shortness of breath, fatigue, h CRP, creatine kinase and lymphocyte (Fig. 1). Each variable corresponded to a point (top line). Assigned points for all variables were then summed to obtain total points. Once total points were located, draw a vertical line down to the bottom line to obtain the predicted probability of risk. For example, a 60-year-old (8 points) patient with COPD (32 points), his h CRP was 70 mg/l (48 points) and lymphocyte was 0.9 × 109/l (100 points). This gives a total of 188 points with a corresponding risk probability of 88%. The performance of the nomogram was measured by ROC curves and the area under the curve (AUC) was 0.89 (95% CI 0.832–0.949), with a sensitivity of 75.76%, a specificity of 89.84% and an accuracy of 87.73% (Fig. 2a). The ROC curves showed that the model had good discrimination. In addition, calibration plots graphically showed the model had good calibration (Fig. 2b). The extent of agreement between the predicted probability and the actual probability of severe risk is shown in Figure 2b. The Hosmer–Lemeshow test result showed that there was no significant difference (P = 0.97), indicating that the predicted probability closely matched the actual probability. The decision curve demonstrated that the model had additional clinical value since it had the highest NB across a broad range of predicted probabilities ranging from 15–85% risk (Fig. 2c). This suggested that basing decisions on the model would yield an overall NB, as opposed to not using the model.

Fig. 1. Nomogram to estimate the severe risk in patients with COVID-19.

Fig. 2. Assessment of a Novel Predictive Model (a) The ROC of the model. (b) The calibration plot of the model. (c) Decision curve analysis for the model.

Discussion

The rapid and extensive spread of SARS-CoV-2 infection in the world has resulted in a tremendous loss of safety in peoples’ lives [Reference Ding18]. Therefore, identifying risk factors on admission to predict the likelihood of disease progression, would be beneficial to physicians when they are making a reasonable decision on patient management. Our study provides comprehensive data on the epidemiological, demographic, clinical and laboratory characteristics of 228 hospitalised patients with COVID-19 in the first hospital of Changsha, which is the largest local dedicated hospital for treating COVID-19 patients. Hence, it may represent the general situation of COVID-19 infection, except for severely affected areas, such as Wuhan. In this study, shortness of breath, fatigue, creatine kinase, lymphocyte and h CRP were independent risk factors for severe risk in COVID-19 patients, while age and COPD had no significant association with the severity of COVID-19. The results of a study with 262 patients were consistent with our study [Reference Zeng19]. This might be related to the small sample size. In Fang et al. 's study, they found older age and COPD associated with the severity of COVID-19 [Reference Fang20]. Similarly, in Xu et al.'s review, they observed that elderly male patients with COPD were more likely to develop severe COVID-19 infections [Reference Xu21]. For these reasons, five independent risk factors together with age and COPD were all selected to formulate a nomogram model to predict the severe risk of COVID-19 patients on admission. Based on these predictors, a risk nomogram with the AUC of 0.89 was established for the prediction of severe COVID-19, suggesting that our predict model had good discrimination. The good performance of this novel nomogram model was also confirmed by calibration plots and decision curves. The calibration curve demonstrated excellent consistency between the prediction of our nomogram and the observed curve. The decision curve analysis further showed that our nomogram conferred significantly high clinical NBs.

Previous studies have reported several clinical characteristics in severe cases and patients with adverse outcomes following COVID-19 infection. Older age, comorbidities such as hypertension, respiratory disease, diabetes, cancer, cardiovascular disease, high lactate dehydrogenase level and lymphocytopenia have all been associated with an increased risk of mortality [Reference Wang4, Reference Wu and McGoogan9, Reference Kobayashi22Reference Zhang24]. Obesity and smoking have been reported to correlate with increased risks in other studies [Reference Wang4, Reference Huang23]. In a study from Italy, men were at higher risk than women, which could be partly due to their higher smoking rates and subsequent comorbidities [Reference Livingston and Bucher25]. In our study, except for age and COPD, there were other factors included in the model, such as symptoms like shortness of breath and fatigue, laboratory data like creatine kinase, lymphocyte and h CRP. If the total points in the model added exceeded 160, the patient was noted to have a 50% risk of progressing to the severe status and perhaps requiring early intervention and more active treatment or even intensive care. The higher the points calculated, the higher the risk for the patient. The nomogram scoring system with seven clinical parameters seemed to be simpler than the 12-parameter MuLBSTA score proposed in the study by Guo et al. [Reference Guo26].

Our study also showed that the level of D-dimer was higher in the severe group than in the non-severe group. High levels of D-dimer were correlated with 28-day mortality in patients with infection or sepsis identified in the emergency department [Reference Rodelo27]. Mechanisms involved included systemic pro-inflammatory cytokine responses and local inflammation, which mediate atherosclerosis and plaque rupture, predisposing the patient to ischaemia and thrombosis. This indicates that severe patients may have a high risk of embolism, thus close monitoring and early intervention are needed [Reference Smeeth28Reference Davidson and Warren-Gash30]. Additionally, angiotensin-converting enzyme 2 (ACE2), the cellular receptor for SARS-CoV-2 entry, is expressed on myocytes and vascular endothelial cells [Reference Gallagher, Ferrario and Tallant31, Reference Mendoza-Torres32], hence there is, at least, a theoretical basis for direct cardiac and vascular involvement in SARS-CoV-2 infection. Our study showed that the severe group had elevated creatine kinase, which was possibly associated with myocardial injury, as reported in several studies [Reference Aboughdir33]. Currently, the specific mechanism remains exclusive. Therefore, in patients with SARS-CoV-2 infection, cardiac and vascular damage cannot be ignored depending on the situation, and dynamic monitoring is recommended. As an acute-phase reactive protein, h CRP usually correlates positively to the severity of inflammation in many diseases. The h CRP has been used as a factor to predict the severity of patients with SARS and SARS-COV-2 previously and recently [Reference Wang29]. It was confirmed again in our study that h CRP level was a risk factor to predict disease severity.

There are several limitations in our study. Firstly, the nomogram model was used to predict the severe risk of COVID-19 only. Like other prediction models in literature [Reference Zeng19Reference Xu21], it can be used to identify early severe COVID-19 patients at high risk and facilitate early appropriate supportive care and medical resources use. It cannot predict other situations such as mortality risk or the duration of severity. Secondly, the sample size was relatively small. It included only 228 patients in a single centre outside Hubei province and may not be suitable for predicting the outcomes of patients in areas most severely affected by the pandemic, such as Wuhan, or regions that are experiencing large-scale outbreaks of COVID-19. Thirdly, a prospective study is required to confirm the reliability of this nomogram model. Fourthly, adding other specific markers might further improve the sensitivity and specificity of the model.

Conclusion

We established a nomogram model of seven clinical parameters to predict the disease severity of COVID-19 on admission. Application of this model with high accuracy might be beneficial for delaying or halting the progression of the disease, which may improve therapeutic treatments, reduce the severity of COVID-19 and result in the more accurate and effective deployment of medical resources.

Acknowledgements

We thank Etage for his critical reading of our manuscript.

Author contributions

Fang Zheng, Ning Li and Ruochan Chen designed the study. Wei Tang, Yaxiong Huang and Guoqiang Zhou collected the data. Ruochan Chen and Run Yao analysed the data and wrote the manuscript. All authors read and approved the final manuscript.

Financial support

This study was supported by the Emergency Special Science and Technology Plan Project of COVID-19 Epidemic of Changsha city (NO. kq2001006 and kq2001053), National Natural Sciences Foundation of Hunan province (NO. 2019JJ30041) and the Innovation-Driven Project of Central South University (NO.2020CX044).

Conflict of interest

The authors have declared that no conflict of interest exists.

Ethical standards

This study was approved by the First Hospital of Changsha city (No. 2020011). Informed consent was obtained from all patients.

Data availability statement

Data analysed during the current study are available from the corresponding author on reasonable request.

Footnotes

*

These authors contributed to the work equally

References

Wang, H et al. (1999) HMG-1 as a late mediator of endotoxin lethality in mice. Science (New York, N.Y.) 285, 248251.CrossRefGoogle ScholarPubMed
Chen, NS et al. (2020) Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. Lancet (London, England) 395, 507513.CrossRefGoogle ScholarPubMed
Peng, YD et al. (2020) Clinical characteristics and outcomes of 112 cardiovascular disease patients infected by 2019-nCoV. Zhonghua Xin Xue Guan Bing Za Zhi 48, E004.Google ScholarPubMed
Wang, DW et al. (2020) Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. The Journal of the American Medical Association 323, 10611069.CrossRefGoogle ScholarPubMed
Wang, YX et al. (2020) Unique epidemiological and clinical features of the emerging 2019 novel coronavirus pneumonia (COVID-19) implicate special control measures. Journal of Medical Virology 92, 568576.CrossRefGoogle ScholarPubMed
Zhu, Z et al. (2020) Clinical value of immune-inflammatory parameters to assess the severity of coronavirus disease 2019. International Journal of Infectious Diseases 95, 332339.CrossRefGoogle ScholarPubMed
Huang, CL et al. (2020) Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet (London, England) 395, 497506.CrossRefGoogle ScholarPubMed
Zhu, N et al. (2020) A novel coronavirus from patients with pneumonia in China, 2019. The New England Journal of Medicine 382, 727733.CrossRefGoogle Scholar
Wu, ZY and McGoogan, JM (2020) Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72314 cases from the Chinese center for disease control and prevention. The Journal of the American Medical Association 323, 12391242.CrossRefGoogle ScholarPubMed
Al-Najjar, H and Al-Rousan, N (2020) A classifier prediction model to predict the status of coronavirus COVID-19 patients in South Korea. European Review for Medical and Pharmacological Sciences 24, 34003403.Google ScholarPubMed
Ji, D et al. (2020) Prediction for progression risk in patients with COVID-19 pneumonia: the CALL score. Clinical Infectious Diseases 71, 13931399.CrossRefGoogle ScholarPubMed
Zhou, F et al. (2020) Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet (London, England) 395, 10541062.CrossRefGoogle ScholarPubMed
Zhou, YL et al. (2020) Risk factors associated with disease progression in a cohort of patients infected with the 2019 novel coronavirus. Annals of Palliative Medicine 9, 428436.CrossRefGoogle Scholar
Lauer, SA et al. (2020) The incubation period of coronavirus disease 2019 (COVID-19) from publicly reported confirmed cases: estimation and application. Annals of Internal Medicine 172, 577582.CrossRefGoogle ScholarPubMed
Alba, AC et al. (2017) Discrimination and calibration of clinical prediction models: users’ guides to the medical literature. The Journal of the American Medical Association 318, 13771384.CrossRefGoogle ScholarPubMed
Van Calster, B et al. (2016) A calibration hierarchy for risk models was defined: from utopia to empirical data. Journal of Clinical Epidemiology 74, 167176.CrossRefGoogle ScholarPubMed
Kastrinos, F et al. (2017) Development and validation of the PREMM5 model for comprehensive risk assessment of Lynch syndrome. Journal of Clinical Oncology 35, 21652172.CrossRefGoogle ScholarPubMed
Ding, Q et al. (2020) The clinical characteristics of pneumonia patients coinfected with 2019 novel coronavirus and influenza virus in Wuhan, China. Journal of Medical Virology 92, 15491555.CrossRefGoogle ScholarPubMed
Zeng, F et al. (2020) A predictive model for the severity of COVID-19 in elderly patients. Aging (Albany NY) 12, 2098220996.CrossRefGoogle ScholarPubMed
Fang, X et al. (2020) Epidemiological, comorbidity factors with severity and prognosis of COVID-19: a systematic review and meta-analysis. Aging (Albany NY) 12, 1249312503.CrossRefGoogle ScholarPubMed
Xu, L et al. (2020) Risk factors for 2019 novel coronavirus disease (COVID-19) patients progressing to critical illness: a systematic review and meta-analysis. Aging (Albany NY) 12, 1241012421.CrossRefGoogle ScholarPubMed
Kobayashi, T et al. (2020) Communicating the risk of death from novel coronavirus disease (COVID-19). Journal of Clinical Medicine 9, 580.CrossRefGoogle Scholar
Huang, R et al. (2020) Clinical findings of patients with coronavirus disease 2019 in Jiangsu province, China: a retrospective, multi-center study. PLoS Neglected Tropical Diseases 14, e0008280.CrossRefGoogle ScholarPubMed
Zhang, JJ et al. (2020) Clinical characteristics of 140 patients infected with SARS-CoV-2 in Wuhan, China. Allergy 75, 17301741.CrossRefGoogle ScholarPubMed
Livingston, E and Bucher, K (2020) Coronavirus disease 2019 (COVID-19) in Italy. The Journal of the American Medical Association 323, 1335.CrossRefGoogle ScholarPubMed
Guo, LX et al. (2019) Clinical features predicting mortality risk in patients with viral pneumonia: the MuLBSTA score. Frontiers in Microbiology 10, 2752.CrossRefGoogle ScholarPubMed
Rodelo, JR et al. (2012) D-dimer is a significant prognostic factor in patients with suspected infection and sepsis. American Journal of Emergency Medicine 30, 19911999.CrossRefGoogle ScholarPubMed
Smeeth, L et al. (2004) Risk of myocardial infarction and stroke after acute infection or vaccination. The New England Journal of Medicine 351, 26112618.CrossRefGoogle ScholarPubMed
Wang, JT et al. (2004) Clinical manifestations, laboratory findings, and treatment outcomes of SARS patients. Emerging Infectious Diseases 10, 818824.CrossRefGoogle ScholarPubMed
Davidson, JA and Warren-Gash, C (2019) Cardiovascular complications of acute respiratory infections: current research and future directions. Expert Review of Anti-infective Therapy 17, 939942.CrossRefGoogle ScholarPubMed
Gallagher, PE, Ferrario, CM and Tallant, EA (2008) Regulation of ACE2 in cardiac myocytes and fibroblasts. American Journal of Physiology. Heart and Circulatory Physiology 295, H2373H2379.CrossRefGoogle ScholarPubMed
Mendoza-Torres, E et al. (2015) ACE2 and vasoactive peptides: novel players in cardiovascular/renal remodeling and hypertension. Therapeutic Advances in Cardiovascular Disease 9, 217237.CrossRefGoogle ScholarPubMed
Aboughdir, M et al. (2020) Prognostic value of cardiovascular biomarkers in COVID-19: a review. Viruses 12, E527.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Demographics and clinical features in patients with COVID-19

Figure 1

Table 2. Laboratory findings in patients with COVID-19

Figure 2

Table 3. Odd ratio and 95% confidence interval (CI) in univariate and multivariate analysis of severe risk factors for patients with COVID-19

Figure 3

Fig. 1. Nomogram to estimate the severe risk in patients with COVID-19.

Figure 4

Fig. 2. Assessment of a Novel Predictive Model (a) The ROC of the model. (b) The calibration plot of the model. (c) Decision curve analysis for the model.