We designed a single center, retrospective, observational study conducted from February 25th. 2020 to April 15th 2020 in the Emergency Department (ED) of Princess Grace Hospital, a general hospital in Monaco. The study was monitored by the research department of our Hospital. No funding was obtained for this study. The ethical board held for the study approved the protocol and waived the need of a written informed consent for inclusion. The protocol was registered in the clinicaltrial.gov website under the MONACOVID-Biomarkers acronym (NCT04401241). The National laws for Ethics did not require informed consent. The study complied with STARD recommendations [16].
Objectives
The primary objective was to assess sensitivity of routine biomarkers and blood cell count for diagnosis of COVID-19-associated pneumonia in low and high probability groups for COVID-19-associated pneumonia classified by an adjudication committee.
Secondary objectives were i) to compare values of routine biomarkers and blood cell count amongst the four different categories of level of certainty; ii) to assess performance of combined routine biomarkers and blood cell count for diagnosis of COVID-19-associated pneumonia; iii) to assess whether usual biomarkers and blood cell count were associated with diagnosis of COVID-19-associated pneumonia using sensitivity analyses in predefinite subgroups chosen a priori; 1) when comparing definite versus excluded patients; 2) when comparing high vs. low probability patients, excluding bacterial infection (respiratory and extra-respiratory) in the low probability COVID-19-associated pneumonia group; 3) when comparing definite versus excluded probability patients, excluding bacterial infections (respiratory and extra-respiratory) in excluded patients.
Adjudication committee
An adjudication committee consisting of two independent senior experts in infectious diseases and pneumology retrospectively assigned the probability of COVID-19-associated pneumonia diagnosis using the 4-level Likert scale, based on data collected from baseline on standardized case report forms, results of SARS-Cov-2 specific RT-PCR, of low dose chest CT-Scan, and full access to all available data including patients’ discharge summary. To note, the adjudication committee was blinded for classification by an independent senior radiologist of low dose chest CT-scan. A Likert scale allowed distribution of patients in four categories: 1) absence of COVID-19-associated pneumonia referred as excluded; 2) unlikely COVID-19-associated pneumonia; 3) probable COVID-19-associated pneumonia; and 4) definite COVID-19-associated pneumonia. After adjudication committee classification, patients were distributed in two groups: low probability of COVID-19-associated pneumonia (excluded and unlikely) and high probability of COVID-19-associated pneumonia (probable and definite).
For this study, the gold standard was the diagnosis assessed by the adjudication committee. Alternative diagnoses were established for low probability COVID-19-associated pneumonia and classified as i) non-COVID viral respiratory tract infection; ii) non-COVID bacterial respiratory tract infection; iii) respiratory tract disorder at the exclusion of infectious diseases; iv) extra-pulmonary infectious diseases; and v) miscellaneous.
Study population
For the study purpose and to ensure quality of the final adjudication committee diagnosis, we selected consecutive adults (18 years of age and above) visiting the COVID-19 dedicated ED who presented with clinically suspected COVID-19-associated pneumonia and had SARS-Cov-2 RT-PCR. Clinically suspected COVID-19-associated pneumonia was based on physician’s judgment and fulfilling the following criteria: new onset of symptoms concordant with viral infection (at least one of the following: sweat; chills; myalgia; temperature ≥38 °C or <36 °C or perception of fever; loss of smell and/or taste; diarrhea) and symptoms of an acute lower respiratory tract disorder (at least one of the following: cough; sputum production; respiratory rate ≥20 per minute; dyspnea; chest pain; altered breathing sounds at auscultation). We selected patients whose presentation required a blood sample for global and severity assessment.
Patient management and usual biomarkers and blood cell count
Patients’ management in the COVID-19-dedicated ED was based on local protocoled practices based on a collegial multidisciplinary decision if they presented with suspected COVID-19-associated pneumonia. Recorded baseline data consisted of demographic data (age; gender), medical history of coexisting conditions; treatments; symptoms; clinical findings and predetermined laboratory tests including: SARS-Cov-2 specific RT-PCR obtained on nasopharyngeal swab; low-dose chest CT-scan; standard blood analysis (complete blood count; hemostasis; metabolic panel; creatinine; blood urea nitrogen; liver enzymes); D-dimers (Vidas. Biomérieux); Procalcitonin (PCT); C-reactive protein (CRP); high sensitive cardiac troponin T; NT-pro-brain natriuretic peptide (NT-proBNP, all on Cobas, Roche diagnostics).
Microbiological samples
Nasopharyngeal swabs were collected at admission and placed in a Middle Virocult MWE (Sigma®) transport medium. Samples were kept at room temperature and sent to the laboratory immediately after collection. For the presence of SARS-COV-2, swabs were sent to french referent centres for virological analysis (Nice, Marseille, Paris). Routine microbiological examinations were performed at the discretion of the emergency physicians and included: presence of influenza A and B viruses and respiratory syncytial virus (RSV) A and B on nasopharyngeal swabs; blood culture; urine antigens for Streptococcus pneumoniae and Legionella pneumophila type I; serodiagnosis of Mycoplasma pneumoniae. These results were available to the adjudication committee.
Low dose chest CT-scan data and COVID-19-associated pneumonia diagnosis classification
Multidetector low dose thoracic CT-scan was performed for each individual patient and interpretation was recorded using a standardized report form. The low dose chest CT-scans were independently reviewed by a senior radiologist, blinded from other data, and classified for probability of COVID-19-associated pneumonia as 1) excluded; 2) unlikely; 3) probable; and 4) definite.
Statistical analysis
Baseline and follow-up characteristics were described by means and standard deviations (SD) or by median and interquartile range (IQR) for continuous variables with normal or with skewed distribution, respectively, and by percentages for categorical variables. Chi-square or Fisher exact tests were performed when appropriate for qualitative variables. The Student or Mann–Whitney tests were used to compare baseline characteristics and study outcomes between study groups for continuous variables with skewed distributions.
The distribution of values for usual biomarkers and blood cell count were determined in the different populations of patients using boxplots. The performances of current laboratory data in predicting definite COVID-19-associated pneumonia were evaluated by sensitivity analysis (definite vs excluded COVID-19-associated pneumonia). CRP was evaluated at several cut-off points of 20 mg/L, 50 mg/L, and 100 mg/L, values used in previous studies [17]. Several cut-off points for PCT were chosen at the level of 0.10 μg/L [17] and at the two levels for suspected bacterial infection 0.25 μg/L and 0.50 μg/L. Cut-offs for cTnT-hs were 14 ng/L and 50 ng/L, as stated by the manufacturer. Cut-offs for D-dimers test were 500 µg/ml and age-adjusted threshold [18]. Sensitivity, specificity, positive predictive values (PPVs), negative predictive values (NPVs), and likelihood ratio were calculated. Receiver operating characteristic (ROC) curves were drawn, area under the curve AUC was computed and optimal cut-off was identified by the maximization of the Youden’s index, comparing laboratory results values in patients with excluded COVID-19-associated pneumonia and definite COVID-19-associated pneumonia. From these optimal cut-offs for laboratory results, sensitivity analyses were performed combining cut-offs.
A multivariate logistic regression model was built to identify factors associated with having high probability of COVID-19-associated pneumonia as compared to having an excluded COVID-19-associated pneumonia diagnosis. All variables with a p value of < 0.15 in the bivariate analysis were entered into a multivariate logistic regression with a backward stepwise approach; the discrimination was evaluated by the C-index and its 95 % confidence interval (95 % CI) and the calibration was evaluated by the Hosmer Lemeshow goodness-of-fit test.
All tests were two-sided, and p-values below 0.05 were considered to denote statistical significance. All statistical analyses were performed using SAS 9.1. (SAS Institute, Cary, NC, USA).