A total of 950 samples from 329 participants seropositive by any assay after 14 days underwent testing with the Roche-N, Roche-S, the MSD and the Abbott-N assay. The majority of the participants (98%, 321/329) had a positive result by two or more assays.
Antibody Decay with Time
Plotting the raw log transformed antibody titres over time since symptom onset (Figure 1) demonstrated that antibody dynamics were dependent on the assay undertaken. The production of spike antibodies was demonstrated to be maintained at high levels up to 200 days when evaluated by the MSD and the quantitative Roche -S assay. All nucleoprotein antibody assays demonstrated decay of the nucleoprotein antibody over time. This was most pronounced in the Abbott-N assay and much less so in the Roche -N assay which demonstrated slow waning of the nucleoprotein antibody.
Assay Sensitivity with Time Post Symptom Onset
The existing published test performance for all assays undertaken is provided in Table 1. The sensitivity of all assays (at least 14 days from symptom onset) at 50, 100 and 150 days is provided in Table 2. All assays demonstrated a reasonable sensitivity at 50 days following infection. As time passed following infection, the Abbott-N assay rapidly became seronegative, with a median survival time inferred at 175 days (95% CI 168-185 days), whereas the survival probability at 150 days was inferred to be 95% for the Roche-N (95% CI 0.92 - 0.97), and 91% for the MSD-N assay (95% CI 0.87 - 0.94). The Roche-S and MSD-S assays remained seropositive for the duration of the study. The MSD-RBD assay showed some evidence of waning seropositivity over time (90% Survival probability at 150 days, 95% CI 0.88 - 0.94).
A total of 45% (159/329) of the individuals had a negative result using the Abbott-N assay during the course of the study. For the MSD test, 16% (52/329) of participants had a negative test for the N antigen, 11% (36/329) for RBD, and 3% (11/329) for the S antigen. For the Roche platform, 5.5% (18/329) of the individuals had a negative result with the Roche-N assay, while only 4.8% (16/329) of them had a negative result for the S antigen over the course of the study.
Table 1
A summary of the existing published data for the commercially available tests in this comparison. The corresponding antigen target and published sensitivity, specificity, positive predictive value and negative predictive value (if available).
Tests | Manufacturer | Target Antigen | Type | Sens† | Spec | # Samples/Patients* | Days post symptom onset |
Abbott-N [16] | Abbott-N | Nucleoprotein | CLMIA | 100.0% (day 17) | 99.9% | 689/125 | ≥21 |
Roche-N [17] | Roche Cobas | Nucleoprotein | ECLIA | 99.5% | 99.8% | 496/102 | ≥14 |
Roche-S [18] | Roche Cobas | Spike protein | ECLIA | 96.6% | 100% | 1485‡/331 | ≥15 |
MSD [13] | Meso Scale Discovery | Nucleoprotein | ECLIA | 87.2% | 92.8% | 196/196 | ≥21 |
Spike protein | 97.9% | 97.4% | 47/47 | ≥21 |
RBD (receptor binding domain) | 93.6% | 92.3% | 47/47 | ≥21 |
ECLIA: Electro Chemiluminescent Immunoassay, CLMIA: Chemiluminescent Microparticle Immuno Assay PPV: Positive Predictive Value, NPV: Negative Predictive Value, Sens: Sensitivity, Spec: Specificity, ELISA: Enzyme Linked Immunosorbent Assay |
†The highest reported sensitivity |
‡233 of these samples were tested at ≥15 days post PCR diagnosis |
*For Sensitivity Testing |
Table 2
Sensitivity of compared assays at 50, 100 and 150 days from symptom onset.
| Survival probability (95% CI) |
| 50-day | 100-day | 150-day |
Abbott-N | 0.985 (0.97;0.99) | 0.919 (0.89;0.95) | 0.655 (0.6;0.71) |
Roche-N | 0.988 (0.98;1.0) | 0.963 (0.94;0.98) | 0.949 (0.92;0.97) |
Roche-S | 0.991 (0.98;1.0) | 0.966 (0.95;0.99) | 0.952 (0.93;0.98) |
MSD | | | |
-N | 0.988 (0.98;1.0) | 0.972 (0.95;0.99) | 0.907 (0.87;0.94) |
-S | 0.997 (0.99;1.0) | 0.978 (0.96;0.99) | 0.968 (0.95;0.99) |
-RBD | 0.994 (0.99;1.0) | 0.969 (0.95;0.99) | 0.909 (0.88;0.94) |
Mathematical Model Fits to Estimate Long-Term Antibody Decay
To estimate the decay rate for each antibody and assay studied, a generalized linear mixed model was fitted to the trajectory of antibody decay after 21 days from symptom onset, where the decay rate was estimated as the slope of the antibody titer through time. Under the most sensitive and quantitative Roche -S assay the spike antibody demonstrated no decay at all and rather a slow rate of increased titres over time from symptom onset (0.0031, 95% CI 0.0018 — 0.0044, Fig. 2b). In accordance with the raw observed data, all nucleoprotein antibodies under the mathematical model decayed (Fig. 2a, Fig. 2b). This was most pronounced in the Abbott-N assay (-0.022, 95% CI -0.023 — -0.02) and least pronounced in the Roche -N assay (-0.0025, 95% CI -0.0039 — -0.0012, Fig. 2b, Table 3).
The Roche-S assay target the spike antibody, the Abbott-N and the Roche-N assays target the N-antibody while the MSD assay targets the N-, the S- and the antibody to the Receptor Binding Domain (RBD) of the spike protein in parallel. (a) Kaplan-Meier curve and numbers at risk (the number of participants under follow up with serological tests available for analysis at that time point) for different serological tests. Y-axis represents the probability of remaining seropositive, while the X-axis shows days after symptom onset with numbers of participants under follow up shown in the table below. (b) Inferred posterior density distributions of the decay rate in a generalized linear mixed model.
Table 3
Decay rate for each serological assay (log arbitrary units per day) estimated in a generalized linear mixed model.
| Mean | 95% CI |
MSD-N | -0.0121 | -0.0134;-0.0107 |
MSD-RBD | -0.0068 | -0.008;-0.0055 |
MSD-S | -0.0035 | -0.0048;-0.0023 |
Abbott-N | -0.0216 | -0.0229;-0.0204 |
Roche-S | 0.0031 | 0.0018;0.0044 |
Roche-N | -0.0025 | -0.0039;-0.0012 |
The lower performance of the Abbott-N assay can be explained by a lower detection of titer values as their concentration wanes over time. When compared to the quantitative MSD-N, 26% (222/860) of all positive samples by the MSD-N were negative for the Abbott-N test (Fig. 3). A total of 75% of samples (137/ 183) positive by the MSD-N with an MSD arbitrary titer value lower than 403 were negative for the Abbott-N assay.
The quantitative results for the MSD-N assay were compared to those of the Abbot-N test for each sample taken. Colours divide the samples depending on whether it was positive (green) or negative (red) for the MSD-N assay. Dotted red lines represent the seropositivity threshold for the Abbott-N assay (horizontal) and the MSD-N test (vertical).