Assay Design and characteristics
In silico analysis by PrimerBlast and BLAST analyses of primers, probes and amplicons signified that all virus oligonucleotide sequences are specific for SARS-CoV-2 and that the assays are not complementary to any other coronavirus. Since the oligonucleotide manufacturer enclosed a cautionary note with primer and probe shipments indicating that they “could contain trace amounts of long oligo templates” specifying SARS-CoV-2 sequences, all panels were immediately assessed in qPCR assays without addition of template. None resulted in amplification signals, demonstrating that they were not contaminated with either SARS-CoV-2 or JUN templates. Assay details, oligonucleotide sequences, fluorophores, final optimised reaction conditions and PCR efficiencies are shown in Table 1. The supplementary data file contains the detailed optimisation results for primer and probe concentrations (Tab 2) and annealing temperatures (Ta) (Tab 3). All six assays resulted in efficient RT-qPCR assays, ranging from 94% to 103% (Table 1) with melt curves resulting in a single peak, indicating the amplification of a single amplicon (Supplementary Figure S1.
A conservative limit of quantification was established based on results from ddPCR experiments using Nsp10. Results from a five-fold serial dilution series indicated that quantification was linear to down to around 50 copies (Supplementary Figure S2a, b). In order to determine whether this was the approximate threshold of reliable and reproducible quantification, seven individual dilutions of the template were subjected to ddPCR assay. The results establish that this assay can reliably quantify 41±12 copies of viral target (Supplementary Figure S2c,d), although this limit is lower if additional probes are used (see below). In order to translate this to an RT-qPCR limit of detection (LOD) for viral targets, the sample containing 50 copies was diluted further to nominal 10, 5, 2 and 1 copies and subjected to qPCR amplification using the Nsp10 assay. This resulted in the detection of 5 copies by 12/12 replicates and two and one copies by 10/12 and 8/12 replicates, respectively (Figure 2a), with similar results obtained with Nsp12 (Figure 2b). A repeat experiment using the dilution that had a predicted two-copy per reaction detected Nsp10 presence in 24/24 reactions (Figure 2c). Underlying data are presented in supplementary data Tab 4.
Comparison of assay performance; individual or multiplex assays
To reduce sample processing time, reduce reagent usage and increase throughput it was desirable to optimise the assays to run in multiplex. Two viral targets (Nsp10 (FAM) and N-gene (Texas Red), JUN (Cy-5) and EICAS2 (HEX) panels were combined to form the initial assay. Cq values obtained from assays run individually were compared with those obtained in the multiplex reaction. The assays perform equally well in both conditions (Figure 3, supplementary data file Tab 5) with only JUN amplification being approximately two cycles later in the multiplex reaction. This was solved by increasing the JUN primer concentration to 1.3µM (supplementary data file Tab 5a).
The performance of the two EICAS assays and their effect on the amplification of the other markers was compared by carrying out four replicate multiplex RT-qPCR with either EICAS1 or EICAS2 as the internal control. Results were similar, suggesting that the inclusion of the additional primer set required for EICAS1 had no detectable adverse effect on assay performance (Supplementary data file Tab 6).
Assay validation
For validation of this test panel, 1µL RNA was used per sample to reanalyse all 28 clinical samples and our results were 100% concordant (Table 3; Cqs are shown in supplementary data file Tab 7). For sample A8, Broomfield Hospital recorded discordant ORF1ab/N-gene results but these were positive for both markers when tested with our panel. Six positive and four negative samples were also tested using a commercial diagnostic kit (Sansure), with comparable results. In this case, the commercial kit did not detect one of the viral targets (ORF1ab) in sample B1, which was detected both at Bromfield Hospital and with our panel. There was significant correlation between Cqs recorded for Nsp10 and N-gene (r (95%CI)=0.96 (0.89-0.98) as well as between Nsp 10 or N-gene and JUN (r=0.73 (0.45-0.88) and 0.86 (0.68-0.94, respectively (supplementary Figure S3 and supplementary data file, Tab 7). An analysis of all clinical samples using the D614G genotyping assay revealed that all isolates harboured the A to G transition, characteristic of the more infectious phenotype, whereas the control clinical sample and Twist BioScience control 1 were both wild type, G, at this location (supplementary data file, Tab 7)
Inclusion of the EICAS template in the assay panel permits some analysis of the quality of RNA extracted from patient samples. If inhibitors of the RT or the PCR are present in the clinical samples, an increase in Cq is expected for the EICAS assay compared with no template control samples, analogous to the principle underlying the SPUD assay (19). An analysis of the 28 samples revealed little, if any inhibition, with a median Cq of 27.07 (range 25.57-29.12) compared with the median Cq of 27.08 (range 27.54-26.91) recorded by no clinical template control samples (supplementary data file, Tab 7a).
The C to T transition at the -9 position in the Nsp10 F primer binding site of isolate MT412262 does not impede the binding of the CoV2-ID F primer to mutant target (Supplementary Figures S4a). The reverse is also true, in that the mutant primer binds efficiently to the WT target (Supplementary Figures S4b). In each case the qPCR data are in broad agreement with the ddPCR results. Targets with mutations at positions -10 and -7 at the N-gene primer binding site are also efficiently amplified by the CoV2-ID F primer (Supplementary Figures S5c), as is the WT sequence by the two mutant primers (Supplementary Figures S5d). Since a mutation has been identified for three isolates (MT506889/506904/506907) at position 2 of the 5’-end of the N-gene probe, the effect of that mutation on the efficiency of amplicon detection by the N-gene probe was investigated. Two specific probes were synthesised, one with (MuN) and one without (N-Pr2) the mutation at position 2 of the probe. Both gave virtually the same results (Supplementary Figure S5a), as did an alternative probe with WT sequences (Supplementary Figure S5b). The performance of both CoV2-ID and mutant primers with their respective templates was further analysed using an annealing temperature gradient analysis, which shows that the mutations have little effect on assay performance below 65ºC. Details of all underlying data for both qPCR and ddPCR results are listed in the supplementary data file Tabs 8, 8a, 8b and8c.
Conversion to a fiveplex assay and simplification
ddPCR data suggest that targeting two viral targets (Nsp10 and 12) using the same flurophore (FAM) increases the sensitivity of the assay by around 80% (Supplementary Figure S6a,b) and that there could be some benefit in a qPCR setting, especially with regards to further reducing the likelihood of a false negative result (Supplementary Figure S6c,d with well statistics and Cqs listed in supplementary data file Tab 9).
To test this concept, Nsp12 was added as a third viral target to the fourplex CoV2-ID assay, making it a fiveplex, with two of the viral targets being detected on one channel. The results show that the assays work equally well (Supplementary Figure S7, with underlying data in supplementary data file Tab 10). Performance of the four- and fiveplex assays was further assessed in four additional patient samples and the results indicate that they perform comparably, with the viral targets being detected earlier in the fiveplex assay (Supplementary Figure S8, with underlying data in supplementary data file Tab 11). Finally, in order to determine whether the sensitivity of the assay could be increased further, the fiveplex assay was modified so that all three viral targets (Nsp10, Nsp12 and N-gene) were detected with FAM-labelled probes. Both qPCR (Figure S9a,b) and ddPCR (Figure S9c,d) data reveal that there is indeed a further increase in sensitivity (data in supplementary data file Tab 12).
Development of Rapid Cycling Conditions
In order to further improve the potential throughput of the assay in a diagnostic setting, the ability of the assay to perform adequately under short RT times and fast PCR conditions was tested. Data equivalent to the initial conditions of 10 mins RT, 5 seconds denaturation and 10 seconds polymerisation were obtained for all three viral targets, when the RT was reduced to 5 minutes and both denaturation and polymerisation times were 1 second, although in practice, the annealing/polymerisation step takes around 6 seconds, as the fluorescence scanning takes around five seconds. This resulted in a reduction in run times from 33 minutes 40 seconds to 20 minutes (Figure 4a, with data in supplementary data file Tab 13). The initial 5 second/10 second and final 1 second/1second conditions were applied to replicate fiveplex assays, and the results confirmed that all panels can be run using this protocol (Figure 4b; with data in supplementary data file Tab 13b).
The next aim was to try and reduce run times by further reducing the RT times. The results shown in supplementary Figure S10 (underlying Cqs are in supplementary data file, Tab 14) suggest that a 1-minute RT step results in Cqs similar to the 5-minute RT reaction, reducing run times to 16 minutes.
Reductions in run times can be achieved on instruments not designed to run as fast as the PCRMax/Techne, as shown for the BioRad CFX. Here the reduction in RT time from 10 minutes to 1 minute and cycling times from 95ºC/5 seconds and 60ºC/20 seconds, to 1 minute RT and 1 second each at 95ºC and 60ºC reduced the run time from 58 minutes to 32 minutes. The Cqs from seven targets present at a wide range of concentrations were compared and there was very little difference. Indeed, most of the targets recorded slightly lower Cqs with the fast run (supplementary data file, Tab 14a).
Since the cooling step is the slowest part of the PCR cycle in block-based qPCR instruments, reducing the temperature gap between denaturation and annealing/polymerisation temperatures should further reduce run times. Following an initial calibration run with a 1 minute RT step followed by 1 second 95ºC denaturation and 60ºC annealing/polymerisation steps, denaturation temperatures were reduced and annealing/polymerisation temperatures were increased. Even without further modifications to primer or enzyme concentrations, the small differences in Cq (Figure 5, with Cqs in supplementary data file, Tab 15) indicate that this would be a potential method to reduce reaction times, in this case from 16 minutes to 14 minutes 11 seconds.
Multiple cycle fluorescence detection
We have developed a multiple cycle fluorescence detection (MCFD) protocol linked to a 5-level rating algorithm. This results in faster run times and permits the inclusion of the quantitative information inherent in real-time PCR without the confusion surrounding the use of quantification cycles. The feasibility of using this method rather than real-time detection was tested by comparing the performance of the two approaches using the same master mixes. Whereas the standard qPCR run took 43 minutes to complete, the MCFD run took just over 22 minutes. The results for five different concentrations of viral target, together with the NTC control are shown in Figure 6a, with the proposed algorithm in Figure 6b. All underlying MCFD data are shown in supplementary data file Tab 16.
Quantification potential
The inclusion of ddPCR quantified, internal EICAS, facilitates an indirect measurement of copy number, thus allows this RNA to function both as a measure of quality control, as well as an assessment of viral load.
The same quantity of Nsp10 target was detected using qPCR as well as digital PCR. The results shown in supplementary Figure S11a demonstrate how the reported Cq depends on the threshold setting, which is subjectively set by the operator or automatically determined by a software algorithm that can vary between runs and instruments. This interferes with accurate quantitative reporting of SARS-CoV-2 viral loads, as the highest and lowest threshold-dependent Cq recorded in that run varies by 8.7, ie corresponds to a 400-fold difference. In contrast, the copy numbers calculated using the ddPCR platform shows very little variation, recording an average copy number of 1163±61 (supplementary Figure S11b) Underlying data are shown in supplementary data file tab 17.