Hostname: page-component-78c5997874-mlc7c Total loading time: 0 Render date: 2024-10-31T22:02:33.112Z Has data issue: false hasContentIssue false
  • English
  • Français

Pooling of coronavirus tests under unknown prevalence

Published online by Cambridge University Press:  06 August 2020

A. Pikovski Open the ORCID record for A. Pikovski [Opens in a new window]  and
K. Bentele Open the ORCID record for K. Bentele [Opens in a new window]
A. Pikovski*
Affiliation:
Freie Universität Berlin, Berlin, Germany
K. Bentele
Affiliation:
HU Berlin, Berlin, Germany
*
Author for correspondence: A. Pikovski, E-mail: a.pikovski@fu-berlin.de
Rights & Permissions [Opens in a new window]

Abstract

Diagnostic testing for the novel coronavirus is an important tool to fight the coronavirus disease (Covid-19) pandemic. However, testing capacities are limited. A modified testing protocol, whereby a number of probes are ‘pooled’ (i.e. grouped), is known to increase the capacity for testing. Here, we model pooled testing with a double-average model, which we think to be close to reality for Covid-19 testing. The optimal pool size and the effect of test errors are considered. The results show that the best pool size is three to five, under reasonable assumptions. Pool testing even reduces the number of false positives in the absence of dilution effects.

Keywords

CoronavirusCOVID-19epidemiologylaboratory testsmathematical modelling
Type
Short Paper
Information
Epidemiology & Infection , Volume 148 , 2020 , e183
Check for updates
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s), 2020. Published by Cambridge University Press

Introduction

The fast global spread of the novel coronavirus is responsible for the current pandemic, known as coronavirus disease 2019 (Covid-19). Diagnostic tests for the novel coronavirus (nCov) are being employed worldwide. It is self-evident that increasing the number of diagnostic tests is important to combat the epidemic.

Widely used tests for Covid-19 detect the novel coronavirus RNA genome, using the real-time polymerase chain reaction method. The capacities for such tests, however, are limited by the used reactants, machine time, lab personnel time and overall logistics. Remarkably, testing capacities can be increased by a modification of the testing protocol.

Combining probes from several individuals and testing them together reduces the total amount of tests needed. This method, known as pooling or group testing, has been known for a long time [Reference Dorfman1]. The main idea is: when probes from several people are mixed together (pooled) and tested, the test will report negative when everyone is healthy and positive when at least one person is infected.

This study deals with Dorfman's classic two-stage protocol [Reference Dorfman1] (described below). More complicated procedures have been devised; however, we shall not consider them here.

The pooling method was validated for nCov tests by many laboratories [Reference Yelin2–Reference Gan15]. However, the following questions remained open, which we address in this paper. (1) What pool size should be used? (2) How are test errors affected by the procedure?

Results

The two-stage procedure is as follows [Reference Dorfman1]. We denote the number of people in one pool, i.e. the pool size, by M. Probes of M people are each split in two parts. One part is mixed together with the others, while the other part is kept for later. The mixture is tested for nCov. Upon a negative result, all the M people are declared healthy. When the result is positive, go to the second stage. In the second stage, each of the M people is tested individually using the probes that were put aside previously; the final test result is that of this second stage.

Pool size

Here we address the question: How many people should be pooled together?

We consider a ‘double-averaging’ model (see Methods), where the prevalence is estimated by a minimal and maximal value. Then, the results are only weakly dependent on the precise values, for reasonable values. Taking the prevalence to be between 0 and 30%, we have the result that a pool size of four is optimal; see Figure 1 for other ranges. Pool sizes of three and five give results which are close to optimal, see Figure 2 for a comparison.

Fig. 1. Optimal pool size (double-averging model), for different prevalence ranges.

Fig. 2. Test ratio (number of tests with pooling divided by number of tests without pooling), for prevalence range between 0 and p max. The coloured area indicates improvement with respect to individual testing.

Therefore, we recommend a pool size of four. Pool sizes of three or five can be used as well, if that is more convenient for practical reasons.

Testing errors

Non-ideal tests produce erroneous results, which can be described by a false-negative rate and a false-positive rate, or equivalently, by giving the test sensitivity and specificity.

Two sources of errors arise in pooled tests. First, each test that is performed is inherently non-ideal and may give an error. These ‘single-test’ errors are described by single-test sensitivity and specificity. Second, an error may arise if several probes are mixed together, due to dilution of the material from each individual. Such ‘dilution errors’ are plausible for large pool sizes. We advocate small pool sizes (up to five), and at such small pool sizes no dilution errors have been found in lab studies [Reference Yelin2, Reference Abdalhamid4, Reference Schmidt11, Reference Hogan, Sahoo and Pinsky14, Reference Lohse16]. Thus, for our analysis we assume no dilution errors.

The two-stage testing protocol leads to a modification of the overall error rates. For the pooled sensitivity, one obtains that the sensitivity of the pooled test is equal to the square of sensitivity of a single test. This means that the pooled sensitivity is reduced, and the number of false negatives increased. The specificity of the pooled test, on the other hand, is increased compared with the single test. (See Methods for details.) This means that the number of false positives is reduced. The reason for this increase of specificity is, that probes tested positive in the first stage are tested again in the second stage, thus reducing false positives. Figure 3 shows, as an example, the improvement of the false-positive rate compared to single tests.

Fig. 3. False-positive ratio for pooled tests, for prevalence range between 0 and p max. The coloured area indicates improvement with respect to individual testing. Here the individual test s = 90% and specificity z = 99%. Pool size is 4.

Methods

When tests from M people are pooled, the pool infection rate p′ (i.e. the probability that a pool is infected) equals p′ = 1 − (1 − p)M, where p is the prevalence in the statistical population.

The number of tests performed during the two-stage pooling protocol (described above) will be denoted by T. Its expectation value for a statistical population of N individuals with prevalence p is E[T] = N/M + N − N(1 − p)M, while the variance is Var[T] = NM((1 − p)M − (1 − p)2M). It is convenient to present the results in terms of the test ratio t = T/N, which is the ratio of the number of tests performed with pooling to the number of tests without pooling. Smaller ratios indicate better performance of pooling. A plot of the test ratio as a function of the prevalence, with error bars due to the variance, is shown in Figure 4.

Fig. 4. Expected test ratio with pooling (black curve) as function of prevalence, for pool size M = 4. The coloured areas indicate the standard error (1σ), for different number of samples N = 20, 40, 100, 500.

The optimal pool size has been studied before and the answer that has been given, e.g. [Reference Dorfman1, Reference Abdalhamid4], is strongly dependent on the prevalence. This, however, is of limited usefulness because (i) the prevalence is unknown and (ii) it is unknown which statistical population is being sampled. Instead we propose to consider the prevalence itself to be a random variable, drawn from a uniform distribution. This amounts to sampling first from a population, and then sampling from a population of populations. Such a model may be not too far from reality. Consider, for example, one day a lab testing for Covid-19 all people from one workplace, another day testing travellers returning from a town and so on. The choice of a uniform distribution for the prevalence suggests itself because nothing is known; such assumptions are known as the principle of indifference.

We average the expectation value of the test ratio t = 1/M + 1 − (1 − p)M with respect to p, when p is uniformly distributed between p 1 and p 2. The resulting test ratio is 〈t〉 = 1/M + 1 + [(1 − p 2)M+1 − (1 − p 1)M+1]/[(p 2 − p 1)(M + 1)]. The results in Figures 1 and 2 are calculated from this expression.

The test errors can be calculated based on standard formulas for binary classification tests. We assume no dilution errors (see above for explanation). This means, for example, that the probability of obtaining a positive test result for one infected person is the same as for a pool of M people where at least one person is infected, even though the pool may contain a different amount of viral material.

Consider single-test sensitivity s and specificity z. The sensitivity and specificity of the pooled test is denoted by s′, z′ respectively. Following the two-stage protocol (as described above), one obtains: s′ = s 2. For the specificity, one has the expression

$${z}^{\prime} = z + \lpar {1-p} \rpar ^{M-1}z\lpar {1-z} \rpar + \lpar {1-{\lpar {1-p} \rpar }^{M-1}} \rpar \lpar {1-s} \rpar \lpar {1-z} \rpar .$$

here M ≥ 2 is the pool size and p is the prevalence. The specificity of the pooled test is increased compared to the single-test specificity, as the right-hand side of the expression is always positive.

According to the double-average model, the expression for z′ can be averaged over a uniform distribution of prevalences. This gives

$$\eqalign{\langle {z}^{\prime}\rangle = & 1-s + sz \quad \quad \quad \quad \cr & + \lsqb {{\lpar {1-p_2} \rpar }^M-{\lpar {1-p_1} \rpar }^M} \rsqb /\lsqb {\lpar {\,p_2-p_1} \rpar M} \rsqb \lpar {1-z} \rpar \lpar {1-s-z} \rpar .}$$

A plot, for some example values, is shown in Figure 3.

Conclusions

Pooling of tests allows to increase the test capacity for Covid-19 testing. For the classic two-stage protocol, a pool size of four is recommended, based on our model. In the absence of dilution errors, testing errors reduce the sensitivity and increase the specificity compared to a test without pooling.

Acknowledgements

We thank Professor Nils Blüthgen for helpful correspondence.

Financial support

This research received no specific grant from any funding agency, commercial or not-for-profit sectors. We thank Wolfram Research for Covid-19-related access to their software technology.

Conflict of interest

None.

References

Dorfman, R (1943) The detection of defective members of large populations. The Annals of Mathematical Statistics 14, 436–440.CrossRefGoogle Scholar
Yelin, I et al. (2020) Evaluation of COVID-19 RT-qPCR test in multi-sample pools. Clinical Infectious Diseases 5.Google Scholar
Eis-Huebinger, AM et al. (2020) Ad hoc laboratory-based surveillance of SARS-CoV-2 by real-time RT-PCR using minipools of RNA prepared from routine respiratory samples. medRxiv.CrossRefGoogle Scholar
Abdalhamid, B et al. (2020) Assessment of specimen pooling to conserve SARS CoV-2 testing resources. American Journal of Clinical Pathology 153, 715–718.CrossRefGoogle ScholarPubMed
Yuan Yuan, C (2020) Statistical methods for batch screening of input populations by stage and group in COVID-19 nucleic acid testing. medRxiv.CrossRefGoogle Scholar
Farfan, MJ et al. (2020) Optimizing RT-PCR detection of SARS-CoV-2 for developing countries using pool testing. medRxiv.CrossRefGoogle Scholar
Ben-Ami, R et al. (2020) Large-scale implementation of pooled RNA extraction and RT-PCR for SARS-CoV-2 detection. Clinical Microbiology and Infection.CrossRefGoogle ScholarPubMed
Torres, I, Albert, E and Navarro, D (2020) Pooling of nasopharyngeal swab specimens for SARS-CoV-2 detection by RT-PCR. Journal of Medical Virology.CrossRefGoogle ScholarPubMed
Gupta, E et al. (2020) Pooled RNA sample reverse transcriptase real time PCR assay for SARS CoV-2 infection: a reliable, faster and economical method. medRxiv.CrossRefGoogle Scholar
Ghosh, S et al. (2020) Tapestry: A Single-Round Smart Pooling Technique for COVID-19 Testing. medRxiv.CrossRefGoogle Scholar
Schmidt, M et al. (2020) FACT- Frankfurt adjusted COVID-19 testing- a novel method enables high-throughput SARS-CoV-2 screening without loss of sensitivity. medRxiv.CrossRefGoogle Scholar
Cleary, B et al. (2020) Efficient prevalence estimation and infected sample identification with group testing for SARS-CoV-2. medRxiv.CrossRefGoogle Scholar
Becker, MG et al. (2020) Recommendations for sample pooling on the Cepheid GeneXpert® system using the Cepheid Xpert® Xpress SARS-CoV-2 assay. bioRxiv.CrossRefGoogle Scholar
Hogan, CA, Sahoo, MK and Pinsky, BA (2020) Sample pooling as a strategy to detect community transmission of SARS-CoV-2. JAMA 04.Google Scholar
Gan, Y et al. (2020) Sample Pooling as a Strategy of SARS-COV-2 Nucleic Acid Screening Increases the False-negative Rate. medRxiv.CrossRefGoogle Scholar
Lohse, S, et al. (2020) Pooling of samples for testing for SARS-CoV-2 in asymptomatic people. The Lancet Infectious Diseases.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. Optimal pool size (double-averging model), for different prevalence ranges.

Figure 1

Fig. 2. Test ratio (number of tests with pooling divided by number of tests without pooling), for prevalence range between 0 and pmax. The coloured area indicates improvement with respect to individual testing.

Figure 2

Fig. 3. False-positive ratio for pooled tests, for prevalence range between 0 and pmax. The coloured area indicates improvement with respect to individual testing. Here the individual test s = 90% and specificity z = 99%. Pool size is 4.

Figure 3

Fig. 4. Expected test ratio with pooling (black curve) as function of prevalence, for pool size M = 4. The coloured areas indicate the standard error (1σ), for different number of samples N = 20, 40, 100, 500.