The following post was written to update a previous Short from 2020. Please see the past Short on this topic here.
There are multiple severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) emergency use authorization (EUA) tests among clinical laboratories and a large amount of cross-assay variation between different assays. Moreover, these assays were rapidly developed, minimally standardized and there is no well recognized external quality assessment program (EQA). As a result, good estimates of the diagnostic sensitivity and specificity are not available. There has been more focus on the diagnostic sensitivity and it is known that sensitivity is poor if the test is performed too early and that the viral RNA may be detectable for a period of time after active infection although the virus is no longer viable. Therefore, the CDC does not recommend PCR retesting after recovery, but CDC suggests symptomless persons who are immunologically normal are no longer infectious about 10 days after symptom onset, although very recently, in more complicated guidelines, CDC has shortened the recommended time for isolation and quarantine to 5 days, with an additional 5 days of mask wearing in most cases and less sensitive protein antigen testing in some cases (1).
There is less information about diagnostic specificity (false positives). Among others, false positives will depend on the length of the DNA probes, how many and which genes are measured and technical errors. The DNA probes used in the CDC rRT-PCR test kits for SARS-CoV-2 assay are only about 25 bases long which does not meet the FDA recommendation for nucleic acid-based molecular diagnostics for viral disease infections where 100 contiguous bases is desirable (2). Various methods use different genes and different probes that may not be equivalent. There is a 100-fold difference in limit of detection (LoD) between some assays (3). Technical error, especially due to DNA contamination, may cause false positives. Seventy-seven professional baseball major league players initially tested positive in one lab but negative elsewhere (4) in what was deemed Lab error. Except that they had multiple sources for testing, they might have been classified as asymptomatic. Many other persons may have been classified in error from this incident. Moreover, false positive PCR results have been reported in the literature. For example a patient who presented with history of fever with dry cough, and body pain who had been in contact with a COVID-19 patient and tested positive for SARS-CoV-2 by PCR was found to be negative for SARS-CoV-2 IgG antibody with repeated testing (5). It is possible that this patient was infected with influenza. Thus, CDC now encourages laboratories to consider adoption of a multiplexed method that can facilitate detection and differentiation of SARS-CoV-2 and influenza viruses (6).
Originally, PCR was followed by a second step where a separation technique was used to confirm that the amplified substance was correct. rRT-PCR is usually not followed by a second step. RRT-PCR is usually applied for diagnostic purposes, not for screening. For acute viral infections, after symptoms appear, a rRT-PCR test battery may be performed. In diagnostic testing, symptoms or high-risk behavior cause an increase in prevalence because those with certain symptoms are classified into characterized groups and false positives are few.
Diagnostic applications are usually applied for chronic viral infections such as HCV, HIV and chronic HBV where symptoms or high-risk behavior initiates testing. In all these chronic diseases antibody concentrations are high and serology usually precedes rRT-PCR, so that false positives are rare. COVID-19 testing is primarily without confirmation.
For SARS-CoV-2 rRT-PCR, cycle threshold (Ct) of 24 or less has been shown to be highly predictable for identifying active COVID-19 cases (7), but since LoD of various methods drastically differ it is unclear which methods this applies to. Generally, methods do not amplify more than 40 cycles, but some systems go beyond 40 Ct. It seems likely that short probes in such systems could lead to amplification errors. There is one report (8), of EQA in clinical laboratories for other RNA virus. The authors compiled 43 EQAs of rRT-PCR assays, conducted between 2004-2019. Three hundred and thirty-six of 10,538 negative samples (3.2%) were reported as positive. The authors defined the lowest percentage of the interquartile range which was 0.8% as a conservative estimate of the false positive rate. In another report, Sin Hang Lee found that 3 of 10 positive proficiency samples in the State of Connecticut were negative containing no SARS-CoV-2 RNA by a confirmatory assay (2). The Foundation for Innovative New Diagnostics (FIND) examined 22 rRT-SARS-CoV-2 diagnostic tests (6) and found diagnostic specificities ranging between 100% and 96% for 100 specimens assayed by each test. Although the great majority showed 100% specificity, given the small number assayed, the lower 95% confidence limit which was 95% for almost all assays would seem to be a better estimate (possible 5% error). Moreover, these were tested under controlled conditions, not similar to high output clinical laboratories running thousands of tests.
The Reverend Thomas Bayes (1701-1761) recognized a kind of statistic that predicts the posterior probability from the prior probability. For testing, the posttest probability can be derived from the pretest probability if the prevalence is known. This sounds complicated but actually, Bayesian statistics are simple compared to classical frequentist statistics since one does not have to apply a null hypothesis, nor interpret p-values or effect-size and the results are obtained from simple mathematics. If, as discussed above (8), a 0.8% false positive rate is correct, at a six percent positive rate, then there would be: 100 x 0.06 = 6 positives/100 tests. But if 0.8% are false positives, then only 5.2% are true positives with a positive predictive value (True positives/total positives x 100) of 5.2/6 x 100 = 86.6%. This means about 13.4% are false positive. Notice as the prevalence of disease decreases, the percentage of false positives to total positives increases because the true positive percentage decreases but the percent false positive (in this case 0.8%) stays about the same. Thus, the percentage of false positives would be about 26.6% at a three percent positive rate.
The source of the problem is recognized from Bayesian analysis. If the prevalence is low (say a prevalence of 1%) even a very good screening test with 99% diagnostic specificity and 100% sensitivity will produce only 1% false positive results: (diagnostic specificity 1%) = 0.01 x 10,000 tests = 100 false positives/10,000 tests and (0.01% prevalence of disease at 100% sensitivity) = 0.01 x 10,000 = 100 true positive but for a poor positive predictive value of only 50% (100/200 x 100 = 50%). Recognizing this problem, the CDC suggests most testing should be diagnostic: “Considerations for who should get tested: People who have symptoms of COVID-19, people who have had close contact with someone with confirmed COVID-19, people who have been asked or referred to get testing by their healthcare provider, or state health department. Not everyone needs to be tested (7).”
Because of rightful concern, this advice is not being followed. As a result, much testing is screening not diagnostic. One way to reduce false positive results is to repeat the test using a test with a different format (different manufacturer). Due to limited testing facilities confirmation is rarely performed. I conclude it is likely that at current active disease prevalence the positive rRT-PCR results of many “asymptomatic” persons are false positives.
There are negative psychological implications of thinking one is infected when one is not and some persons with illness other than COVID-19 who test false positive might be hospitalized with COVID-19 patients and become infected. This may explain why some persons seem to have been infected twice: the first time being a false positive. It seems to me it is important for practicing medical professionals to be aware of these issues so that they can appropriately advise and direct suspect patients for additional testing.
Another area of interest is the question of persons who are nasally infected but who may not be systemically infected. The nasal immune system contains both IgG and IgA but the glandular olfactory mucosa contains mainly dimeric IgA similar to the digestive tract while the stroma contains mainly IgG. SARS-CoV-2 first infects the upper respiratory tract and mucosal immune responses are expected to be induced in the nasopharynx and the nasopharynx-associated lymphoid tissue (9). The Oxford University paper showed that SARS-CoV-2 viral RNA was detected in nose swabs from all rhesus macaques whether or not vaccinated, and no difference was found on any day between vaccinated and control (unvaccinated) animals (10), although the vaccinated animals showed no pneumonia in the lower respiratory tract while the control animals exhibited disease. These data suggest that vaccinated persons who are exposed may carry live virus for several days but not have systemic disease. Whether such persons would be infectious to others or are only carriers seems unclear. Clearly such persons may test positive for SARS-CoV-2 by nasopharynx testing but appear largely asymptomatic or with cold symptoms – sometimes severe. This may help explain many breakthrough infections. It is likely the more vaccine doses one gets; the more nasal immunity will be elicited. Four vaccination shots are recommended for polio, another virus that infects mucosal tissue, and it is nonexistent in the advanced world. It may ultimately be necessary to develop a nasal vaccine to completely eradicate this highly infectious respiratory virus.
- CDC. CDC Updates and Shortens Recommended Isolation and Quarantine Period for General Population. https://www.cdc.gov/media/releases/2021/s1227-isolation-quarantine-guidance.html. Published 2021. Accessed 12/27/2021.
- Lee, S. H. (2020) Testing for SARS-CoV-2 in cellular components by routine nested RT-PCR followed by DNA sequencing International Journal of Geriatrics and Rehabilitation 2, 69-96
- FDA. (2020) SARS-CoV-2 Reference Panel Comparative Data
- Maske, M. h. w. w. c. p. m.-m. (2020) NFL’s 77 positive virus tests were ‘likely false positive results,’ company says.
- Roy, S. (2021) Physicians' Dilemma of False-Positive RT-PCR for COVID-19: a Case Report. SN Compr Clin Med, 1-4
- CDC. 07/21/2021: Lab Alert: Changes to CDC RT-PCR for SARS-CoV-2 Testing. https://www.cdc.gov/csels/dls/locs/2021/07-21-2021-lab-alert-Changes_CDC_RT-PCR_SARS-CoV-2_Testing_1.html. Published 2021. Accessed 12/27/2021.
- Bullard, J., Dust, K., Funk, D., Strong, J. E., Alexander, D., Garnett, L., Boodman, C., Bello, A., Hedley, A., Schiffman, Z., Doan, K., Bastien, N., Li, Y., Van Caeseele, P. G., and Poliquin, G. (2020) Predicting infectious SARS-CoV-2 from diagnostic samples. Clin Infect Dis
- Cohen, A. N., Kessel, B. (2020) False positives in reverse transcription PCR testing for SARS-CoV-2.
- Russell, M. W., Moldoveanu, Z., Ogra, P. L., and Mestecky, J. (2020) Mucosal Immunity in COVID-19: A Neglected but Critical Aspect of SARS-CoV-2 Infection. Front Immunol 11, 611337
- Ivan Doremalen, N., Lambe, T., Spencer, A., Belij-Rammerstorfer, S., Purushotham, J. N., Port, J. R., Avanzato, V. A., Bushmaker, T., Flaxman, A., Ulaszewska, M., Feldmann, F., Allen, E. R., Sharpe, H., Schulz, J., Holbrook, M., Okumura, A., Meade-White, K., Perez-Perez, L., Edwards, N. J., Wright, D., Bissett, C., Gilbride, C., Williamson, B. N., Rosenke, R., Long, D., Ishwarbhai, A., Kailath, R., Rose, L., Morris, S., Powers, C., Lovaglio, J., Hanley, P. W., Scott, D., Saturday, G., de Wit, E., Gilbert, S. C., and Munster, V. J. (2020) ChAdOx1 nCoV-19 vaccine prevents SARS-CoV-2 pneumonia in rhesus macaques. Nature 586, 578-582