Notes from the Field: Evaluation of the Sensitivity and Specificity of a Commercially Available Rapid Syphilis Test — Escambia County, Florida, 2016
Weekly / October 28, 2016 / 65(42);1174–1175
James Matthias1,2; Patty Dwiggins3; Yolanda Totten4; Carina Blackmore2; Craig Wilson2; Thomas A. Peterman1 (View author affiliations)View suggested citation
In December 2014, the Food and Drug Administration granted the first-ever Clinical Laboratory Improvement Amendments waiver for a rapid treponemal syphilis screening test, Syphilis Health Check (SHC) (1). SHC is a new tool for public health programs to combat increasing syphilis rates, specifically among persons without a prior syphilis infection. SHC can be performed by nonlaboratorian health care personnel and results are available in 10 minutes. In 2015, a total of 7,094 noncongenital cases of syphilis (35.8 case per 100,000) were reported to the Florida Department of Health (2). The Florida Department of Health evaluated the performance of SHC in comparison with treponemal and nontreponemal tests routinely used in its sexually transmitted disease (STD) clinic in Escambia County.
For this evaluation, patients seeking STD testing at the Florida Department of Health STD clinic in Escambia County during March 11–April 21, 2016, were tested for syphilis using the SHC on blood specimens obtained by fingerstick; a venous blood specimen was drawn concurrently and submitted for treponemal (Trep-Sure), and nontreponemal (Arlington Scientific, Inc. [ASI] rapid plasma reagin [RPR] card test for syphilis) testing at the state public health laboratory. The state public health laboratory in Florida uses the CDC-recommended algorithm for syphilis testing (i.e., nontreponemal testing followed by treponemal testing for persons with a reactive nontreponemal test); however, for the purpose of this study, all collected specimens underwent treponemal testing regardless of the nontreponemal test result. The SHC result was compared with results of routine syphilis testing using the traditional testing algorithm at the state laboratory. Sensitivity, specificity, and overall laboratory test agreement were determined using the Trep-Sure qualitative enzyme immunoassay (EIA) reference treponemal test as the standard for “true” positive or negative treponemal test results.
The SHC was used to screen 202 patients for syphilis. Among these patients, 171 (85%) were nonreactive on all syphilis tests (SHC, EIA, and RPR), 26 (13%) had a reactive SHC, and five (2%) had a nonreactive SHC but had one or more reactive tests at the state laboratory. Among the 26 reactive SHCs, 10 (38%) had a reactive EIA (six had a reactive RPR), and 16 (62%) were not confirmed by EIA or RPR at the state laboratory. For the six reactive SHC patients with reactive EIA and reactive RPR, three were staged as secondary syphilis, one as primary syphilis, one as early latent syphilis, and one was a previously treated positive with no increase in titer since last testing. Among the five specimens that were reactive on other tests but SHC nonreactive, only one was both RPR (1:8 serum dilution) and EIA reactive. It came from a patient with primary syphilis and a history of herpes simplex virus 2, and a reactive RPR (1:2 serum dilution) that was collected 6 days before the SHC test.
The sensitivity of SHC was 71.4% (95% confidence interval [CI] = 41.9%–95.1%) when compared with the Trep-Sure (EIA) reference treponemal test (Table). The specificity of the SHC compared with the reference treponemal test was 91.5% (95% CI = 87.5%–95.5%).
The findings in this study are subject to at least one limitation. The sample size was 202; however, results indicate a high proportion of reactive SHC tests were not confirmed by reference treponemal testing (16 of 26, 61.5%). This relatively low positive predictive value suggests that reactive SHC results should be interpreted with caution. Furthermore, four of 14 specimens that tested positive on the reference treponemal test tested negative on the SHC, including one from a patient with primary syphilis. Sensitivity and specificity analyses of the SHC using fingerstick specimens at the Florida Department of Health in Escambia County’s STD clinic were significantly lower than the >98% reported by the manufacturer of SHC in a 510(k) submission (3). Further evaluation of the sensitivity and specificity of the SHC in additional health care settings is needed to determine whether SHC might be beneficial in identifying patients who might have syphilis, especially in settings where phlebotomy is unavailable.
Corresponding Author: James Matthias, email@example.com, 850-245-4308.
1Division of STD Prevention, National Center for HIV/AIDS, Viral Hepatitis, STD, and TB Prevention, CDC; 2Florida Department of Health; 3Florida Department of Health in Escambia County; 4Florida Department of Health, Bureau of Public Health Laboratories.
- Food and Drug Administration. FDA grants CLIA waiver expanding the availability of rapid screening test for syphilis. FDA News Release. December 15, 2014. Washington, DC: US Department of Health and Human Services, Food and Drug Administration; 2014. http://www.fda.gov/NewsEvents/Newsroom/PressAnnouncements/ucm426843.htmexternal icon
- CDC. Sexually transmitted disease surveillance 2015. Atlanta, GA: U.S. Department of Health and Human Services, CDC; 2016. http://www.cdc.gov/std/default.htm
- Diagnostics Direct. Syphilis Health Check Test. 510(k) summary. August 1, 2011 Stone Harbor, NJ: Diagnostics Direct; 2011. http://www.accessdata.fda.gov/cdrh_docs/pdf10/k102400.pdfpdf iconexternal icon
TABLE. Comparative results of Syphilis Health Check testing of specimens (N = 202) at the Florida Department of Health in Escambia County STD clinic and Trep-Sure reference treponemal testing at the state health department laboratory — Florida, 2016
|Syphilis Health Check result||Trep-Sure (EIA) result|
|Testing agreement% (95% CI)|
|Overall agreement||90.1 (86.0–94.2)|
Suggested citation for this article: Matthias J, Dwiggins P, Totten Y, Blackmore C, Wilson C, Peterman TA. Notes from the Field. Evaluation of the Sensitivity and Specificity of a Commercially Available Rapid Syphilis Test — Escambia County, Florida, 2016. MMWR Morb Mortal Wkly Rep 2016;65:1174–1175. DOI: http://dx.doi.org/10.15585/mmwr.mm6542a5external icon.
MMWR and Morbidity and Mortality Weekly Report are service marks of the U.S. Department of Health and Human Services.
Use of trade names and commercial sources is for identification only and does not imply endorsement by the U.S. Department of Health and Human Services.
References to non-CDC sites on the Internet are provided as a service to MMWR readers and do not constitute or imply endorsement of these organizations or their programs by CDC or the U.S. Department of Health and Human Services. CDC is not responsible for the content of pages found at these sites. URL addresses listed in MMWR were current as of the date of publication.
All HTML versions of MMWR articles are generated from final proofs through an automated process. This conversion might result in character translation or format errors in the HTML version. Users are referred to the electronic PDF version (https://www.cdc.gov/mmwr) and/or the original MMWR paper copy for printable versions of official text, figures, and tables.
Questions or messages regarding errors in formatting should be addressed to firstname.lastname@example.org.