Current Trends Update: Serologic Testing for Antibody to Human Immunodeficiency Virus
Tests to detect antibody to human immunodeficiency virus (HIV), the virus that causes acquired immunodeficiency syndrome (AIDS), were first licensed by the Food and Drug Administration (FDA) in 1985, primarily as screening tests for blood and plasma donation. Since that time, millions of HIV antibody tests have been performed in laboratories of blood and plasma collection centers, in counseling and testing centers, and in clinical facilities as well as for purposes such as screening active duty military personnel and applicants for military service. Assuring accurate test results requires continued attention to both the intrinsic quality of the tests and the performance of the technical personnel doing the tests.
Given the medical and social significance of a positive test for HIV antibody, test results must be accurate, and interpretations of the results must be correct. For these reasons, the Public Health Service has emphasized that an an individual be consideredto have serologic evidence of HIV infection only after an enzyme immunoassay (EIA) screening test is repeatedly reactive* and another test such as Western blot (WB) or immunofluorescence assay has been performed to validate the results (1).**
Licensed test kits currently available in the United States for HIV antibody testing comprise seven EIAs and one WB. All of these tests use HIV antigens derived from disruption of whole virus cultured in human-derived cell lines. In addition, many laboratories produce their own WB test reagents using viral antigen purchased from commercial sources. A variety of other test procedures are in use or under development or are being evaluated for licensure.
Criteria for interpretation of a reactive anti-HIV EIA test are based on data from clinical studies performed under the auspices of each manufacturer. Since licensure of the first EIA test kits in 1985, the manufacturers have worked to improve the sensitivity, specificity, and reproducibility of their assays.*** Clinical data submitted by the manufacturers to FDA for licensure indicate that the sensitivity and specificity of the EIA tests currently marketed in the United States are greater than 99.0%. Other laboratories performing comparative analyses of licensed anti-HIV EIA test kits have found similar or slightly lower sensitivity and specificity (2-5). In routine use, both the sensitivity and specificity of the tests depend on the quality of testing in the laboratory. In addition, false-positive test results are observed when nonspecific serologic reactions occur among uninfected persons who have immunologic disturbances or who have had analyses of licensed anti-HIV EIA test kits have found similar or slightly lower sensitivity and specificity (2-5). In routine use, both the sensitivity and specificity of the tests depend on the quality of testing in the laboratory. In addition, false-positive test results are observed when nonspecific serologic reactions occur among uninfected persons who have immunologic disturbances or who have had multiple transfusions. False-negative test results are observed among persons who have recently become infected with HIV and who have not yet developed detectable antibody (6).
Repeating each initially reactive EIA test increases the specificity of the test sequence by reducing the possibility that technical laboratory error caused the reactive result. In the American Red Cross Blood Services laboratories, a specificity of approximately 99.8% has been consistently achieved during screening of donated blood (7, unpublished data). However, in a population with a low prevalence of infection, even a specificity of 99.8% does not provide the desired predictive value**** for a positive test. For this reason, it is particularly important not to rely solely on EIA testing to determine whether a person is infected with HIV. Rather, EIA test results should be validated with an independent supplemental test of high specificity conducted by a laboratory with high performance standards. In the United States, the validation test used most often is the WB. Some laboratories also use radioimmunoprecipitation assays and indirect immunofluorescence assays.
For the licensed WB test, interpretation of reactive and nonreactive tests is based on data from clinical studies submitted to FDA for licensure. The manufacturer states that, for a test to be considered positive with this WB, antibody must be reactive with multiple virus-specific protein bands, i.e., p24, p31, and either gp41 or gp160 (Table 1). If fewer bands are present, the test is considered indeterminate; it is interpreted as negative only if no bands are present on the blot. When the manufacturer's stringent criteria are used for interpreting test results, the probability of either a false-positive or a false-negative result is extremely small. In clinical trials for licensure of this WB, however, as many as 15% to 20% of tests on persons at low risk for HIV infection were described as indeterminate. Sera from persons recently infected with HIV also may produce an indeterminate WB pattern. For such persons, a repeat WB on a second specimen obtained after the initial specimen often yields a positive blot pattern within 6 months. Conversely, follow-up testing of uninfected persons whose serum had an indeterminate blot pattern on initial testing usually will show no change in the banding pattern. Serum from some HIV-infected persons who have advanced immunodeficiency may have an indeterminate pattern because of a loss of antibodies to non-env proteins (8). To reinstate donors with a history of a positive EIA test, blood and plasma centers may use only results from the licensed WB test performed in the FDA-approved test sequence.
The performance characteristics of the unlicensed tests used by many laboratories, whether WB, immunofluorescence assays, or other procedures, have not been uniformly subjected to the same rigorous scrutiny required for licensure by FDA. Recommendations for standardization have been published (9), but the extent to which these are followed is unknown. Information about production standards, inter-lot variability, or validation of criteria used for interpretation often is not available. Absence of standardization and appropriate quality controls may result in a lower sensitivity or specificity and, thus, a higher probability of inaccurate results (10).
Despite the existence of a licensed WB test, many laboratories continue to use unlicensed WB tests because of cost and the stringent criteria required for interpreting the licensed test. The potential problems in using and interpreting unlicensed WB tests have been openly debated (11,12). Although unlicensed WB tests can be highly accurate and reproducible when done with appropriate quality controls in laboratories with established performance standards (9), not all laboratories meet acceptable performance standards. Ten of 19 laboratories bidding for contracts to perform WB tests for the Department of Defense failed the required proficiency panel on one or more occasions (13). Two of the laboratories satisfying the performance standards were awarded contracts by the U.S. Army. Both of these laboratories use well- validated techniques for WB that yield virus-specific bands at p17, p24, p31, gp41, p53, p55, and p64. The U.S. Army considers these WBs to be positive if bands are present either at gp41 or at both p24 and p55 (14). In comparison with multiple validation procedures, WBs in these contract laboratories have an estimated specificity of 99.4%, and the laboratories have consistently performed accurately on all pre- and post-award quality assurance serum panels (14). These and other laboratories have demonstrated that the achievable false-positive rate of sequentially performed EIA and WB tests can be less than 0.001% (less than 1/100,000 persons tested) (13,15).
The College of American Pathologists (CAP), in conjunction with the American Association of Blood Banks, conducts an open proficiency testing program***** for laboratories performing HIV antibody tests. Each quarter, more than 600 laboratories that participate voluntarily report results from testing five coded samples of plasma that have various known levels of anti-HIV reactivity or that are nonreactive.
In the CAP survey conducted in October 1987, the results of EIA tests at the participating laboratories correlated well with results from the referee laboratories (Table 2). For the three reactive samples (W-21, W-23, W-24), correlation ranged from 99.5% to 100%. For the single nonreactive sample that could be adequately evaluated (W-25), correlation was 98.3%. The nonreactive W-22 sample that was sent with the October 1987 serum panel had been prepared with a pool of processed plasma that caused an unexplained, nonspecific reaction with one of the EIA test kits. Consequently,the EIA results for this sample could not be evaluated.
The individual participating laboratories used their own criteria for interpreting WB results. WB results for two of the three reactive specimens were reported as indeterminate by one referee laboratory each, while results for the two nonreactive specimens in the CAP survey were reported correctly by all 10 referee laboratories (Table 3). One of the 73 participating laboratories reported a nonreactive sample (W-22, the sample that gave artifactual reactions with one of the EIA test kits) as reactive, while approximately 5% reported the two nonreactive samples as indeterminate, and 12% to 15% reported two of three reactive specimens as indeterminate.
For the three reactive samples, the results of 241 repeatedly reactive EIA tests could be compared with WB results (Table 4). For 215 (89.2%) of these, the WB tests were reported as positive; for 23 (9.5%), the WBs were reported as indeterminate;and, for 3 (1.2%), they were reported as negative. Of 58 WB results performed on nonreactive samples found nonreactive by EIA, 55 (94.8%) were reported as negative by WB, and 3 (5.2%) were reported as indeterminate. None of the nonreactive samples were read as positive by WB.
Because criteria used to interpret WB varied by laboratory, banding patterns reported in the 299 WB tests conducted in the October 1987 survey were examined (Table 5). Two or more virus-specific protein bands were reported in 215 blots, 208 (96.7%) of which were interpreted as positive. Eighteen (60.0%) of 30 blots with only a single virus-specific protein band were considered positive. When the single protein band was from the env gene, 12 (85.7%) of 14 were read as positive. These data demonstrate that different laboratories may report different WB results for sampleswith the same banding patterns.
Results of CAP proficiency tests from more than 500 laboratories participating in the 1986 and 1987 surveys indicate the following performance for the anti-HIV EIA test. Of 6,946 tests on reactive samples, 99.5% were reported as positive. Of 1,142 tests on nonreactive samples, 98.3% were interpreted as negative. Based on results from 601 laboratories on a pair of identical reactive samples (W-23 and W-24), reproducibility was 99.5%.
For the WB test, calculations were based only on positive or negative results divided by the total number of tests in the October 1987 CAP survey (Table 4). For the reactive samples, 89.2% of 241 results were correctly interpreted as positive, and, for the nonreactive samples, 94.8% of 58 results were correctly interpreted as negative. Reproducibility, which was based on 83 tests on a pair of identical reactive samples (W-23 and W-24), was 95.2%. The performance of the referee laboratories was more accurate for the EIA and much more accurate for the WB than was the performance of the participating laboratories. The performance of the licensed and unlicensed WB tests could not be compared because the data were not collected. Reported by: HF Polesky, MD, College of American Pathologists. Div of Blood and Blood Products, Center for Biologics Evaluation and Research, Food and Drug Administration. Div of Assessment and Management Consultation, Training and Laboratory Program Office; AIDS Program, Center for Infectious Diseases, CDC.
Editorial Note: Quality laboratory testing for HIV antibody is a critically important element for surveillance and detection of HIV infection. The laboratory testing process requires quality assurance for each step including: 1) collection, labeling, and transport of specimens; 2) laboratory reagents and procedures; 3) interpretation of analytical results; and 4) communication from the laboratory scientist to the clinician and then to the person being tested. Quality performance is promoted by using licensed or standardized tests in proper sequence and by developing consensus about interpretation of analytical results.
Proficiency testing benefits participating laboratories by identifying problems with particular types of samples, with particular tests, or with interpretation of results. However, results of proficiency testing programs should be interpreted cautiously. Data from proficiency testing measure only the operational performance of participating laboratories but cannot be used to measure the sensitivity or specificity of a given test. Samples provided for testing in the HIV antibody surveys may be pooled human plasma samples with known levels of anti-HIV reactivity, or they may be dilutions of a single reactive plasma sample in HIV-negative serum. They are rarely fresh serum specimens from a person who is or is not infected with HIV. Some samples are selected because they exhibit nonspecific reactivity or are otherwise difficult to test and interpret; they are not typical of the vast majority of specimens that will be handled by the participating laboratories. For instance, in normal practice, samples W-22 and W-25 would not be tested by WB because the EIA was nonreactive. The nonspecific reactivity of the type that occurred with specimen W-22 cannot always be predicted; a similar unexplained nonspecific reaction occurred in a proficiency testing program conducted by CDC (16) and with several samples used by the American Association of Bioanalysts (unpublished data).
The number of specimens commonly used in proficiency testing programs (five in each CAP survey) sent to each laboratory also limits the application of survey results. This number of specimens is not sufficient to measure adequately the performance of any single laboratory. The number of specimens tested per month in different laboratories varies enormously, and no attempt is made in the survey to select a representative sample of laboratories performing the test; those that choose to participate in the survey do so voluntarily.
Laboratories in the surveys reported indeterminate WB results on some reactive and nonreactive samples. An indeterminate result is not a final result; it requires additional laboratory testing on the same specimen and often entails asking the person from whom the specimen was obtained to provide one or more additional specimens. The final interpretation of an indeterminate result frequently will also require additional epidemiologic, clinical, or corroborating laboratory information.
Even among the diverse laboratories participating in the CAP survey, none performing the EIA and WB tests in sequence would have reported false-positive test results. However, performance and interpretation of WB tests vary among laboratories. The Public Health Service is convening a meeting to address these issues. A nationwide performance evaluation program for HIV antibody testing has been started by CDC's Training and Laboratory Program Office and Center for Infectious Diseases (17). The first sample shipment, consisting of reference materials, was mailed in November 1987 to more than 700 participating U.S. laboratories.
The predictive values of both positive and negative test results for HIV antibody are extremely high in laboratories that have good quality control and high performance standards and that use licensed EIA tests and the licensed WB or other well- standardized tests. Physicians or other health-care providers who request HIV antibody tests and who counsel persons about test results must have a clear understanding of the significance of the test results and the potential pitfalls of the testing process. When test results are indeterminate or inconsistent with other information, additional information should be obtained to try to confirm whether the person is infected with HIV. The counseling procedure should include a careful assessment of the person's potential risks or exposures to HIV. As for all medical tests, results should be interpreted in concert with all the historic, epidemiologic, clinical, and other pertinent laboratory information available.
*The terms "reactive" or "nonreactive" are used to describe serum or plasma specimens that give reactive or nonreactive test results and to describe the test results from EIA or WB tests before final interpretation. The terms "positive" and "negative" are used to describe the interpretation of EIA test results indicating that the specimen tested is 1) repeatedly reactive (positive) or 2) nonreactive or not repeatedly reactive (negative). The terms "positive," "indeterminate," and "negative" are used to describe the interpretation of WB test results that indicate that the specimen tested is reactive with a specific pattern of bands (positive), reactive with a nonspecific pattern of bands (indeterminate), or nonreactive (negative).
**Blood and plasma are not accepted for transfusion or further manufacture when the EIA screening test is positive, regardless of the results of other tests that may be performed.
***Sensitivity is the probability that the test result will be reactive if the specimen is a true positive; specificity is the probability that the test result will be nonreactive if the specimen is a true negative; and reproducibility (reliability) is the ability to replicate qualitative results with the same or similar test procedures on blindly paired samples.
****The predictive value of a positive or negative test is the probability that the test result is correct.
*****The laboratories know that the samples have been supplied for proficiency testing.
Disclaimer All MMWR HTML documents published before January 1993 are electronic conversions from ASCII text into HTML. This conversion may have resulted in character translation or format errors in the HTML version. Users should not rely on this HTML document, but are referred to the original MMWR paper copy for the official text, figures, and tables. An original paper copy of this issue can be obtained from the Superintendent of Documents, U.S. Government Printing Office (GPO), Washington, DC 20402-9371; telephone: (202) 512-1800. Contact GPO for current prices.**Questions or messages regarding errors in formatting should be addressed to email@example.com.
Page converted: 08/05/98
This page last reviewed 5/2/01