The content on this page is being archived for historic and reference purposes only. The content, links, and pdfs are no longer maintained and might be outdated.
Improving Influenza, Pneumococcal Polysaccharide, and
Hepatitis B Vaccination Coverage Among Adults Aged <65 Years at High Risk
A Report on Recommendations of the Task Force on Community
Bayo C. Willis, MPH1
Serigne M. Ndiaye, PhD2
David P. Hopkins, MD3
Abigail Shefer, MD1
1 Immunization Services Division, National Immunization Program
2 Global Aids Program/Office of the Director, National Center for HIV, STD, and TB Prevention
3 Division of Prevention Research and Analytic Methods, Epidemiology Program Office
The material in this report was prepared by the Epidemiology Program Office, Stephen B. Thacker, MD, Director, Division of Prevention and Research and Analytic Methods, Anne Haddix, PhD, Acting Director.
Corresponding preparer: Serigne M. Ndiaye, PhD, National Center for HIV, STD, and TB Prevention, CDC, 1600 Clifton Road NE, MS
E-30, Atlanta, GA, 30333. Telephone: 404-639-8558; Fax: 404-639-6499; e-mail:
The Task Force on Community Preventive Services conducted systematic reviews to evaluate the effectiveness
of interventions to improve targeted vaccination coverage (i.e., coverage with vaccines recommended for some but not
all persons in an age range on the basis of risk for exposure or disease) among adults aged <65 years at high risk
when implemented alone (single-component interventions) and in combination with other interventions
(multicomponent interventions). A 1999 report by the Task Force examined the effectiveness of interventions to increase coverage with universally recommended vaccinations (i.e.,
vaccines recommended for all persons in particular age groups).
Three targeted vaccinations recommended for populations at risk are addressed in this review: influenza,
pneumococcal polysaccharide, and hepatitis B. The Task Force identified evidence that certain combinations of interventions
have improved vaccination coverage. To increase targeted vaccination coverage, the Task Force recommends a combination
of interventions that include selected interventions from two or three categories of interventions (i.e., increasing community demand for vaccinations, enhancing access to vaccination services, and provider- or system-based interventions). The Task Force also recommends provider reminders, when implemented alone, to improve targeted vaccination
coverage. This report provides additional information about population-based interventions to improve the coverage of influenza, pneumococcal polysaccharide, and hepatitis B vaccines among populations at risk, briefly describes how the reviews were conducted, and provides information that can help in applying the interventions locally.
Influenza, pneumococcal infections, and hepatitis B are
vaccine-preventable diseases that cause substantial illness and premature death in the United States
(1--3). Rates of morbidity and mortality are higher among adults with certain medical conditions, occupational exposures, or risk behaviors
(2,4,5). Efforts to reduce the burden of these diseases depend
on increasing vaccination coverage in the population, especially among adults at high risk. This report provides
recommendations from the Task Force on Community Preventive Services (Task Force) for use of population-based interventions to improve the coverage of influenza, pneumococcal polysaccharide, and hepatitis B vaccines among adults aged <65 years at high risk,
with occupational exposure, risky behaviors, or medical conditions (targeted vaccinations). Previously, the Task Force
evaluated the effectiveness of interventions to increase coverage with universally recommended vaccinations (i.e., those recommended for all persons in particular age groups) (6--8).
Influenza causes an estimated 114,000 excess hospitalizations (5) and 36,000 deaths (3) annually in the United States. Morbidity and mortality rates are high among adults aged >65 years and among younger persons who have medical
conditions that place them at risk for complications from the disease (e.g., diabetes or lung or heart disease). Influenza vaccination
is effective in preventing hospitalization and death among persons with high-risk medical conditions
(9). Influenza coverage rates among adults aged <65 years with one or more risk conditions ranged from 20.4% (aged 18--49 years) to 37.7% (aged 50--64 years) in 1995 (10) and remained low (32%) among adults aged 18--64 years in 2002 (National Health Interview
Survey [NHIS], unpublished data, 2002).
In the United States, approximately 3,500 persons aged
<65 years die every year as a result of pneumococcal disease
(2). Pneumococcal infections cause an estimated 3,000 cases of meningitis, 50,000 cases of bacteremia, and 500,000 cases of pneumonia annually (11). Efficacy rates for the 23-valent vaccine in studies of immunocompetent adults ranged from 65% to 75% in the prevention of pneumococcal bacteremia and meningitis
(12,13). Despite the efficacy of the vaccine,
vaccination coverage remains low for adults aged 18--64 years with risk conditions. Coverage rates for pneumococcal
polysaccharide vaccine among adults aged <65 years with one or more risk conditions ranged from 11.8% (aged 18--49 years) to 20.1% (aged 50--64 years) in 1995 (10) and remained low (19.1%) among persons aged 18--64 years in 2002 (NHIS, unpublished
An estimated 1.0--1.3 million persons in the United States are chronically infected with hepatitis B virus (HBV) (14), of whom approximately 5,000 die of HBV-related cirrhosis or liver cancer each year
(15--17). Risk conditions for hepatitis B include occupational exposures and risk behaviors (e.g.,
injection-drug use and multiple sex partners). Although reported
cases of HBV declined 76% during 1987--1998
(18), the annual number of new infections remained substantial with 78,000
cases estimated in 2001 (19). Despite the availability of an effective vaccine, vaccination coverage rates remain low in the majority of targeted populations. In one study, 9% of men who have sex with men (MSM) had both a history and serologic evidence
of hepatitis B vaccination in 1998 (20). Among injection-drug users attending a sexually transmitted disease clinic in San
Diego during 1998--2001, vaccination coverage for hepatitis B was 6%
(21). Among occupationally exposed workers,
vaccination coverage is approximately 75%, and with increasing vaccination coverage, the estimated number of HBV infections
among health-care workers in the United States has decreased from >10,000 in 1983 to approximately 400 in 2002 (22,23).
Targeted vaccination coverage rates for influenza, pneumococcal polysaccharide, and hepatitis B vaccines in adult
populations at high risk remain low and below the Healthy People 2010 objectives
(24). These objectives include increasing both
influenza and pneumococcal vaccination coverage among adults at high risk to 60% and increasing hepatitis B vaccine coverage among high-risk groups, including hemodialysis patients (to 90%), MSM (to 60%), and occupationally exposed workers (to 98%).
The independent, nonfederal Task Force on Community Preventive Services leads work on the
Guide to Community Preventive Services (the
Community Guide), a resource that includes multiple systematic reviews, each focusing on a
preventive health topic. The Community
Guide is being developed with the support of the U.S. Department of Health and
Human Services (DHHS) in collaboration with public and private partners. Although CDC provides staff support to the Task Force for development of the Community Guide, the recommendations presented in this report were developed by the Task Force and are not necessarily the recommendations of DHHS, CDC, or other participating groups.
This report is one in a series of topics included in the
Community Guide. It provides an overview of the process used by
the Task Force to select and review evidence and summarize its recommendations about interventions to improve
targeted vaccination coverage among adults at high risk. A full report on the recommendations, additional evidence (i.e., discussions of
applicability; additional benefits; potential harms; existing barriers to implementation; and costs, cost-benefit, and cost-effectiveness [when available] of recommended interventions), and remaining research questions will be published in the American Journal of Preventive Medicine
Community Guide topics are prepared and released as each is completed. The findings from systematic reviews on improving coverage with universally recommended vaccines,
tobacco-use prevention and reduction, reducing motor-vehicle
occupant injury, increasing physical activity, diabetes management, oral health, skin cancer prevention, violence prevention, and the effects of the social environment on health have already been published. A compilation of systematic reviews has
been published in book form (The Guide to Community Preventive Services. What Works to Promote
Health?). Additional information about the Task Force and the
Community Guide and a list of published articles are available at
The methods used by the Community Guide for conducting systematic reviews and linking evidence to recommendations
have been described elsewhere (25). For each
Community Guide topic, a multidisciplinary team (the systematic review
development team composed of Community
Guide researchers and methodologists, Task Force members, and other subject matter
specialists)* conducts a review consisting of the following steps:
developing an approach to organizing, grouping, and
selecting the interventions;
systematically searching for and retrieving evidence;
assessing the quality and summarizing the strength of the body of evidence on effectiveness;
translating the body of evidence on effectiveness into
assessing evidence about economic efficiency,
applicability, other positive and negative effects, and barriers
to implementation (if the effectiveness of the intervention has been established); and
identifying and summarizing research gaps.
The same conceptual approach and model (logic framework) used in the initial systematic reviews of
vaccine-preventable diseases for the Guide to Community Preventive Services
in 2000 (6) was adopted for this review. As in the initial review,
the systematic review development team focused on the following three categories of interventions:
Interventions to increase community and client demand for vaccines and vaccination services. These efforts provide
or disseminate information, advice, or both to clients
to increase and improve their efforts to seek appropriate
Interventions to enhance access to vaccination services. These efforts reduce barriers clients might encounter in
attempting to receive vaccinations.
Provider- or system-based interventions. These interventions provide information or deliver timely reminders or
periodic feedback to health-care providers with the intent of increasing provider counseling about, and administration
of, appropriate vaccinations to clients.
The Task Force previously reviewed the evidence on interventions to improve coverage of universally
recommended vaccinations (i.e., vaccines recommended for all persons in particular age groups) in children, adolescents, and adults (6--8). This review is an expansion of the original
Community Guide review and evaluates the effectiveness of interventions to
increase targeted vaccine coverage among populations at high risk. Although barriers to vaccination are similar for
universally recommended and targeted vaccinations, the populations are different. This review focused on interventions conducted among adults aged <65 years with medical conditions such as diabetes, human immunodeficiency virus, heart disease, and
lung disease; health-care workers at high risk for occupational exposure; and persons with high-risk behaviors for
HBV infection (e.g., injection-drug use or multiple sex partners). Because these groups might be harder to reach than those
for whom universally recommended vaccinations are
appropriate, the Task Force conducted reviews specifically addressing
these populations at risk.
The team reviewed the same interventions selected for the initial review of strategies to increase coverage for
universally recommended vaccines, adding new studies published during 1997--2001. Studies were eligible for inclusion in the reviews of effectiveness if they 1) were primary investigations of interventions selected for evaluation rather than, for example, guidelines
or reviews; 2) were published in English during January 1980--August 2001; 3) compared outcomes among groups of
persons exposed to the intervention with outcomes among groups of persons not exposed or less exposed to the intervention (i.e.,
the study design included a concurrent or before-and-after comparison); 4) were conducted in established market
economies; 5) measured differences or changes in vaccination coverage; 6) were studies of influenza, pneumococcal polysaccharide, or hepatitis B vaccines; and 7) were studies of populations that either focused on or included
persons aged <65 years and at high risk for infection,
morbidity, or mortality.
The team used multiple strategies to identify studies of interventions, starting with a search of 12 computerized
databases (MEDLINE®, Embase, Psychlit, Sociological Abstracts, CabHealth, HealthStar, AIDSline, Occupational Safety and
Health Database, Educational Resource Information Center [ERIC],
PsycINFO®, Dissertation Abstracts, and Conference
Papers Index).§ Team members also reviewed reference lists of published studies and consulted with specialists in the field to identify relevant studies. Each study was evaluated by two independent reviewers using a standardized abstraction form and was
assessed for suitability of the study design and threats to validity
(25,26). Studies were characterized as having good, fair, or limited execution on the basis of the number of threats to validity (25). Studies with greatest or moderate design suitability and a
good or fair quality of execution were considered qualifying studies and became part of the body of evidence.
Results for each outcome of interest were obtained from each study that met the minimum quality criteria. For this
review, assessment of the effectiveness of an intervention was primarily based on the reported measurements of changes in
coverage rates for influenza, pneumococcal polysaccharide, or hepatitis B vaccination. In studies with concurrent comparison groups,
the overall change in vaccination coverage was calculated by using the difference in vaccine coverage change observed in
the intervention and comparison groups. In studies
without a concurrent comparison group (e.g., time series evaluations),
the absolute percentage change was calculated from measurements of vaccination coverage in the study population pre-
and postintervention.¶ The median was used to summarize a typical measure of effect across the body of evidence for each outcome of interest; both the median and the range are reported.
The strength of the body of evidence of effectiveness was characterized as strong, sufficient, or insufficient on the basis of
the number of available studies, the suitability of study designs for evaluating effectiveness, the quality of execution of the studies as defined by the Community Guide
(25), the consistency of the results, and a determination of median
effect size sufficient for the purpose of public health benefit.
The Task Force uses systematic reviews to evaluate the evidence of intervention effectiveness and makes recommendations
on the basis of the findings of the reviews
(25). The strength of each recommendation is based on the evidence of
effectiveness (i.e., an intervention is recommended on the basis of either strong or sufficient evidence of effectiveness)
(25). Other types of evidence can also affect a recommendation. For example, harms resulting from an intervention that outweigh benefits might lead to a recommendation that the intervention
not be used even if it is effective in improving certain outcomes.
A finding of insufficient evidence to determine effectiveness means that the team was not able to determine whether or
not the intervention is effective. This finding is important for identifying areas of uncertainty and continuing research needs.
In contrast, sufficient or strong evidence of ineffectiveness would lead to a recommendation against use of the
In its earlier review of universally recommended vaccines, the Task Force summarized the evidence on effectiveness
of interventions implemented in combination within defined multicomponent categories (e.g., multicomponent
interventions that include patient or provider education)
(26). The multicomponent body of evidence summarized in the current
reviews consisted predominantly of studies evaluating unique, overlapping combinations of interventions. A
multicomponent framework was initially developed in these reviews, but the Task Force later determined that a simplified, qualitative,
and conceptual categorization of interventions within a "menu" format provides a more accurate and useful assessment of the evidence. Studies with similar but not identical combinations of interventions within or across categories were
evaluated together as a body of evidence. Effectiveness was determined for each possible combination of categories. After effective category combinations were identified, specific interventions with sufficient evidence on effectiveness as part of a multicomponent effort were included as category options in the menu (results of this review are presented elsewhere)
(27). This approach introduces an additional qualitative method for Task Force recommendations while acknowledging the work of previous investigators who developed and implemented intervention combinations on the basis of a conceptual
understanding of vaccination demand and delivery
The team identified 2,461 titles and abstracts, of which 60 met the inclusion criteria. Of these, 25 were excluded on the
basis of limitations in their design or execution and were not considered further. The remaining 35 studies were
considered qualifying studies and form the basis for the Task Force evaluations reported here. Reviews identified strong evidence of effectiveness in increasing targeted vaccine coverage for provider reminder systems when implemented alone. The evidence
was insufficient to determine the effectiveness of all other interventions when implemented alone (single-component interventions). All 11 single-component interventions are described here (Table 1), and a more detailed report will be published elsewhere (27).
The findings of the systematic review of interventions to increase targeted vaccine coverage when implemented
in combination (multicomponent) are based on 23 studies
(29--51). Overall, the 23 qualifying studies provided 26 study
arms evaluating 22 different combinations of interventions. Seven study arms in seven studies evaluated one of three specific intervention combinations: two studies evaluated a combination of client reminders and provider reminders; two used a combination of client education, client reminders, and expanded access in a health-care setting; and three used a
combination of client education, client reminders, expanded access, and reduced client out-of-pocket costs. The remaining 19 study arms evaluated unique combinations of interventions.
Because the majority of studies evaluated unique combinations of interventions, the team examined the evidence
of effectiveness of combinations of interventions within and across three categories of vaccination delivery (i.e., enhancing access to vaccination services, provider- or system-based interventions, and increasing client or community demand)
On the basis of strong evidence of effectiveness, the Task Force recommends the combination of one or more interventions
to enhance access to vaccination services (expanded
access in health-care settings or reduced client out-of-pocket costs) with
at least one provider- or system-based intervention (standing orders, provider reminder systems, or provider assessment
and feedback), and/or at least one intervention to increase client or community demand for vaccination (client reminders or
client education). The menu format of this recommendation is presented (Table 3). Evidence was insufficient to determine
the effectiveness of other combinations across or within categories.
Although incremental improvements in vaccine coverage could not be attributed to the specific components,
combined activities improved vaccination coverage. This could reflect any of the following:
The combined activities reinforce one another (e.g., education alone might not be enough to increase acceptance of vaccinations, but could make clients more receptive to other components).
Multicomponent interventions are delivered more intensively than single-component interventions.
More studies have been conducted of multicomponent interventions than single-component.
Multicomponent interventions might increase the likelihood of a client's exposure to at least one component.
The results of this review should be applicable in the
majority of client and provider populations and the majority of
settings where improvements in coverage are needed. Interventions were evaluated among outpatients, inpatients, health-care workers, nurses, and faculty physicians. Evaluated health-care settings included academic programs, outpatient clinics, hospitals, and long-term care facilities. No additional positive or negative effects specific to the combination of interventions were identified in this review, although positive or negative effects of single-component interventions might remain relevant
(6). Economic evaluations of the effects of these combined interventions were identified, but none of them met the quality criteria (52,53). Therefore, the results of these evaluations are not presented.
Barriers to the implementation of single-component interventions are probably relevant to combinations of interventions
(6). Additional barriers (e.g., lack of infrastructure) also might be encountered in efforts to combine and coordinate two or more interventions.
In conclusion, on the basis of strong evidence of effectiveness in increasing targeted vaccination coverage among
adult populations at high risk, the Task Force recommends the use of provider reminder systems and the use of combinations
of interventions that include one or more interventions to enhance access to targeted vaccination services coordinated with one
or more provider- or system-based interventions and/or one or more interventions to increase client or community demand
for targeted vaccination services. These findings should be applicable to the majority of client populations for which targeted
vaccines are indicated and where improvements in coverage are needed and to diverse provider populations and
Using the Recommendations in Communities and Health-Care Settings
Evidence reviews can support, but do not replace, the need to conduct local assessments in the process of program planning. Recommendations from the Task Force can assist program planners in matching effective intervention options to local needs, experience, administrative and social structures and regulations, and resources. In addition to the evidence on
effectiveness, evidence on applicability can be used to assess the extent to which the interventions reviewed match a particular local situation. Economic evaluations of the recommended intervention and intervention combinations are limited in both quality
The evidence on effectiveness identified in the review is divided among three different vaccines, certain targeted
populations, and different community and health-care settings. Despite a limited body of evidence for selected conditions, the Task Force recommendations presented in this report, except as noted in the following, should be broadly applicable. For example,
a limited number of studies were identified of population-based interventions to increase vaccination coverage for hepatitis B among health-care workers. Although motivation to be vaccinated might vary with the vaccine (i.e., hepatitis B protects the health-care worker who is vaccinated, whereas influenza vaccine also protects those patients with whom the health-care worker comes in contact), the Task Force recommendation reflects confidence that effective efforts to increase influenza
vaccine coverage among health-care workers can also be applicable to efforts to vaccinate health-care workers against hepatitis B.
Community-based options for interventions to increase vaccination coverage of persons at high risk for HBV are
one important area in which substantial gaps remain in the evidence on effectiveness. Substantial differences in the hepatitis
B vaccination schedule (a series of three injections), the target populations (persons with high-risk behaviors such as injection-drug use), and the settings for intervention (not primary health-care settings) are unlikely to be overcome through the direct application of health-care system strategies demonstrated to be effective in other targeted vaccination efforts
(28). Effective and recommended health-care--based interventions might not be applicable or might require considerable modification to
fit community-based programs to increase HBV coverage in populations at high risk. Practitioners should ensure
that interventions are selected or modified to address
locally relevant barriers to vaccination. Researchers should consider
more studies of this problem.
In 2000, the Advisory Committee on Immunization Practices updated their universal recommendations for annual
influenza vaccination to include adults aged 50--64 years
(54). Program planners dedicated to increasing influenza vaccination
coverage within this population should consider recommendations from either or both Task Force reviews applicable. For initial
efforts, the recommendations in the original, universal review provide effective and flexible intervention options
(6,8). For enhancing initial program efforts, the information on intervention combinations recommended in this targeted review might be helpful.
Certain studies included in these reviews evaluated interventions or combinations of interventions implemented to
increase vaccine coverage among all adult patients within a health-care system (including both patients with universal and high-risk indications). To match effective interventions to
local needs, program planning should include an assessment of
existing disparities, if any, in vaccine coverage among adult patients with universal and targeted indications.
Task Force on Community Preventive Services. Recommendations regarding interventions to improve vaccination coverage in children,
adolescents, and adults. Am J Prev Med 2000;18(1S):92--6.
Hak E, Nordin J, Wei F, et al. Influence of high risk medical conditions on the effectiveness of infleunza vaccination among elderly members of
3 large managed care organizations. Clin Infect Dis 2002;35:370--7.
Singleton JA, Greby SM, Wooten KG, Walker FJ, Strikas R. Influenza, pneumococcal, and tetanus toxoid vaccination of adults---United
States, 1993--1997. In: CDC Surveillance Summaries. MMWR 2000;49(SS-9).
Butler J, Breiman RF, Campbell JF, Lipman HB, Broome CV, Facklam RR. Pneumococcal polysaccharide vaccine efficacy: an evaluation of
current recommendations. JAMA 1993;270:1826--31.
Shapiro E, Berg A, Austrian R, et al. The protective efficacy of polyvalent pneumococcal polysaccharide vaccine. N Engl J Med 1991;325:1453--60.
Jiles R, Daniels D, Yusuf H, McCauley M, Chu S. Undervaccination with hepatitis B vaccine: missed opportunities or choice? Am J Prev
Bloom BS, Hillman AL, Fendrick AM, Schwartz JS. A reappraisal of hepatitis B virus vaccination strategies using cost-effectiveness analysis.
Ann Intern Med 1993;118:298--306.
Margolis HS, Coleman PJ, Brown RE, Mast EE, Sheingold SH, Arevalo JA. Prevention of hepatitis B virus transmission by immunization.
An economic analysis of current recommendations. JAMA 1995;274:1201--8.
Mahoney FJ, Stewart K, Hu H, Coleman P, Alter MJ. Progress toward the elimination of hepatitis B virus transmission among health care workers
in the United States. Arch Intern Med 1997;157:2601--5.
Williams IT, Perz JF, Bell BP. Viral hepatitis transmission in ambulatory health care settings. Clin Infect Dis 2004;38:1592--8.
U.S. Department of Health and Human Services. Healthy people 2010 (conference ed, in 2 vols). Washington, DC: U.S. Department of Health
and Human Services; 2000.
Briss PA, Zaza S, Pappaioanou M, et al. Developing an evidence-based
Guide to Community Preventive Services---methods. Am J Prev
Zaza S, Wright-de Aguero L, Briss PA, et al. Data collection instrument and procedure for systematic reviews in the
Guide to Community Preventive Services. Am J Prev Med 2000;18(1S):44--74.
Ndiaye SM, Hopkins DP, Shefer AM, et al. Interventions to improve influenza, pneumococcal polysaccharide, and hepatitis B vaccination
coverage among high-risk adults: a systematic review. Am J Prev Med;2005 (in press).
Ndiaye SM, Hopkins DP, Smith SJ, Hinman AR, Briss PA, Task Force on Community Preventive Services. Methods for conducting
systematic reviews of targeted vaccination strategies for the
Guide to Community Preventive Services. Am J Prev Med 2005 (in
Baker AM, McCarthy B, Gurley VF, Yood MU. Influenza immunization in a managed care organization. J Gen Intern Med 1998;13:469--75.
Barton MB, Schoenbaum SC. Improving influenza vaccination performance in an HMO setting: the use of computer-generated reminders and
peer comparison feedback. Am J Public Health 1990;80:534--66.
Becker DM, Gomez EB, Kaiser DL, Yoshihasi A, Hodge RH. Improving preventive care at a medical clinic: how can the patient help? Am J
Prev Med 1989;5:353--9.
Brimberry R. Vaccination of high-risk patients for influenza: a comparison of telephone and mail reminders. J Fam Pract 1988;26:397--400.
Carter WB, Beach LR, Inui TS. The flu shot study: using multiattribute utility theory to design a vaccination intervention. Organ Behav
Hum Decis Process 1986;38:378--91.
Coyne DW, Taylor LF, Yelton S, Long C, Preston SD. Network 12 hepatitis B vaccination quality improvement program: an educational
program directed at physicians, staff, and patients. Adv Ren Replace Ther 2000;7(4[Suppl 1]):S71--S5.
Fedson DS. Influenza vaccination of medical residents at the University of Virginia: 1986 to 1994. Infect Control Hosp Epidemiol 1996;17:431--3.
Harbarth S, Siegrist C, Schira J, Wunderli W, Pittet D. Influenza immunization: improving compliance of healthcare workers. Infect Control
Hosp Epidemiol 1998;19:337--42.
Hogg WE, Bass M, Calonge N, Crouch H, Satenstein G. Randomized controlled study of customized preventive medicine reminder letters in
a community practice. Can Fam Physician 1998;44:81--8.
Jans MP, Schellevis FG, Van Hensbergen W, Van Eijk JT. Improving general practice care of patients with asthma or chronic obstructive
pulmonary disease: evaluation of a quality system. Eff Clin Pract 2000;3:16--24.
Klein RS, Adachi N. An effective hospital-based pneumococcal immunization program. Arch Intern Med 1986;146:327--9.
Landis S, Scarbrough ML. Using a vaccine manager to enhance in-hospital vaccine administration. J Fam Pract 1995;41:364--9.
Larson EB, Bergman J, Heidrich F, Alvin BL, Schneeweiss R. Do postcard reminders improve influenza compliance? A prospective trial of
different postcard "cues." Med Care 1982;20:639--48.
Moran WP, Nelson K, Wofford JL, Velez R, Case LD. Increasing influenza immunization among high-risk patients: education or financial
incentive? Am J Med 1996;101:612--20.
Nichol KL, Korn JE, Margolis KL, Poland GA, Petzel RA, Lofgren RP. Achieving the national health objective for influenza immunization:
success of an institution-wide vaccination program. Am J Med 1990;89:156--60.
Nichol KL. Ten-year durability and success of an organized program to increase influenza and pneumococcal vaccination rates among
high-risk adults. Am J Med 1998;105:385--92.
Overhage JM, Tierney WM, McDonald CJ. Computer reminders to implement preventive care guidelines for hospitalized patients. Arch
Intern Med 1996;156:1551--6.
Sellors J, Pickard L, Mahony JB, et al. Understanding and enhancing compliance with the second dose of hepatitis B vaccine: a cohort analysis and
a randomized controlled trial. Can Med Assoc J 1997;157:143--8.
Spaulding SA, Kugler JP. Influenza immunization: the impact of notifying patients of high-risk status. J Fam Pract 1991;33:495--8.
Thomas DR, Winsted B, Koontz C. Improving neglected influenza vaccination among healthcare workers in long-term care. J Am Geriatr
Turner RC, Waivers LE, O'Brien K. The effect of patient-carried reminder cards on the performance of health maintenance measures. Arch
Intern Med 1990;150:645--7.
van Essen GA, Kuyvenhoven MM, de Melker RA. Implementing the Dutch College of General Practitioners' guidelines for influenza vaccination:
an intervention study. Br J Gen Pract 1997;47:25--9.
Yassi A, Khokhar JB, Marceniuk M, McGill ML. Hepatitis B vaccination for health care workers: evaluation of acceptance rate and program
strategy at a large tertiary care hospital. Can J Infect Control 1993;8:94--7.
* The systematic review development team directs the review, in conjunction with a group of consultants. For these reviews, the members of the systematic review development team were David P. Hopkins, MD, Peter A. Briss, MD, Division of Prevention Research and Analytic Methods, Epidemiology Program Office; Serigne M. Ndiaye, PhD, Lance E. Rodewald, MD, Abigail M. Shefer, MD, Bayo Willis, MPH, National Immunization Program, CDC,
Atlanta, Georgia; Alan R. Hinman, MD, Task Force for Child Survival and Development, Atlanta, Georgia. Consultants were Bob Gunn, MD, National Center for HIV, STD and TB Prevention, CDC, Atlanta, Georgia; Joseph Chin, MD, Center for Medicare Services, Baltimore, Maryland; Lloyd Novick, MD,
Onondaga County Health Department, Syracuse, New York; Rose Marie Matulionis, MSPH, Association of State and Territorial Directors of Health Promotion and Public Health Education, Washington, DC; Susan Lett, MD, Massachusetts Department of Health, Boston; Tracy Lieu, MD, Harvard University,
Cambridge, Massachusetts; Theresa W. Gyorkos, PhD, Montreal General Hospital and McGill University, Montreal, Quebec, Canada; Tom Saari, MD, University of Wisconsin, Madison; William Schaffner II, MD, Vanderbilt University, Nashville, Tennessee; Peter Szilagyi, MD, University of Rochester, New York.
Established Market Economies, as defined by the World Bank, are Andorra, Australia, Austria, Belgium, Bermuda, Canada, Channel Islands, Denmark, Faeroe Islands, Finland, France, Germany, Gibraltar, Greece, Greenland, Holy See, Iceland, Ireland, Isle of Man, Italy, Japan, Liechtenstein, Luxembourg,
Monaco, The Netherlands, New Zealand, Norway, Portugal, San Marino, Spain, St. Pierre and Miquelon, Sweden, Switzerland, the United Kingdom, and the
¶ In studies with concurrent comparison groups, the overall change in vaccination coverage was calculated by using the difference between the changes in vaccination coverage observed in the intervention and comparison groups. In time-series studies, the absolute percentage point change over time was derived.
In these calculations, Ipost = last reported coverage in the intervention group after the intervention; Ipre = reported coverage in the intervention group immediately before the intervention; Cpost = last reported coverage in the comparison group after the intervention; and Cpre = reported coverage in the comparison group immediately before the intervention.
For studies with before-and-after measurements and concurrent comparison groups, where baseline = Ipre: (Ipost -- Ipre) -- (Cpost -- Cpre)
For studies with post-only coverage measurements and concurrent comparison groups, where baseline = Cpost: Ipost -- Cpost
For studies with before-and-after measurements but no concurrent comparison, where baseline = Ipre: Ipost -- Ipre
Task Force on Community Preventive Services*
February 1, 2005
Chair: Jonathan E. Fielding, MD, Los Angeles Department of Health Services, Los Angeles, California.
Members: Noreen Morrison Clark, PhD, University of Michigan School of Public Health, Ann Arbor, Michigan; John Clymer, Partnership
for Prevention, Washington, DC; Kay Dickersin, PhD, Center for Clinical Trials and Evidence-based Healthcare, Brown University, Providence,
Rhode Island; Alan R. Hinman, MD, Task Force for Child Survival and Development, Atlanta, Georgia; Robert L. Johnson, MD, New Jersey Medical School, Department of Pediatrics, Newark, New Jersey; Garland H. Land, MPH, Center for Health Information Management and Epidemiology,
Missouri Department of Health, Jefferson City, Missouri; Patricia A. Nolan, MD, Rhode Island Department of Health, Providence, Rhode Island; Alonzo L. Plough, PhD, Public Health-Seattle and King County, Seattle, Washington; Nicolaas P. Pronk, PhD, HealthPartners Center for Health
Promotion, Minneapolis, Minnesota; Dennis L. Richling, MD, Midwest Business Group on Health, Chicago, Illinois; Barbara K. Rimer, DrPH; School of Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina; Steven M. Teutsch, MD, Merck & Company, Inc., West Point, Pennsylvania.
Consultants: Robert S. Lawrence, MD, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland; J. Michael
McGinnis, MD, Robert Wood Johnson Foundation, Princeton, New Jersey; Lloyd F. Novick, MD, Onondaga County Department of Health, Syracuse, New York.
* Patricia A. Buffler, PhD, University of California, Berkeley; Ross Brownson, PhD, St. Louis University School of Public Health, St. Louis, Missouri; Mary Jane England, MD, Regis College, Weston, Massachusetts; Caswell A. Evans, Jr., DDS, National Oral Health Initiative, Office of the U.S. Surgeon
General, Rockville, Maryland; David W. Fleming, MD, CDC, Atlanta, Georgia; Mindy Thompson Fullilove, MD, New York State Psychiatric Institute and Columbia University, New York, New York; Fernando A. Guerra, MD, San Antonio Metropolitan Health District, San Antonio, Texas; George J. Isham, MD, HealthPartners, Minneapolis, Minnesota; Charles S. Mahan, MD, College of Public Health, University of South Florida, Tampa, Florida; Patricia
Dolan Mullen, DrPH, University of Texas--Houston School of Public Health, Houston, Texas; Susan C. Scrimshaw, PhD, University of Illinois School of Public Health, Chicago, Illinois; and Robert S. Thompson, MD, Department of Preventive Care, Group Health Cooperative of Puget Sound, Seattle, Washington, also served on the Task Force while the recommendations were being developed.
Use of trade names and commercial sources is for identification only and does not imply endorsement by the U.S. Department of
Health and Human Services.References to non-CDC sites on the Internet are
provided as a service to MMWR readers and do not constitute or imply
endorsement of these organizations or their programs by CDC or the U.S.
Department of Health and Human Services. CDC is not responsible for the content
of pages found at these sites. URL addresses listed in MMWR were current as of
the date of publication.
All MMWR HTML versions of articles are electronic conversions from ASCII text
into HTML. This conversion may have resulted in character translation or format errors in the HTML version.
Users should not rely on this HTML document, but are referred to the electronic PDF version and/or
the original MMWR paper copy for the official text, figures, and tables.
An original paper copy of this issue can be obtained from the Superintendent of Documents,
U.S. Government Printing Office (GPO), Washington, DC 20402-9371; telephone: (202) 512-1800.
Contact GPO for current prices.
**Questions or messages regarding errors in formatting should be addressed to