Frequently Asked Questions About Changes to the Behavioral Risk Factor Surveillance System
- What is the BRFSS?
- What are the changes that have been made to BRFSS?
- Why is it necessary to increase the number of survey calls to cell-phone numbers?
- Why is it necessary to adopt a different method of data weighting?
- What steps were taken to implement these BRFSS changes?
- How will these two changes affect each state’s dataset?
- When will we first see BRFSS data that reflects the two changes?
- Can the 2010 BRFSS dataset be compared with 2011 dataset?
- Where can I learn more about the BRFSS changes?
What is the BRFSS?
The Behavioral Risk Factor Surveillance System (BRFSS) is the largest ongoing telephone health survey in the world. It is a state-based system of health surveys established by the Centers for Disease Control and Prevention (CDC) in 1984. BRFSS completes more than 400,000 adult interviews each year.
For most states, BRFSS is their only source of population-based health behavior data about chronic disease prevalence and behavioral risk factors.
What are the changes that have been made to BRFSS?
The two BRFSS changes have been made to keep the data accurate and representative of the total population. These are making survey calls to cell-phone numbers and adopting an advanced weighting method.
- The first change is including and then growing the number of interview calls made to cell phone numbers. Estimates today are that 3 in 10 U.S. households have only cell phones.
- The second change is to replace the “post-stratification” weighting method with a more advanced method called “iterative proportional fitting,” also sometimes called “raking.”
Why is it necessary to increase the number of survey calls to cell-phone numbers?
During 2003—2009, the proportion of U.S. adults who lived in cell phone-only households increased by more than 700%, and this trend is continuing. Estimates are that currently 3 in 10 U.S. households have only cell phones.
These households increasingly were left out of the population that BRFSS seeks to characterize—adults 18 years of age or older who do not live in institutional settings. Using cell phones only is especially strong in younger age groups and among persons in certain racial and ethnic minority groups.
Why is it necessary to adopt a new method of data weighting?
For the past several decades, BRFSS used a statistical weighting method called “post-stratification.” However, the advent of easily accessible ultra-fast computer processors and networks has allowed the BRFSS to adopt an advanced weighting method called iterative proportional fitting, also known by its nickname, “raking.”
What steps were taken to implement these BRFSS changes?
In 2004 a panel of national survey experts recommended that CDC make the two changes to ensure BRFSS data remained valid and useful. Beginning in 2006, how to best design and implement the changes went through an extensive development process with experts, collaboration with the state BRFSS coordinators to pilot test the new methods, and training to ensure that state BRFSS coordinators understood the changes and the rationale for them.
The changes were discussed at the annual BRFSS Conferences in 2007, 2008, 2009, 2010 and 2011; with CDC and state members of the BRFSS Working Group; at training sessions; and at meetings of NACCHO, APHA, CSTE, and the American Association of Polling and Opinion Research (AAPOR) in 2009, 2010, and 2011.
How will these two changes affect each state’s dataset?
When will we first see BRFSS data that reflects the two changes?
Can the 2010 BRFSS dataset be compared with 2011 dataset?
It is always difficult to discern long-term trends by comparing one year to the next. Such comparisons will be especially difficult to make for 2010 and 2011, given the change in BRFSS methods.
Changes in the 2011 data are likely to show indications of somewhat higher occurrences of risk behaviors common to younger adults and to certain racial or ethnic minority groups. Such effects will vary for each state survey. CDC anticipates small increases for health-risk indicators such as tobacco use, obesity, binge drinking, HIV, asthma, and health status.
Where can I learn more about the BRFSS changes?