7: No. 4, July 2010
Kathryn Wojcik, MPH; Annie Gjelsvik, PhD; Dona Goldman, RN, MPH
Suggested citation for this article: Wojcik K, Gjelsvik A, Goldman D. Identifying populations at high risk for diabetes with the Behavioral Risk Factor Surveillance System, Rhode Island, 2003. Prev Chronic Dis 2010;7(4):A86.
http://www.cdc.gov/pcd/issues/2010/jul/09_0175.htm. Accessed [date].
We evaluated the feasibility of applying a previously validated diabetes risk score (DRS) to state-based surveillance data from the Behavioral Risk Factor Surveillance System (BRFSS) to assess population risk for developing type 2 diabetes or having undiagnosed type 2 diabetes.
We conducted a cross-sectional analysis of 1,969 adults aged 30 to 60 years who self-reported never having been diagnosed with diabetes. The Danish DRS was applied to the 2003 Rhode Island BRFSS data by using 6 categorical variables: age, sex,
body mass index, known hypertension, leisure-time physical activity, and family history of diabetes. The DRS was the sum of these individual scores, which ranged from 0 to 60; a score of 31 or more was considered high-risk.
We found that 436 study participants, representing 23% of Rhode Island adults aged 30 to 60 years, had a high DRS. In the final model, adults with at least some college education were 43% less likely to have a high DRS, compared to adults with a high school diploma. Adults with no health insurance were 54% more likely to have a high DRS compared with insured adults.
By adding a family history question in odd years to correspond to the hypertension module in the BRFSS,
routinely available state-level surveys can be used with a DRS to monitor populations at high risk for developing type 2 diabetes. In Rhode Island, almost one-fourth of adults aged 30 to 60 years were at high risk for having undiagnosed diabetes or developing diabetes. Adults with lower education and without health insurance were at highest risk.
Back to top
Type 2 diabetes often goes undetected for many years. When patients are diagnosed with diabetes, 25% have established retinopathy, and half have clinical evidence of diabetic tissue damage. These measurements have been extrapolated to estimate a delay from disease onset to diagnosis of more than 10 years (1). Moreover, type 2 diabetes can be prevented or delayed in people with impaired glucose tolerance (IGT) with lifestyle modification or prescription drug treatment (2). A major task for
public health professionals is to identify people at high risk for developing diabetes who would benefit from these interventions.
Researchers have created diabetes risk score (DRS) tools based on data that are routinely available in primary care and have validated them in many populations (3-12). For a study conducted in Denmark, researchers developed a simple self-administered questionnaire to identify people with undiagnosed diabetes and derived a DRS from it. The Danish DRS is useful for identifying people who have undiagnosed diabetes or are at high risk for developing diabetes. In addition, the Danish DRS study
concluded that the use of this tool may decrease the number of subsequent tests and potentially could lower screening costs (8).
In addition to clinical applications, a DRS could prove useful when applied to surveillance data to assess population risk of developing diabetes. This information can help target high-risk populations that clinical application may miss, such as people without health insurance. In addition, screening for diabetes may be more efficient if targeted at high-risk populations (13). DRS questionnaires have mainly been used in primary care because they are less labor-intensive and more acceptable
to patients than biochemical screening tests such as measurement of fasting glucose or glycosylated hemoglobin (1).
Projection of disease prevalence helps in planning for health care needs. Studies have projected diagnosed diabetes prevalence for the United States and other countries (14,15). By understanding the proportion and distribution of adults at high risk for developing diabetes or having undiagnosed diabetes, more accurate estimates of prevalence can be calculated and prevention activities can be better targeted.
Our objective was to evaluate the feasibility of using a validated DRS with state-based surveillance data from the Behavioral Risk Factor Surveillance System (BRFSS) to assess population risk for developing diabetes and to identify populations for screening and targeting interventions.
Back to top
We used data from the 2003 Rhode Island BRFSS for this analysis. The BRFSS is a standardized, telephone survey of noninstitutionalized adults aged 18 years or older in the United States, Guam, Puerto Rico, and the Virgin Islands (16). The standard BRFSS questionnaire has 3 components: the core, optional modules, and state-added questions. The core questionnaire is a set of standardized questions asked of all respondents in each state and territory. Optional
modules are sets of standardized questions that each state can select about specific topics such as diabetes and arthritis management. State-added questions are designed and used by states to address their specific needs.
The Danish Diabetes Risk Score
We used the Danish DRS for our research. The Danish DRS was developed with half of the 6,124 eligible participants of the Inter99 study, validated internally with the
other half of the Inter99 participants and validated externally with 1,028 ADDITION pilot study participants (8). Frequent thirst, frequent voluminous voiding of urine, weight loss, tiredness, repeated cystitis, age, sex, body mass index (BMI), family history of diabetes (parents or siblings), known hypertension,
antihypertensive treatment, knowledge of dyslipidemia, treatment for hypercholesterolemia, and leisure-time physical activity were considered for this DRS. Three steps were used to select variables in the final Danish DRS. If diabetes was strongly associated with the variable then it was next evaluated by using logistic regression, with screen-detected diabetes as the outcome. Participants were considered to have screen-detected diabetes if they did not know they had diabetes but had a fasting
plasma glucose level ≥7.0 mmol/L or 2-hour plasma glucose level ≥11.1 mmol/L. Variables with a P value of <.20 from this model were included in a stepwise backward elimination process, with screen-detected diabetes as the dependent variable, resulting in 6 variables (age, sex, BMI, known hypertension, leisure-time physical activity, and parental diabetes) in the final model. The score was constructed by multiplying the regression coefficient by 10 and rounding to the
nearest integer (Table 1). The sum of each variable score was calculated for each participant, resulting in a DRS ranging from 0 to 60. Because a score of 31 or more showed a sensitivity close to the prespecified value of 75%, this value was chosen as the cutoff for high risk and was the only cutoff that was validated (8).
We selected the 2003 Rhode Island BRFSS because this was the only year that included all 6 of the variables in the Danish DRS. The study
sample included Rhode Island residents aged 30 to 60 years who said they had not been told by a doctor that they have diabetes and who had valid responses for all items included in the Danish DRS and all potential predictor variables (n = 1,969). Respondents were identified as having diabetes if they answered yes to the question, “Have you ever been
told by a doctor that you have diabetes?” (17). Respondents who answered “do not know/not sure” or “refused” and women who had diabetes only during pregnancy were classified as not having diabetes and were included in the study
We divided age into 4 categories: 30 to 40, 41 to 47, 48 to 54, and 55 to 60. Sex was a binary category. BMI was divided into 3 categories: <25.0 kg/m2, 25.0-29.9 kg/m2, and ≥30 kg/m2. The BRFSS question used to define known hypertension was, “Have you ever been told by a doctor, nurse, or other health professional that you have high blood pressure?” (17). Respondents who answered yes were classified as having hypertension and those who answered no
or only during pregnancy were classified as not having hypertension (Table 1).
In the Danish DRS, leisure-time physical activity was a binary (yes/no) variable (8). BRFSS respondents were asked, “During the past month, other than your regular job, did you participate in any physical activities or exercises such as running, calisthenics, golf, gardening, or walking for exercise?” (17) (Table 1).
The final variable in the Danish DRS was whether the respondent had a parent with diabetes. The 2003 Rhode Island BRFSS contains a state-added question related to family history of diabetes: “This question asks about your family members who are related to you by blood (do not include diabetes during pregnancy). Do you have a parent, brother, or sister related by blood, who has or has had diabetes?” (17). The response was categorized into a binary (yes/no) variable. Respondents who answered
“not sure/do not know” or “refused” to any of these variables were not included in the analyses.
We evaluated potential predictors that have been demonstrated in previous studies to be related to undiagnosed diabetes or high diabetes risk that were not already included in the DRS: race/ethnicity (18), education (19), employment (20), health insurance (21), and smoking status (1). In addition, we evaluated marital status and having an annual checkup as potential predictors.
To account for the complex survey design, we conducted all analyses by using Stata version 10.0 (StataCorp LP, College Station, Texas). First we calculated frequencies for potential predictors. Then we calculated odds ratios (ORs)
and 95% confidence intervals (CIs) for each potential predictor. Our third step was to run a full model that included all potential predictors. Our final model included race/ethnicity, education, employment, health insurance, and smoking status, based on previous literature (1,18-21), and added
annual checkup based on the Wald test. We assessed this model by using a goodness-of-fit statistic developed for complex survey design (22).
Back to top
Approximately 23% of adults in Rhode Island aged 30 to 60 years who had not been diagnosed with diabetes had a high risk of developing diabetes according their Danish DRS category. Compared to respondents with a low DRS, a greater percentage of those with a high DRS had less than a high school education, were retired, had no health insurance, and had seen a doctor within the past 12 months
Crude estimates showed that adults who had less than a high school degree or General Educational Development certificate (GED)
were 58% more likely and those with at least some college were 39% less likely to have a high Danish DRS compared to people with a high school degree or GED. In addition, respondents who were unemployed were 51% more likely and those who were retired were more than 5 times as likely to have a high Danish DRS as adults who were employed
The final model contained race/ethnicity, education, employment, health insurance, smoking status, and annual checkup. It showed no evidence of lack of fit (F = 0.80, P = .61). In the final model, adults with at least some college, current smokers, and those who had not seen a doctor in the past 12 months had lower odds of a high DRS, and retired adults and adults without health insurance had higher odds of a high DRS. There was no association between race/ethnicity and
high DRS (Table 3).
Back to top
Based on 2003 Rhode Island BRFSS data, 7% of Rhode Island adults had diagnosed diabetes, which corresponds to national estimates (23), and we found that 23% of Rhode Island adults aged 30 to 60 years without previous diagnosis of nongestational diabetes are at high risk for having undiagnosed diabetes or developing diabetes. This estimate is consistent with estimates of undiagnosed diabetes and diabetes risk from National Health and Nutrition Examination Survey (NHANES) data. Using 1999-2002
NHANES data, Cowie and colleagues estimated that 28.8% of adults aged 20 or older
had either undiagnosed diabetes (2.8%) or impaired fasting glucose (IFG) (26.0%)
(24). These estimates varied by age; 33.2% of 40- to 59-year-olds and 16.6% of 20- to 39-year-olds have either undiagnosed diabetes or IFG
(24). When incorporating IGT into the definition of high-risk so that people were identified as having prediabetes if they had IFG or IGT, Cowie and colleagues estimated
that 29.5% of adults aged 20 or older were at high risk for diabetes on the basis of 2005-2006 NHANES data (25).
We found that education and health insurance status were associated with diabetes risk, which is consistent with previous research (19,21). In the final model, adults with at least some college education were 43% less likely to have a high DRS than
were adults with a high school education, and adults without health insurance
were 54% more likely to have a high DRS than were adults with health insurance. Retired adults had 5.43 the odds of a high DRS compared with employed adults, which is likely due
to the increased risk of diabetes associated with aging.
Current smokers were 30% less likely to have a high DRS compared with adults who did not smoke. This finding may be due to the differences in BMI between smokers and nonsmokers (26). In our sample, 48% of smokers were neither overweight nor obese compared with 39% of nonsmokers. Contrary to what we expected to find, adults who had not seen a doctor in the past year were 39% less likely to have
a high DRS compared with adults who had seen a doctor in the past year. This could be due to the way
hypertension was assessed. Participants needed to have been told by a doctor, nurse, or other health professional that they had hypertension to be categorized accordingly; thus, adults without regular checkups may be less likely to have a high DRS because of undiagnosed hypertension. In addition, other variables that contribute to a high DRS such as increasing age, family history of diabetes, and obesity may increase the likelihood of seeing a doctor regularly.
Unlike previous research (27), we did not find any differences in diabetes risk by race/ethnicity. One reason is that the Danish DRS was developed only for white populations (8) and does not take race/ethnicity into account as other DRS tools do (10-12). We ran our final model using only non-Hispanic white adults and the results were essentially the same: lower education, having a health plan, not smoking, and having an annual checkup were associated with a higher DRS. The increased odds of
high DRS for unemployed adults compared with employed adults became significant (OR, 1.42; 95% CI, 1.00-2.01).
Our study had several limitations. First, the Danish DRS was developed and validated in different populations than our study population. Risk scores that have been developed and validated in 1 population may not have adequate sensitivity or specificity in other populations (28). Although the Rhode Island population is primarily non-Hispanic white (29), there are likely differences between the European and Rhode Island populations on DRS items. For instance, the Rhode Island study
population had higher rates of obesity, known hypertension, and reported leisure-time physical activity compared with the Inter99 and ADDITION pilot study populations (8).
Second, although we tried to duplicate the Danish DRS as closely as possible, we were limited to the population and items available on the Rhode Island BRFSS, since we were primarily interested in determining and monitoring high diabetes risk in a state population. The BRFSS is a telephone survey of noninstitutionalized adults; thus, we did not have information on adults in prisons, long-term care facilities, or without landline telephones. These populations may have a higher risk of
diabetes (30). Additionally, all information on the BRFSS is self-reported, in contrast to the pilot study of the Inter99 and ADDITION populations, in which blood pressure, height, and weight were measured (8). Women tend to underestimate their weight and men to overestimate their height (31), which would result in an underestimate, in the Rhode Island population, of diabetes risk.
There were also differences in the questions used to assess family history of diabetes and leisure-time physical activity. In the Inter99 study, family history of diabetes was assessed in 2 parts: parental and sibling. The Danish DRS included only parental history of diabetes, although the ADDITION pilot study, 1 of the populations in which the Danish DRS was validated, used only 1 question.
This was similar to the Rhode Island BRFSS, which combined parental and sibling history of diabetes. In
addition, because the family history question used in the Rhode Island BRFSS was state-added it has not, to our knowledge, been validated. This study may therefore overestimate the prevalence of high diabetes risk.
We used a single question on reported leisure-time physical activity to categorize participants as active or inactive, whereas the Danish DRS used 4 original categories (sedentary, moderate, active, and competitive sport), which were collapsed into active vs inactive. Differences in how leisure-time physical activity was measured could result in
inaccurate estimation of population diabetes risk. We therefore explored 2 other ways of categorizing adults using the BRFSS data. The first used
information on any activity vs no moderate or vigorous activity. The second used information on days and minutes of moderate and vigorous physical activity and adhered to the Healthy People 2010 definition of active and inactive (32). With all 3 ways of categorizing physical activity we found similar prevalence of high diabetes risk (23.1%, 23.8%, and 22.1%) and similar relationships with potential predictors. Thus, we used the 1-question original method, since this resulted in the
fewest observations discarded because of missing information.
We would have preferred a DRS that had been validated in a US population with similar demographics to Rhode Island and
that used the same questions as the Rhode Island BRFSS. We were unable to find another validated DRS that could be applied to state-level surveillance data because the BRFSS does not ask participants their waist circumference, which is a common variable in other validated DRS questionnaires (3-12).
Data collected routinely in the BRFSS can identify populations at risk of diabetes more efficiently than complicated and costly screening strategies. Our method of using the Danish DRS applied to the BRFSS offers a new way for states to determine and target the population at risk for diabetes. In addition, because the BRFSS is a routine surveillance system for states, states can track high-risk populations over time. A state-added question about family history of diabetes should be included
in the same year as the rotating hypertension awareness module.
This study indicates that approximately 23% of the Rhode Island adult population is at high risk for diabetes and that particular risk groups such as people with less education and without health insurance should be targeted for diabetes prevention and screening.
Back to top
This publication was funded in part by Centers for Disease Control and Prevention cooperative agreement U32/CCU122687-05.
Back to top
Corresponding Author: Annie Gjelsvik, PhD, Brown University, Box G-S121, 2nd floor, Providence, RI 02912. Telephone: 401-863-2396. E-mail:
Annie_Gjelsvik@brown.edu. Dr Gjelsvik is also affiliated with the Rhode Island Department of Health Diabetes Prevention and Control Program.
Author Affiliations: Kathryn Wojcik, Warren Alpert Medical School, Brown University, Providence, Rhode Island; Dona Goldman, Rhode Island Department of Health Diabetes Prevention and Control Program, Providence, Rhode Island. Ms Wojcik is also affiliated with Coastal Medical, Providence, Rhode Island.
Back to top
- Griffin SJ, Little PS, Hales CN, Kinmonth AL, Wareham NJ.
Diabetes risk score: towards earlier detection of type 2 diabetes in general
practice. Diabetes Metab Res Rev 2000;16(3):164-71.
- Engelgau ME, Geiss LS, Saaddine JB, Boyle JP, Benjamin SM, Gregg EW, et al.
The evolving diabetes burden in the United States. Ann Intern Med 2004;140(11):945-50.
- Mohan V, Deepa M, Somannavar S, Datta M.
A simplified Indian diabetes risk score for screening for undiagnosed diabetic subjects. J Assoc Physicians India 2005;53:759-63.
- Ramachandran A, Snehalatha C, Vijar V, Wareham NJ, Colagiuri S.
Derivation and validation of diabetes risk score for urban Asian Indians. Diabetes Res Clin Pract 2005;70(1):63-70.
- Al-Lawati J, Tuomilehto J.
Diabetes risk score in Oman: a tool to identify prevalence of type 2 diabetes among Arabs of the Middle East. Diabetes Res Clin Pract 2007;77(3):438-44.
- Spijkerman AM, Yuyun MF, Griffin SJ, Dekker JM, Nijpels G, Wareham NJ.
The performance of a risk score as a screening test for undiagnosed hyperglycemia in ethnic minority groups: the data from the 1999 health survey for England. Diabetes Care 2004;27(1):116-22.
- Lindstrom J, Tuomilehto J.
The diabetes risk score: a practical tool to predict type 2 diabetes risk. Diabetes Care 2003;26(3):725-31.
- Glümer C, Carstensen B, Sandbæk A, Lauritzen T, Jørgensen T, Borch-Johnsen K.
A Danish diabetes risk score for targeted screening: the Inter99 study. Diabetes Care 2004;27(3):727-33.
- Schulsa MB, Hoffmann K, Boeing H, Linseisen J, Rohrmann S, Möhlig M, et al.
An accurate risk score based on anthropometric, dietary, and lifestyle factors to predict the development of type 2 diabetes. Diabetes Care 2007;30(3):510-5.
- Hippisley-Cox J, Coupland C, Robson J, Sheikh A, Brindle P.
Predicting risk of type 2 diabetes in England and Wales: prospective derivation and validation of QDScore. BMJ 2009;338:B880.
- Kahn HS, Cheng YJ, Thompson TJ, Imperatore G, Gregg EW.
Two risk-scoring systems for predicting incident diabetes mellitus in US adults age 45 to 64 years. Ann Intern Med 2009;150(11):741-51.
- Heikes KE, Eddy DM, Arondekar B, Schlessinger L.
Diabetes risk calculator: a simple tool for detecting undiagnosed diabetes and pre-diabetes. Diabetes Care 2008;31(5):1040-5.
- Lawrence JM, Bennett P, Young A, Robinson AM.
Screening for diabetes in general practice: cross-sectional population study. BMJ 2001;323(7312):548-51.
- Boyle JP, Honeycott AA, Navayan KM, Hoerger TJ, Geiss LS, Chen H, et al.
Projection of diabetes burden through 2050: impact of changing demography and disease prevalence in the US. Diabetes Care 2001;24(11):1936-40.
- Helms RB.
Implications of population growth on prevalence of diabetes: a look at the future. Diabetes Care 1992;15 Suppl 1:6-9.
- Strine T, Okoro C, Chapman D, Beckles G, Balluz L, Mokdad A.
The impact of formal diabetes education on the preventive health practices and behaviors of persons with type 2 diabetes. Prev Med 2005;41(1):79-84.
- Rhode Island Behavioral Risk Factor Surveillance System, 2003. Rhode Island Department of Health, Office of Health Statistics; 2004. http://www.health.ri.gov/data/behaviorriskfactorsurvey/ questionnaires/brfsssurvey2003.pdf. Accessed March 1, 2010.
- Lawlor DA, Patel R, Fraser A, Smith GD, Ebrahim S.
The association of life course socio-economic position with diagnosis, treatment, control and survival of women with diabetes: findings from the British Women’s Heart and Health Study. Diabet Med 2007;24(8):892-900.
- Ginde AA, Delaney KE, Lieberman RM, Vanderweil SG, Camargo CA.
Estimated risk for undiagnosed diabetes in the emergency department: a multicenter survey. Acad Emerg Med 2007;14(5):492-5.
- Mainous AG, Diaz VA, Everett EA.
Assessing risk for development of diabetes in young adults. Ann Fam Med 2007;5(5):425-9.
- Franse LV, Bari MD, Shorr RI, Resnick HE, VanEijk JTM, Bauer DC, et al.
Type 2 diabetes in older well-functioning people: who is undiagnosed? Diabetes Care 2001;24(12):2065-70.
- Archer KJ, Lemeshow S, Hosmer DW. Goodness-of-fit tests for logistic regression models when data are collected using a complex sampling design. Comput Stat Data Anal 2007;51(9):4450-64.
- Gjelsvik A, Wojcik K. Rhode Island diabetes health profile: 2008. Rhode
Island Department of Health; 2008. http://www.health.ri.gov/publications/healthprofiles/2008Diabetes.pdf. Accessed May 30, 2008.
- Cowie CC, Rust KF, Byrd-Holt DD, Eberhardt MS, Flegal KM, Engelgau MM, et al.
Prevalence of diabetes and impaired fasting glucose in adults in the US population: National Health and Nutrition Examination Survey 1999-2002. Diabetes Care 2006;29(6):1263-8.
- Cowie CC, Rust KF, Ford ES, Eberhardt MS, Byrd-Holt DD, Li C, et al.
Full accounting of diabetes and pre-diabetes in the US population in 1988-1994 and 2005-2006. Diabetes Care 2009;32(2):287-94.
- Albanes D, Jones DY, Micozzi MS, Mattson ME.
Associations between smoking and body weight in the US population: analysis of NHANES II. Am J Public Health 1987;77(4):439-44.
- Mainous AG, Baker R, Koopman RJ, Saxena S, Diaz VA, Everett CJ, et al.
Impact of the population at risk of diabetes on projections of diabetes burden in the United States: an epidemic on the way. Diabetologia 2007;50(5):934-40.
- Glümer C, Vistisen D, Borch-Johnsen K, Colagiuri S.
Risk scores for type 2 diabetes can be applied in some populations but not all. Diabetes Care 2006;29(2):410-4.
- Kaiser Family Foundation. Population distribution by race/ethnicity, states (2005-2006), US (2006). http://www.statehealthfacts.org/comparebar.jsp?ind=6&cat=1. Accessed March 20, 2008.
- Zimmet P.
The burden of type 2 diabetes: are we doing enough? Diabetes Metab 2003;29(4 Pt 2):6S9-18.
- van Sluujs EM, van Poppel MN, Stalman WA, van Mechelen W.
Feasibility and acceptability of a physical activity promotion programme in general practice. Fam Pract 2004;21(4):429-36.
- US Department of Health and Human Services. Healthy people 2010: understanding and improving health. 2nd edition. Washington (DC): US Government Printing Office; 2000.
Back to top