INTRODUCTION

Maintaining optimal glycemic control for type 2 diabetes has become a significant goal for health systems, providers, and patients. Landmark studies have shown that lowering blood glucose over the long term reduces microvascular complications,1,2. However, unexpected excess mortality recently reported in the ACCORD Trial, a randomized trial exploring the effects of lowering blood glucose to near-normal levels, has renewed the controversy about glycemic targets3-6 and raised important questions regarding treatment safety. One unintended consequence of optimizing glycemic control may be an increased risk for hypoglycemic events3 (Fig. 1).

Figure 1
figure 1

Proportion of patients reporting 1 or more significant hypoglycemic events in past 12 months.

Hypoglycemia is one of the most common adverse drug events that lead to emergency room visits and hospitalization,7,8 and reduces quality of life9,10. Although trials to assess the benefits of optimizing glycemic control among type 2 diabetes patients have documented a low incidence of hypoglycemia,11,12 hypoglycemia may be more common in practice13, and little is known about the incidence of hypoglycemia occurrences that do not come to medical attention.

The relationship between limited health literacy and hypoglycemia is unclear. Limited health literacy (HL) has been found to be common among patients with type 2 diabetes14,15 and has been shown to be a barrier to adequate self-management of medication regimens, with less comprehension of medication instructions, dosing, timing, and warnings16-18, which could lead to increased risk for hypoglycemia.

We measured the occurrence of patient-reported significant hypoglycemia in a large, diverse population of medication-treated patients with type 2 diabetes with uniform access to care in an integrated managed care setting. We hypothesized that adults with diabetes would report significant hypoglycemia more often in this observational cohort than previously reported in clinical trials. We hypothesized that even after adjustment for a host of potential confounders, limited health literacy would be associated with hypoglycemia in an observational study of diabetes patients.

METHODS

Study Population

The Diabetes Study of Northern California (DISTANCE) enrolled an ethnically-stratified, random sample of patients from the Kaiser Permanente Northern California (KPNC) Diabetes Registry, a large, ethnically diverse and well-characterized population with diabetes. KPNC is a fully integrated health care delivery system that provides comprehensive medical care to over 3 million members (30% of the entire Northern California population). Except for the extremes of income, the demographic characteristics of KPNC’s patient population are similar to those of the overall population of Northern California19.

The overarching aim of the DISTANCE study (available at http://distancesurvey.org) was to investigate ethnic and educational disparities in diabetes-related behaviors, processes of care and health outcomes. The survey methods and cohort profile have been described previously20. The extensive survey was conducted among an ethnically-stratified, random sample of 40,735 diabetes patients, aged 30–75 at baseline, of known (Caucasian, African-American, Latino, Asian) and unknown ethnicity. Demographic, clinical, health care utilization and census data were obtained from electronic (non-survey) databases for the entire cohort. Briefly, three modes of the DISTANCE Survey were offered to all patients in the sample: self-administered written questionnaire, web-based survey, or computer-assisted telephone interview (CATI) with interviews conducted in English, Spanish, Cantonese, Mandarin or Tagalog.

Surveys were completed by 20,188 patients (62% response rate, according to AAPOR response rate #3 definition21). Respondents were primarily (78%) of minority (non-White) race/ethnicity and varied widely in clinical and behavioral profiles, as well as education, income, wealth, occupation, nativity and neighborhood characteristics. For this analysis, we restricted our sample to respondents with type 2 diabetes (classified using a published algorithm22), since the incidence and mechanism of hypoglycemia may differ from type 1 diabetes23. We included only respondents taking any hyperglycemic medications, since strictly diet-controlled patients are generally not at risk for hypoglycemia24. We were able to obtain complete laboratory, prescription, emergency department and hospital utilization data from Kaiser’s electronic records. This study was approved by the institutional review boards at Kaiser Foundation Research Institute.

Measures

Outcome

We asked participants, “In the past year, how many times have you had a SEVERE low blood sugar reaction, such as passing out or needing help to treat the reaction?” This item was drawn from the widely-used, well-validated Diabetes Care Profile25-27, and is similar to the hypoglycemia reporting items used in landmark diabetes trials and observational studies to identify treatment-related adverse events1,11-13,28. Responses were dichotomized into one or more episodes versus no episode. We considered “don’t know” responses as missing.

Exposure

To obtain self-reported HL, we employed a slightly modified version of a 3-item instrument that asks patients to report problems due to reading, understanding, and filling out forms, not due to poor vision: (a)“How often do you have problems learning about your medical condition because of difficulty understanding written information?”; (b) “How confident are you filling out medical forms by yourself?”; (c) “How often do you have someone like a family member, friend, hospital or clinic worker or caregiver, help you read Kaiser health plan materials (such as written information about your health or care you are offered)?” This instrument has been validated against direct HL measures29,30 in patients with diabetes and across a variety of research settings30-32. In keeping with prior studies, we dichotomized Likert responses into ever having difficulties versus never having difficulties30. We considered “don’t know” responses as missing. Each question was analyzed separately, as the item authors recommend29,30.

Analysis

First, we determined the frequency of reporting one or more episodes of significant hypoglycemia in the overall sample of pharmacologically treated patients with type 2 diabetes, then calculated its frequency across HL levels. Second, we performed an unadjusted logistic regression by regressing significant hypoglycemia on each HL question individually. Third, we performed three separate multivariate logistic regression analyses to assess the possible association of each HL item with hypoglycemia, adjusted for the demographic and clinical characteristics listed below and in Table 1. Because we used a stratified random sample (with over-sampling of racial/ ethnic minority patients), we needed to account for design effects by applying expansion weights (reciprocal of the non-proportional sampling fractions for each race) to multivariate models.

Table 1 Subject Characteristics (N = 14,357)

The multivariable analysis included age, sex, race/ethnicity, non-English language, and household income. Because hypoglycemia may be more common as renal function declines, we also adjusted for the glomerular filtration rate (GFR) using the MDRD equation33. We further adjusted for diabetes duration, hemoglobin A1c (HbA1c), and whether patients perform self-monitoring of blood glucose (SMBG), based on a validated measure constructed from prescription refill rates of glucose test strips22. We used diagnostic codes to adjust for cognitive impairment and dementia (ICD9 2900x, 29020, 2904x, 2941x, 2948x, 2949x, 3310x, 3311x, 33182x, 33183, 78093x), and past history of stroke (ICD9 431.x, 433.x, 434.x, 436.x). Finally, because some medication regimens are known to carry higher risk of hypoglycemia than others, we categorized participants’ medication use, using pharmacy prescription data over the 12 months prior to the survey, as follows: (a) insulin alone or in combination with oral agents; (b) oral secretagogues (such as sulfonylureas) alone; (c) metformin alone; (d) mixed oral agents, and adjusted for type of regimen in all analyses. We also explored the possible contribution of body-mass index, problematic alcohol use, medication adherence (continuous medication gap34), and neuropathy (ICD 9 250.6x) in additional multivariable models.

We wished to address 2 types of response bias: survey non-response and item non-response. For survey non-response, we used the standard Horvitz-Thompson35 approach. This multi-part model, first uses available data to calculate the probability of survey response. The inverse of that fitted non-response probability is then used to weight the complete observations. Even among survey respondents, not all answered all questions in the 52-page survey, leading to some missing values for outcome, exposure (HL), and co-variates. Item non-response is a common problem in lengthy surveys. Analysis restricted to complete cases can introduce bias if the data are not missing completely at random, and also reduce precision36. Therefore, we used multiple imputation, as implemented in SAS Proc MI37. Missing items were imputed ten times under the assumption that they were missing, not completely at random, but at random, given the covariates in the imputation models; then the ten completed datasets were each analyzed using complete data methods, and the results combined using established methods that provide standard errors, confidence intervals and p-values that properly reflect the imputation of the missing items. Imputed values for binary and categorical variables were rounded and truncated to the nearest category38. Final parameter estimates, confidence intervals, and significance tests were calculated using standard methods for combining results across the ten imputed data sets38,39, as implemented in Proc MIANALYZE. In addition, we performed a sensitivity analyses using only complete cases, those for whom no data were missing. Finally, we examined whether the sample included in the current analysis (those with pharmacologically-treated type 2 diabetes), exhibited demographic or clinical differences compared to the survey respondents overall.

Because there may be underreporting of limited HL due to shame16, we performed a sensitivity analysis in which we assumed that those with “don’t know” responses to the HL items had limited HL. We also explored hypothesized interactions between HL and potential effect modifiers including age, diabetes medication treatment, and survey mode by adding cross-product terms to the model specified above. To further evaluate the possibility that inaccurate reporting of hypoglycemia contributed to our findings, we performed a sensitivity analysis involving only the subgroup (94%) that provided a correct answer to a hypoglycemia knowledge item from the DISTANCE survey that asked “If a person with diabetes suddenly gets sweaty, nervous, and shaky, what should he or she do?” Finally, as an exploratory analysis to further validate the outcome assessment, we compared the odds of participants’ making an emergency department visit or requiring a hospitalization for hypoglycemia (International Classification of Disease Codes 250.8, 251.0, 251.1, 251.2) over the 3-year period prior to survey completion between those who did versus did not report significant hypoglycemia in the survey.

RESULTS

Of the 20,188 surveyed, 2,393 were excluded because they completed a short-form of the survey which lacked the HL items. We further excluded 826 because they did not have type 2 diabetes, and 2612 who did not take medication for type 2 diabetes. Thus, our overall sample was the 14,357 responders with pharmacologically treated type 2 diabetes whom we asked about health literacy. Subjects were ethnically-diverse, had long-standing diabetes (average time since diagnosis approximately 10 years) and relatively well-controlled glycemia (average HbA1c of 7.6) (Table 1). The most common medication regimen was mixed oral agents (43%), followed by insulin alone or in combination with oral agents (22%), metformin alone (19%), and secretagogues alone (16%). According to refill rate of glucose test strips, 48% regularly self-monitor their blood glucose (SMBG). Among all respondents, 53% reported problems learning about health, 40% needed help reading healthcare materials, and 32% were not confident with medical forms, due to reading difficulties. We did not observe clinically meaningful differences between the 14,357 we analyzed and the 20,188 survey respondents (see online appendix Table 1).

Overall, 1,579 (11%) of participants reported experiencing at least one significant hypoglycemic episode in the past year. Hypoglycemia occurrence varied by medication regimen, with the highest risk for those on insulin (59%) followed by, mixed oral medication types (23%), secretagogues alone (13%) and metformin alone (5%). Of these participants who reported at least 1 significant hypoglycemic episode, 8% (129/1579) had evidence of a documented emergency department visit or hospitalization for hypoglycemia in the prior year, compared to 1.6% (202/12,777) of the participants who reported not having significant hypoglycemia, yielding an odds ratio of 19.0 (95% CI 13.0–26.0).

A significantly higher proportion of patients reporting limited HL experienced significant hypoglycemia (p for all <0.0001; Figure). This pattern was consistent across all three HL questions, with each accompanying analysis yielding very similar effect sizes (Table 2). These relationships did not change substantively with adjustment for patient factors (age, sex, race/ethnicity, language, income, social support, diabetes factors (glycemic control, diabetes duration, treatment regimen, SMBG practice), and renal function. In additional models further adjusted for body-mass index, alcohol use, medication adherence, and neuropathy, the relationship between HL and hypoglycemia remained unchanged (see online appendix Table 2.) While we found that those with limited HL were more likely than those with adequate HL to respond by CATI than either web or mailed written surveys (p for all <0.001), the relationship between HL and hypoglycemia did not differ significantly across survey modes (p-value for all HL-survey \mode cross-product terms >0.2). In stratified analyses, neither age nor medication type substantively or significantly modified the HL-hypoglycemia relationships. Results did not differ substantively in the complete-case only analysis. In a sensitivity analysis that excluded all participants who did not demonstrate knowledge of hypoglycemia symptoms and treatment, results remained substantively unchanged. When we classified participants who responded “don’t know” to the health literacy questions as limited health literacy, the results did not change. Finally, our results were substantively unchanged in an analysis re-weighted for the inverse probability of survey response (data not shown).

Table 2 Unadjusted and Adjusted Odds Ratios of Experiencing Significant Hypoglycemia (Versus Not) by Self-reported HL

CONCLUSIONS

Among ambulatory type 2 diabetes patients receiving care in a well-integrated, managed-care system, we found that hypoglycemia is a significant problem. To our knowledge, this is the largest observational study in the U.S. to assess significant hypoglycemia. As prior studies would suggest40, the frequency of significant hypoglycemia reported in this population was significantly higher than reported in landmark trials. Annual assistance-requiring hypoglycemia rates range from 0.7 per 100 overall for ADVANCE1 and 5.1% in the standard arm for ACCORD41. In UKPDS, the highest rate of assistance-requiring hypoglycemia was among insulin users in the intensive arm, and was only 1.8%/year1. The prevalence of self-reported hypoglycemia relative to emergency department visits or hospitalizations coded for hypoglycemia suggests that (a) the vast majority of events are cared for outside of the medical setting, (b) clinicians and health systems may not fully appreciate the scope of this problem and that (c) most patients are choosing to self-manage any immediate consequences of hypoglycemia without medical assistance. Whether patients are developing and implementing strategies to avoid future hypoglycemia events on their own, or in consultation with their treating clinicians, is not known.

Hypoglycemia, while an important adverse event in and of itself, contributes to poorer diabetes outcomes in other domains. Recent work has shown that acute care visits for hypoglycemia predict future risk for dementia among type 2 diabetes patients42. Many have suggested that those who experience hypoglycemia may have lower rates of hypoglycemic medication adherence for fear of recurrence43,44.

Significant hypoglycemia was especially common among patients reporting limited HL, and this association persisted even after adjusting for known and suspected correlates of HL and hypoglycemia. There are several possible mechanisms by which limited HL could increase hypoglycemia risk. First, limited HL could lead to patient errors in timing or dosage of diabetes medications16,45. Second, limited HL could interfere with proper adjustment of diabetes medication in response to changing caloric intake or energy expenditure46. Third, those with limited HL may not correctly interpret and respond to their blood glucose values and trends obtained through self-monitoring, potentially missing opportunities to adapt self-management behaviors so as to prevent significant hypoglycemia47. Importantly, mastery of such self-management skills depends, in part, on adequate patient-clinician communication. Limited HL has been shown to impede both patients’ understanding of clinician information and instructions, and patients’ reporting of symptoms and disease state to clinicians18.

Study strengths include a large, diverse population with uniform access to care, and detailed assessments of HL and hypoglycemic events within a real world setting. Nevertheless, this study has several limitations. First, the KPNC system provides coordinated and uniform access to care, including diabetes education and comprehensive care management. As such, our results may under-estimate hypoglycemic event rates in the under- and uninsured,48 or among populations cared for in non-integrated health systems. Second, because this is a cross-sectional analysis, we cannot infer that limited HL was the cause of increased hypoglycemia risk; although reverse causation is improbable, there may be underlying factors affecting both. Third, we did not directly measure HL, although the self-report HL items we used have been validated against direct measurement instruments29,30. Moreover, the degree to which these items exactly correlate with HL as assessed by standard, ‘direct’ measurement may be less relevant in practice, insofar as these questions have predictive validity as they appear to identify subgroups at risk for a clinically important adverse event. Fourth, we did not measure numeracy in this study, so we could not address the relative contribution of numeracy versus literacy. Numeracy and literacy have been shown to be highly correlated. Fifth, we could not capture attendance at diabetes education. Sixth, not all participants answered every question in this lengthy survey (184 questions, 52 pages). Nevertheless, this remains the largest observational study of hypoglycemia, and the subjects included in the analysis did not differ from the overall sample in terms of age, race/ ethnicity, educational attainment, which are the best predictors of health literacy, or HbA1c, renal function, or medication type, the clearest correlates of hypoglycemia. In addition, we used multiple imputation to minimize the bias associated with missing items36,38,39,49. Moreover, results using multiply imputed data did not differ from the complete data-only approach. Seventh, we could not explore individual medications within each class. Finally, consistent with prior studies,1,10-13,50 we obtained measures of hypoglycemia via patient self-report, albeit an imperfect measure. Since self-report of mild hypoglycemia may be less accurate, we queried only clinically significant episodes of losing consciousness or requiring treatment assistance. The fact that we observed a stepwise increase in hypoglycemia consistent with the established pharmacologic risks of hypoglycemia from different medication regimens (i.e., highest in insulin-treated patients) suggests the validity of patients’ reports. We also found that self-report of hypoglycemia was strongly associated with likelihood of making an emergency room visit or requiring hospitalization for hypoglycemia during the year prior to the survey, providing additional validation of this self-reported measure. Furthermore, while it is possible that those with limited HL were more likely to misattribute non-hypoglycemic events to hypoglycemia, the results of our sensitivity analysis that involved only those participants who demonstrated accurate knowledge of hypoglycemia symptoms and treatment suggest that outcome misclassification does not explain our findings. It is theoretically possible that those with limited HL reported more significant hypoglycemia because they may require help for hypoglycemic episodes while those with adequate HL can manage themselves. Such a heightened need for assistance would, in and of itself, place them at greater risk.

Our findings have several clinical and health policy implications. First, while it is unclear whether treating clinicians’ actions (such as intensifying medications or inadequate communication of safety precautions) contributed to these events or whether treating clinicians were aware of patients’ hypoglycemic episodes, our results suggest that hypoglycemic symptoms should be routinely assessed in patients with type 2 diabetes receiving hyperglycemia-lowering agents. Second, because insulin use confers a particularly high risk for hypoglycemia, we recommend formal hypoglycemia prevention counseling that is appropriate for those with limited health literacy, as well as more vigilant self-management support that includes training family members and caregivers, at the time of insulin initiation. More research is needed to (a) identify whether errors in patient self-management are contributing to hypoglycemia, and (b) determine what actions by patients, families, caregivers and clinicians can reduce hypoglycemia. Third, hypoglycemia risk profile should be an important criteria when choosing medication regimen, favoring medications which are least likely to cause hypoglycemia.

Hypoglycemia has been described as a sentinel adverse event7 in type 2 diabetes that should trigger systems-based approach to reduce recurrences. System-level surveillance for hypoglycemia, perhaps through use of patient-directed health information technology, may promote patient safety. Between-visit surveillance mechanisms, utilizing technologies such as interactive voice response technology,30,5,52 personal health internet portals,53-55 or continuous blood glucose monitors56,57 may be more sensitive in capturing hypoglycemia than are current practices in diabetes management. For example, patients receiving periodic automated telephone self-management support for diabetes could input a low blood glucose value into their telephone touchpad, which would lead to a live telephone call with a care manager as well as notification to the primary care provider. Such technologies have the potential to make use of visual and voice modalities so as to be appropriate for those with limited HL, but this requires further investigation. Finally, from a health policy perspective, our results suggest higher rates of hypoglycemia than previously documented, raising the question of whether widely-recommended clinical targets and performance measures derived from efficacy studies, when applied to real world contexts, may jeopardize the safety of many patients with type 2 diabetes3,4.