Adherence to process of care measures was associated with reduced risk of 2 diabetes complications or any of 4 complications in a national industrial cohort.
To examine the association between processes measures of diabetes care and time to progression for 4 diabetes complications: coronary artery disease (CAD), stroke, heart failure (HF), and renal disease (RD).
This retrospective study followed outcomes from 2003 through 2009 in a cohort of 1797 employees with diabetes who worked for a large US manufacturer and were enrolled in the same health insurance plan.
Quality of care was measured by consensus standards for testing glycated hemoglobin, lipids, and microalbuminuria. Employees with diabetes who received all 3 measures of care in the baseline year (2003) were compared with those who received less complete testing. Cox proportional hazard regression models were used to assess potential associations between diabetes care and time to complications, controlling for potential confounders.
Observed differences between the 2 groups in time to event were significant for 2 of the 4 complications: HF (hazard ratio [HR] = 0.39, 95% confidence interval [CI], 0.19-0.81; P = .0117) and RD (HR = 0.48, 95% CI, 0.24-0.95; P = .0339) and any of the 4 complications (HR = 0.66, 95% CI, 0.48-0.91; P = .0101). Differences in time to complication for CAD (HR = 0.70, 95% CI, 0.49-1.02; P = .0635) and stroke (HR = 0.63, 95% CI, 0.38-1.07; P = .0891) showed the same trend but were not significant.
Employees with diabetes who received all 3 quality measures experienced fewer complications, risk-adjusting for other factors. These results provide support for the importance of care quality.
Am J Manag Care. 2014;20(1):41-52The proportion of patients with diabetes receiving standard processes of care based on systematic reviews is disturbingly low and in our fully insured population is just under 15%.
In 2010, the estimated prevalence of diabetes among adults ranged from 5% to 13% across the United States and its territories,1 accounting for substantial morbidity, mortality, and associated economic costs.2,3 Type 2 diabetes mellitus often develops 9 to 12 years before diagnosis4 and more than 50% of patients have at least 1 complication by that time.5 A significant body of research has established that effective treatments can significantly decrease the development and/or progression of complications.6-17
However, diabetes care remains suboptimal and varied in the United States.18-22 In an effort to improve outcomes, The National Diabetes Quality Improvement Project (1997) developed a comprehensive set of process and intermediate outcome measures to assess quality of care for diabetes patients that are now considered standards of care.20,23 These measures include annual screenings for lipids and microalbuminuria, at least 2 measurements of glycated hemoglobin (A1C) at least 30 days apart, and annual flu vaccinations, dilated eye exams, and foot examinations.23
A number of studies1,7,18,20-32 have used these performance measures to assess care provided to patients with diabetes. These studies provide evidence of the substantial gaps between national performance measures for diabetes care and actual care received by persons with diabetes in the United States.26
The present study examines 3 process measures of diabetes care: A1C tests, lipid tests, and urine screening tests for microalbuminuria; and their association with 4 subsequent complications of diabetes: coronary artery disease (CAD), stroke, heart failure (HF), and renal disease (RD); in a cohort of employees of a large national manufacturing company. This cohort provides an opportunity to study this issue in a geographically, ethnically, and socioeconomically diverse population with rich and uniform healthcare benefits. This study contributes to the literature by identifying systematic reasons for differences in care among privately insured Americans and examining whether adherence to recommended processes of care is associated with better outcomes.26,33
The study setting was a large (approximately 36,000 employees) US-based manufacturing company with uniform healthcare benefits in 22 states that generated claims data during the years of the study. We examined the relationships between the 3 measures of the quality of diabetes care and the risk of major diabetes complications to determine whether employees with diabetes who received all 3 quality-of-care measures in a baseline year (2003) demonstrated a lower risk for developing any of 4 complications over the 6-year observation period (2004-2009). Baseline characteristics suspected to impact outcome risk and/or likelihood of receiving optimal care included in the multivariate model were age, sex, ethnicity, marital status, income, insulin use, comorbidities, and smoking. Due to data limitations, we were unable to assess the possible confounding roles of obesity and duration of diabetes. Data on annual flu vaccinations, dilated eye exams, and foot examinations were not available; thus, these elements were not included in our model.
This was a retrospective cohort study using administrative data on employees collected between January 1, 2001, and December 31, 2009. The majority of the employees held hourly manufacturing jobs; minorities and women were well represented. Although employees could select from a menu of health benefits, only a single preferred provider organization (PPO) network was available to the entire population. Employees who did not opt for this PPO were excluded (3%). The panel was restricted to those employed by the manufacturer for some part of 2001 and 2002, and for all of 2003, the year during which quality of care measures were assessed. Health outcomes were assessed from claims between January 1, 2004, and December 31, 2009.
During the “lead-in” period (2001-2002), diabetes status was ascertained from the claims data based on International Classification of Diseases, Ninth Revision (ICD-9) codes for the condition on a submitted medical claim for at least 1 of the following: a hospitalization, emergency department visit, 2 office visits, or 1 prescription for a diabetes-specific medication. Participants were included in the final data set if they were between 18 and 64 years old and employed throughout 2003 and for at least 1 month in the observation period (2004-2009). Employees with diabetes who had any 1 of the 4 end point complications coded in a medical claim in 2001 or 2002 and women with a claim containing an ICD-9 code for gestational diabetes were excluded. Those with claims for 1 of the 4 complications in the baseline year (2003) were included in the panel, but were excluded from the analysis for that complication. A total of 1797 subjects were available for analysis.
Process measures of diabetes care (ie, 2 A1C tests at least 30 days apart and at least 1 test each for lipids and microalbuminuria) were assessed in the baseline year (2003).34 Each employee with diabetes was categorized into 1 of 2 mutually exclusive groups: those who received all 3 measures of care in 2003 and those who did not. Cox proportional hazard regression models were used to assess the associations between diabetes care and time to each of the 4 complications (CAD, stroke, HF, and RD) or any of the 4 complications.
The databases available for analysis have been described in detail in previous publications.35 Briefly, health data were obtained from the health insurance plan, extraction of onsite occupational health medical records available for about 40% of the locations, and other linked employer-managed administrative databases. Data included ICD-9 codes from the Chronic Condition Data Warehouse list36 for disease diagnosis and National Drug Codes37 for prescription information. End point complications were identified based on ICD-9 codes during a face-to-face exam or hospitalization. For end point data, the subset of ICD-9 codes from the Chronic Condition Data Warehouse list for causes of kidney disease and heart disease unrelated to diabetes (eg, infectious or genetic etiology) were excluded. Demographic and health behavior data were obtained from the health medical record and human resources databases.
Vision claims were not available. Therefore, claims for routine eye exams and screening for diabetic retinopathy were not usable as measures of quality of diabetes care.
Sightlines DxCG Risk Solutions software (Verisk Analytics, Jersey City, New Jersey) was used to assign risk scores to the cohort during the baseline assessment and capture potential illness-related influences on treatment decisions. This actuarial program uses medical and pharmacy data with proprietary risk-adjustment algorithms to predict future health spending, and its risk scores are comparable to similar scores used by the Centers for Medicare & Medicaid Services and other insurance bodies for global risk estimates. A score of 1 in 2003 implies an actuarial prediction that an individual would consume the median amount of healthcare or the population in 2004. Databases were linked by an encrypted unique identifier to ensure human subject privacy. This study was approved by the authors’ institutional review boards.
Hazard ratios for each outcome (CAD, stroke, HF, RD, and any of the 4 conditions) were calculated for quality of diabetes care (exposures) and covariates. Time to event, defined as the number of months from the start of the observation period (January 1, 2004) to the first medical claim for a complication, was used for all primary analyses. Employees with diabetes who no longer received employer-provided health benefits were censored at the time of their last month of coverage. Records (n = 901) were censored during the observation period for the following reasons: retirement, layoff or termination (n = 647), change from PPO to health maintenance organization or Consolidated Omnibus Budget Reconciliation Act (COBRA) coverage (n = 77), and death or long-term disability (n = 30). For 119 subjects, the reason for loss of coverage could not be definitely established from the available records. Differences between the baseline characteristics of censored and uncensored employees were assessed with x2 tests. The Kaplan-Meier method was used to identify crude time-to-event models for the associations between the exposure and outcome measures.
Cox proportional hazard models were used to evaluate bivariate and multivariate association, which enabled time-to-outcome assessment with risk adjustment based on socioeconomic and lifestyle risk factors, comorbidities, and severity of diabetes. The base model, calculating time to event as a function of quality of care, was specified with demographic covariates. Covariates including modifiable risks (smoking), clinical characteristics (insulin use and health severity risk score), and socioeconomic status indicators (individual income, job status [hourly or salary], and marital status) were then added to the base model. Finally, the fully adjusted model was used to assess the combined explanatory effects for all measured factors. Hazard ratios (HRs) for primary outcomes were calculated based on Cox proportional hazard analyses stratified by hourly job status, salary, sex, and insulin use. As a sensitivity test, kappa statistics, correlation analyses, and Cox proportional hazard analyses were used to assess outcome differences based on 2 years (2003 and 2004) of continuous high-quality care (leaving 2005-2009 available for outcome observation). Other sensitivity tests included looking at each stratum of sex, job status, and insulin use in the full model. All analyses were conducted using SAS version 9.2 (SAS Institute Inc, Cary, North Carolina).
A total of 1797 patients met criteria for inclusion. The cohort consisted primarily of white (69.2%), male (83.1%), married (74.2%), hourly employees (75.7%), a significant number of whom earned less than $35,423 per year (27.2%). More than half (55.1%) were between the ages of 18 and 51 years. The mean age for the total population was 49.0 years (standard deviation = 8.4). Smoking data were reported as never (14.4%), past/current (17.3%), and unknown (68.3%). The unknown group represents primarily locations for which health medical record data were unavailable. As a measure of diabetes severity, 20.1% of the population had insulin prescriptions during the baseline year. Health severity risk scores were also used to assess comorbidities, with 75.1% of the cohort receiving a score of 2.1 or lower (1 = average health risk spending probability, 2 = risk likelihood of double the average health expenditures). Regarding the quality of diabetes care process measures, a majority of patients received at least 1 A1C test (67.6%) and lipid testing (61.8%) in the baseline year. Other measures of care were less common: 43% of patients had at least 2 tests for A1C and only 24.0% were tested for microalbuminuria in the baseline year.
Characteristics of the baseline sample are shown in ; the same subjects stratified by treatment status are shown in . At baseline, the group receiving all 3 process measures was smaller (n = 267) than the comparison group (n = 1530). Differences between the 2 groups were assessed with 2-tailed t tests for independent samples. Despite the sample size differences, there were no statistically significant differences between the 2 groups during the baseline period (2003) for demographic, socioeconomic status, or modifiable risk variables. However, there was evidence that the group receiving all 3 process measures was sicker at baseline. They were significantly more likely to be receiving insulin than the comparison group (27.7% vs 18.8%; P = .0007) and were also more likely to fall into the higher quartiles of health severity risk score (P = .043).
shows the characteristics of those who were censored compared with those who remained in employment throughout the follow-up period. Although workers who left were older and less well paid on average at baseline, differences between censored employees and non-censored employees were not significant for race, marital status, occupational group (salary or hourly), insulin use, health severity risk score, and importantly, likelihood of receiving the treatment.
In total, 366 persons with diabetes (20%, n = 1797) had medical claims for at least 1 of the 4 complications with a mean time to complication of 29.1 months. The most frequent complication in the cohort was CAD (16.9%) with a mean time to complication of 26.6 months, followed by stroke (8.7%, 33.1 months), HF (5.8%, 29.7 months), and RD (4.9%, 38.1 months). Those getting all 3 process measures of care fared better for all end points. Hazard ratios for 2 of the 4 complications were significant: HF (HR = 0.39, 95% confidence interval [CI], 0.19-0.81; P = .012) and RD (HR = 0.48, 95% CI, 0.24-0.95; P = .034). The HRs for CAD (HR = 0.70, 95% CI, 0.49-1.02; P = .064) and stroke (HR = 0.63, 95% CI, 0.38-1.07; P = .089) showed the same trend but were not significant. Hazard ratios with CIs for each and any of the 4 end points are summarized in .
The HR for submitting a medical claim for any of the 4 complications was significantly lower for those receiving all 3 process measures (HR = 0.66, 95% CI, 0.48-0.91; P = .01). Covariates associated with increased risk included increasing age 46-51 years (HR = 1.88, 95% CI, 1.36-2.61; P = .0001), 52-56 years (HR = 2.06, 95% CI, 1.47-2.89; P <.0001), and 57-64 years (HR = 3.09, 95% CI, 2.15-4.46; P <.0001); health severity risk scores of 2.1 or higher (HR = 1.91, 95% CI, 1.36-2.68; P = .0002); and smoking (HR = 1.44, 95% CI, 1.01-2.07; P = .047). Differences in all other covariates were not statistically significant. The Kaplan-Meier estimates of cumulative hazards for all end points are depicted in through .
We conducted 2 sensitivity analyses. The first used 2 years (2003 and 2004) of continuous process of care measures to reduce the likelihood of random misclassification. Results showed the same trends and similar point estimates (data not shown), although with shorter follow-up (2005-2009) these results were no longer significant. Likewise we tested for robustness within strata by sex, hourly versus salaried job status, and initial insulin use. Results revealed comparable point estimates for all strata with the exception of the women, in whom HR estimates for each complication hovered around 1. In general, the point estimates within strata were similar to those found for the full cohort, but with wider CIs.
This study compared 2 groups of employees with diabetes to assess how differences in process measures of care might have affected the onset of complications associated with diabetes. Significant differences in time to complication were observed between the 2 groups for 2 of the 4 complications (HF and RD) and for any of the 4 complications. Remarkably, those employees getting optimal process scores were, on average, sicker at the outset based on greater insulin use and increased risk severity scores; hence, they would have been expected a priori to have worse outcomes.
Many studies have assessed whether interventions at the provider level improve processes of care and intermediate outcomes, but the effect of such process improvements on complications remains less clear because the outcomes themselves are rarely assessed.38 This study estimates the impact of process measures of quality care by analyzing data in a national sample across multiple physician groups administering diabetes care within the same health insurance plan structure. This study is the first to our knowledge confirming, in practice, the expectations for benefit from compliance with recommended process measures of care in which follow-up was long enough to observe the major clinical end points of interest.
That said, there remain significant limitations to our methods and our ability to draw causal inference from the results. We relied on claims data for recognition of our population with diabetes, for ascertainment of complications, and for assessment of the critical covariate of interest—execution of all of the quality of care diagnostic measures in the baseline year. Each step entails opportunity for misclassification. Although the diagnosis of diabetes is readily inferred from claims with high sensitivity and specificity,39 comparable data comparing claims with verifiable sources such as medical records or examinations do not exist for any of the major complications with the exception of RD,40 which has been found to be identified with high specificity but less sensitivity than diabetes. That would not, however, bias our findings for patients who had been identified as having RD. Thus, it is possible that the end points misclassified cohort members in both directions and that some with complications already evident were not appropriately excluded. The impact of such misclassifications, assuming they were random, would likely drive our result toward the null, but there is no assurance that such errors were random.
Another concern is the impact on our conclusions of unobserved variables (eg, body mass index, duration of diabetes) as noted above. Although there is no strong prior reason to suspect that such variables were distributed in such a way as to confound our result, more obese subjects might have received consistently poorer care and, independently, had a higher risk of bad outcomes. The impact of censorship may also have resulted in possible bias, as those faring most poorly might be expected to leave prematurely more often. It is reassuring that censorship was not associated with baseline characteristics of disease severity nor with treatment group, but the size of loss—more than half of the cohort—introduces concern for unmeasured bias.
The employees in this study may not represent a generalizable population, as they work for a stable employer with rich and uniform benefits in the heavy manufacturing sector, both less common features than a generation ago. Our study panel requirements demanded a group stably employed during a period of years, further rendering it less representative of the larger workforce.
Perhaps most difficult to fully address is the possibility of endogenous differences among persons with diabetes leading some to both seek better care for their disease—picking better qualified doctors and/or advising them what tests to order—and take better are of themselves in other ways, collectively resulting in better outcomes. Nonetheless, it is noteworthy that in the primary test of the hypothesis, the baseline characteristics created an uneven playing field, with more ostensibly sick patients having a higher rate of better care; thus, the deck was stacked against those with better care having better outcomes, an effect that began to be visually apparent in the third observation year (see Figure 5). It is also reassuring that our result survived the various sensitivity tests. We are exploring instrumental variables and other approaches to examine the causal pathway further, including assessment of the relationships between the process measures and intermediate outcomes such as medication change, adherence, frequency of exams, and the like.
Limitations notwithstanding, these results provide further support for process measures and efforts to promote their application in practice, starting with the obvious; the proportion of employees with diabetes getting the standard of care based on systematic reviews1,38 was disturbingly low (just under 15%) in our fully insured population. If even a modest portion of the association with outcome is causal, there is a considerable opportunity for benefit from driving better processes of care.Author Affiliations: From Alcoa Aluminum (FJB), Pittsburgh, PA; Yale Occupational & Environmental Medicine (DG, MS, OT), Yale School of Medicine, New Haven, CT; Stanford University School of Medicine (IMC, MRC), General Medical Disciplines, Stanford, CA.
Author Disclosures: Dr Bayer reports employment with Alcoa Aluminum, who provided data for this study. The other authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (FJB, DG, MS, OT, MRC); acquisition of data (FJB, MRC); analysis and interpretation of data (FJB, DG, MS, IMC, OT, MRC); drafting of the manuscript (FJB, IMC, MRC); critical revision of the manuscript for important intellectual content (FJB, DG, IMC, OT, MRC); statistical analysis (FJB, DG, MS, MRC); provision of study materials or patients (FJB); obtaining funding (FJB, MRC); administrative, technical, or logistic support (FJB, IMC); and supervision (MRC).
Financial Source: This study was supported by National Institutes for Health grant 5RO1AG026291-04 and continuing support from Alcoa Aluminum. The funders had no role in the design of this study; collection, management, analysis, and interpretation of the data; conduct of this study; or preparation or approval of the manuscript. Alcoa Aluminum reviewed the manuscript prior to publication.
Address correspondence to: Mark R. Cullen, MD, Stanford University School of Medicine, General Medical Disciplines, 1265 Welch Rd, MSOB X-338, Stanford, CA 94305. E-mail: firstname.lastname@example.org. Chowdhury P, Balluz L, Town M, et al; Centers for Disease Control and Prevention (CDC). MMWR: Surveillance of certain health behaviors and conditions among states and selected local areas—Behavioral Risk Factor Surveillance System, United States, 2007. MMWR Surveill Summ. 2010;59(SS-1):1-220.
2. Saydah SH, Fradkin J, Cowie CC. Poor control of risk factors for vascular disease among adults with previously diagnosed diabetes. JAMA. 2004;291(3):335-342.
3. American Diabetes Association. Economic costs of diabetes in the U.S. in 2007 [published correction appears in Diabetes Care. 2008;31(6): 1271]. Diabetes Care. 2008;31(3):596-615.
4. Lillioja S, Mott DM, Spraul M, et al. Insulin resistance and insulin secretory dysfunction as precursors of non-insulin-dependent diabetes mellitus: prospective study of Pima Indians. N Engl J Med. 1993;329(27): 1988-1992.
5. Rodbard HW, Blonde L, Braithwaite SS, et al; AACE Diabetes Mellitus Clinical Practice Guidelines Task Force. American Association of Clinical Endocrinologists medical guidelines for clinical practice for the management of diabetes mellitus. Endocr Pract. 2007;13(suppl 1):1-68.
6. Diabetes Control and Complications Trial and Research Group. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med. 1993;329(14):977-986.
7. The Diabetes Control and Complications Trial Research Group. Lifetime benefits and costs of intensive therapy as practiced in the diabetes control and complications trial [published correction appears in JAMA. 1997;278(1):25]. JAMA. 1996;276(17):1409-1415.
8. Epidemiology of Diabetes Interventions and Complications (EDIC). Design, implementation, and preliminary results of a long-term followup of the Diabetes Control and Complications Trial cohort. Diabetes Care. 1999;22(1):99-111.
9. Early Treatment Diabetic Retinopathy Study Research Group. Early photocoagulation for diabetic retinopathy: ETDRS report number
9. Ophthalmology. 1991;98(5 suppl):766-785.
10. Goldberg RB, Mellies MJ, Sacks FM, et al; the Care Investigators. Cardiovascular events and their reduction with pravastatin in diabetic and glucose-intolerant myocardial infarction survivors with average cholesterol levels: subgroup analyses in the cholesterol and recurrent events (CARE) trial. Circulation. 1998;98(23):2513-2519.
11. Knowler WC, Barrett-Connor E, Fowler SE, et al; Diabetes Prevention Program Research Group. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002; 346(6):393-403.
12. Litzelman DK, Slemenda CW, Langefeld CD, et al. Reduction of lower extremity clinical abnormalities in patients with non-insulindependent diabetes mellitus: a randomized, controlled trial. Ann Intern Med. 1993;119(1):36-41.
13. Heart Outcomes Prevention Evaluation Study Investigators. Effects of ramipril on cardiovascular and microvascular outcomes in people with diabetes mellitus: results of the HOPE study and MICRO-HOPE substudy. Lancet. 2000;355(9200):253-259.
14. Ohkubo Y, Kishikawa H, Araki E, et al. Intensive insulin therapy prevents the progression of microvascular complications in Japanese patients with non-insulin dependent diabetes mellitus: a randomized prospective 6-year study. Diabetes Res Clin Pract. 1995;28(2):103-117.
15. Stratton IM, Adler AI, Neil HA, et al. Association of glycaemia with macrovascular and microvascular complications of type 2 diabetes (UKPDS 35): prospective observational study. Br Med J. 2000;321(7258): 405-412.
16. UK Prospective Diabetes Study (UKPDS). Group Intensive bloodglucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications with type 2 diabetes (UKPDS 33) [published correction appears in Lancet. 1999;354(9178):602]. Lancet. 1998;352(9131):837-853.
17. UK Prospective Diabetes Study Group. Cost effectiveness analysis of improved blood pressure control in hypertensive patients with type 2 diabetes: UKPDS 40. BMJ. 1998;317(7160):720-726.
18. Beckles GL, Engelgau MM, Narayan KM, Herman WH, Aubert RE, Williamson DF. Population-based assessment of the level of care among adults with diabetes in the U.S. Diabetes Care. 1998;21(9): 1432-1438.
19. CDC Diabetes Cost-Effectiveness Study Group, Centers for Disease Control and Prevention. The cost-effectiveness of screening for type 2 diabetes [published correction appears in JAMA. 1999;281(4):325]. JAMA. 1998;280(20):1757-1763.
20. Fleming BB, Greenfield S, Engelgau MM, Pogach LM, Clauser SB, Parrott MA. The Diabetes Quality Improvement Project: moving science into health policy to gain an edge on the diabetes epidemic. Diabetes Care. 2001;24(10):1815-1820.
21. Kenny SJ, Smith PJ, Goldschmid MG, Newman JM, Herman WH. Survey of physician practice behaviors related to diabetes mellitus in the U.S; physician adherence to consensus recommendations. Diabetes Care. 1993;16(11):1507-1510.
22. Saaddine JB, Cadwell B, Gregg EW, et al. Improvements in diabetes processes of care and intermediate outcomes: United States, 1988- 2002. Ann Intern Med. 2006;144(7):465-474.
23. American Diabetes Association. Standards of medical care in diabetes [published correction appears in Diabetes Care. 2005;28(4):990]. Diabetes Care. 2005;28(suppl 1):S4-S36.
24. Grant RW, Buse JB, Meigs JB; University HealthSystem Consortium (UHC) Diabetes Benchmarking Project Team. Quality of diabetes care in U.S. academic medical centers. Diabetes Care. 2005;28(2): 337-442.
25. Imperatore G, Cadwell BL, Geiss L, et al. Thirty-year trends in cardiovascular risk factor levels among US adults with diabetes: National Health and Nutrition Examination Surveys, 1971-2000. Am J Epidemiol. 2004;160(6):531-539.
26. Jencks SF, Huff ED, Cuerdon T. Change in the quality of care delivered to Medicare beneficiaries, 1998-1999 to 2000-2001 [published correction appears in JAMA. 2002;289(20):2649]. JAMA. 2003;289(3): 305-312.
27. Koro CE, Bowlin SJ, Bourgeois N, Fedder DO. Glycemic control from 1988 to 2000 among U.S. adults diagnosed with type 2 diabetes: a preliminary report. Diabetes Care. 2004;27(1):17-20.
28. Mangione CM, Gerzoff RB, Williamson DF, et al; TRIAD Study Group. The association between quality of care and the intensity of diabetes disease management programs. Ann Intern Med. 2006;145(2): 107-116.
29. McClain MR, Wennberg DE, Sherwin RW, Steinmann WC, Rice JC. Trends in the diabetes quality improvement project measures in Maine from 1994 to 1999. Diabetes Care. 2003;26(3):597-601.
30. Roubideaux Y, Buchwald D, Beals J, et al. Measuring the quality of diabetes care for older American Indians and Alaska Natives. Am J Public Health. 2004;94(1):60-65.
31. Sawin CT, Walder DJ, Bross DS, Pogach LM. Diabetes process and outcome measures in the Department of Veterans Affairs. Diabetes Care. 2004;27(suppl 2):B90-B94.
32. Selby JV, Swain BE, Gerzoff RB, et al; TRIAD Study Group. Understanding the gap between good processes of diabetes care and poor intermediate outcomes: Translating Research into Action for Diabetes (TRIAD). Med Care. 2007;45(12):1144-1153.
33. US Department of Health and Human Services. Health Communication. Washington, DC: US Department of Health and Human Services; 2010. Healthy People 2010; vol 1.
34. American Diabetes Association. Standards of medical care for patients with diabetes mellitus [published correction appears in Diabetes Care. 2003;26(3):972]. Diabetes Care. 2003;26(suppl ):S33-S50.
35. Cullen MR, Vegso S, Cantley L, et al. Use of medical insurance claims data for occupational health research. J Occup Environ Med. 2006;48(10): 1054-1061.
36. Chronic Condition Data Warehouse. CMS Chronic Condition Data Warehouse Condition Categories. http://www.ccwdata.org/cs/groups/public/documents/document/ccw_conditioncategories.pdf. Published October 2010. Accessed November 23, 2013.
37. US Food and Drug Administration. National Drug Code Directory. http://www.accessdata.fda.gov/scripts/cder/ndc/default.cfm. Current through September 17, 2013. Accessed November 23, 2013.
38. Renders CM, Valk GD, Griffin SJ, Wagner EH, Eijk Van JT, Assendelft WJ. Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review. Diabetes Care. 2001;24(10):1821-1833.
39. Miller DR, Safford MM, Pogach LM. Who has diabetes? best estimates of diabetes prevalence in the Department of Veterans Affairs based on computerized patient data. Diabetes Care. 2004;27(suppl 2): B10-B21.
40. Kern EF, Maney M, Miller DR, et al. Failure of ICD-9-CM codes to identify patients with comorbid chronic kidney disease in diabetes. Health Serv Res. 2006;41(2):564-580.