Currently Viewing:
The American Journal of Managed Care January 2014
Patient-Centered Medical Home Transformation With Payment Reform: Patient Experience Outcomes
Leonie Heyworth, MD, MPH; Asaf Bitton, MD, MPH; Stuart R. Lipsitz, ScD; Thad Schilling, MD, MPH; Gordon D. Schiff, MD; David W. Bates, MD, MSc; and Steven R. Simon, MD, MPH
Currently Reading
Process of Care Compliance Is Associated With Fewer Diabetes Complications
Felicia J. Bayer, PhD; Deron Galusha, MS; Martin Slade, MPH; Isabella M. Chu, MPH; Oyebode Taiwo, MBBS, MPH; and Mark R. Cullen, MD
Electronic Health Risk Assessment Adoption in an Integrated Healthcare System
Diana S. M. Buist, PhD, MPH; Nora Knight Ross, MA; Robert J. Reid, MD, PhD; and David C. Grossman, MD, MPH
Comorbidities and Cardiovascular Disease Risk in Older Breast Cancer Survivors
Reina Haque, PhD, MPH; Marianne Prout, MD; Ann M. Geiger, PhD; Aruna Kamineni, PhD; Soe Soe Thwin, PhD; Chantal Avila, MA; Rebecca A. Silliman, MD, PhD; Virginia Quinn, PhD; and Marianne Ulcickas Yood
The Effects of Federal Parity on Substance Use Disorder Treatment
Susan H. Busch, PhD; Andrew J. Epstein, PhD; Michael O. Harhay, MPH; David A. Fiellin, MD; Hyong Un, MD; Deane Leader Jr, DBA, MBA; and Colleen L. Barry, PhD, MPP
Evaluation of Electronic Medical Record Administrative Data Linked Database (EMRALD)
Karen Tu, MD, MSc; Tezeta F. Mitiku, BSc, MSc; Noah M. Ivers, MD; Helen Guo, BSc, MSc; Hong Lu, PhD; Liisa Jaakkimainen, MD, MSc; Doug G. Kavanagh, BSEng, MD; Douglas S. Lee, MD, PhD; and Jack V. Tu,
Specialist Participation in Healthcare Delivery Transformation: Influence of Patient Self-Referral
Oluseyi Aliu, MD, MS; Gordon Sun, MD, MS; James Burke, MD, MS; Kevin C. Chung, MD, MS; and Matthew M. Davis, MD, MAPP
Optimal Management of Diabetes Among Overweight and Obese Adults
Denison S. Ryan, MPH; Karen J. Coleman, PhD, MS; Jean M. Lawrence, ScD, MPH, MSSA; Teresa N. Harrison, SM; and Kristi Reynolds, PhD, MPH
Why Are Medicare and Commercial Insurance Spending Weakly Correlated?
Laurence C. Baker, PhD; M. Kate Bundorf, PhD; and Daniel P. Kessler, JD, PhD

Process of Care Compliance Is Associated With Fewer Diabetes Complications

Felicia J. Bayer, PhD; Deron Galusha, MS; Martin Slade, MPH; Isabella M. Chu, MPH; Oyebode Taiwo, MBBS, MPH; and Mark R. Cullen, MD
Adherence to process of care measures was associated with reduced risk of 2 diabetes complications or any of 4 complications in a national industrial cohort.
Characteristics of the baseline sample are shown in Table 1; the same subjects stratified by treatment status are shown in Table 2. At baseline, the group receiving all 3 process measures was smaller (n = 267) than the comparison group  (n = 1530). Differences between the 2 groups were assessed with 2-tailed t tests for independent samples. Despite the sample size differences, there were no statistically significant differences between the 2 groups during the baseline period (2003) for demographic, socioeconomic status, or modifiable risk variables. However, there was evidence that the group receiving all 3 process measures was sicker at baseline. They were significantly more likely to be receiving insulin than the comparison group (27.7% vs 18.8%; P = .0007) and were also more likely to fall into the higher quartiles of health severity risk score (P = .043).

Table 3 shows the characteristics of those who were censored compared with those who remained in employment throughout the   follow-up period. Although workers who left were older and less well paid on average at baseline, differences between censored employees and non-censored employees were not significant for race, marital status, occupational group (salary or hourly), insulin use, health severity risk score, and importantly, likelihood of receiving the treatment.

In total, 366 persons with diabetes (20%, n = 1797) had medical claims for at least 1 of the 4 complications with a mean time to complication of 29.1 months. The most frequent complication in the cohort was CAD (16.9%) with a mean time to complication of 26.6 months, followed by stroke (8.7%, 33.1 months), HF (5.8%, 29.7 months), and RD (4.9%, 38.1 months). Those getting all 3 process measures of care fared better for all end points. Hazard ratios for 2 of the 4 complications were significant: HF (HR = 0.39, 95% confidence interval [CI], 0.19-0.81; P = .012) and RD (HR = 0.48, 95% CI, 0.24-0.95; P = .034). The HRs for CAD (HR = 0.70, 95% CI, 0.49-1.02; P = .064) and stroke (HR = 0.63, 95% CI, 0.38-1.07; P = .089) showed the same trend but were not significant. Hazard ratios with CIs for each and any of the  4 end points are summarized in Table 4.

The HR for submitting a medical claim for any of the 4 complications was significantly lower for those receiving all 3 process measures (HR = 0.66, 95% CI, 0.48-0.91; P = .01). Covariates associated with increased risk included increasing age 46-51 years (HR = 1.88, 95% CI, 1.36-2.61; P = .0001), 52-56 years (HR = 2.06, 95% CI, 1.47-2.89; P <.0001), and 57-64 years (HR = 3.09, 95% CI, 2.15-4.46; P <.0001); health severity  risk scores of 2.1 or higher (HR = 1.91, 95% CI, 1.36-2.68; P = .0002); and smoking (HR = 1.44, 95% CI, 1.01-2.07; P = .047).  Differences in all other covariates were not statistically significant. The Kaplan-Meier estimates of cumulative hazards for all end points are depicted in Figures 1 through 5.

We conducted 2 sensitivity analyses. The first used 2 years (2003 and 2004) of continuous process of care measures to reduce the likelihood of random misclassification. Results showed the same trends and similar point estimates (data not shown), although with shorter follow-up (2005-2009) these results were no longer significant. Likewise we tested for robustness within strata by sex, hourly versus salaried job status, and initial insulin use. Results revealed comparable point estimates for all strata with the exception of the women, in whom HR estimates for each complication hovered around 1. In general, the point estimates within strata were similar to those found for the full cohort, but with wider CIs.


This study compared 2 groups of employees with diabetes to assess how differences in process measures of care might have affected the onset of complications associated with diabetes. Significant differences in time to complication were observed between the 2 groups for 2 of the 4 complications  (HF and RD) and for any of the 4 complications. Remarkably, those employees getting optimal process scores were, on average, sicker at the outset based on greater insulin use and increased risk severity scores; hence, they would have been expected a priori to have worse outcomes.

Many studies have assessed whether interventions at the provider level improve processes of care and intermediate outcomes, but the effect of such process improvements on complications remains less clear because the outcomes themselves are rarely assessed.38 This study estimates the impact of process measures of quality care by analyzing data in a national sample across multiple physician groups administering diabetes care within the same health insurance plan structure. This study is the first to our knowledge confirming, in practice, the expectations for benefit from compliance with recommended process measures of care in which follow-up was long enough to observe the major clinical end points of interest.

That said, there remain significant limitations to our methods and our ability to draw causal inference from the results. We relied on claims data for recognition of our population with diabetes, for ascertainment of complications, and for assessment of the critical covariate of interest—execution of all of the quality of care diagnostic measures in the baseline year. Each step entails opportunity for  misclassification. Although the diagnosis of diabetes is readily inferred from claims with high sensitivity and specificity,39 comparable data comparing claims with verifiable sources such as medical records or examinations do not exist for any of the major complications with the exception of RD,40 which has been found to be identified with high specificity but less sensitivity than diabetes. That would not, however, bias our findings for patients who had been identified as having RD. Thus, it is possible that the end points misclassified cohort members in both directions and that some with complications already evident were not appropriately excluded. The impact of such misclassifications, assuming they were random, would likely drive our result toward the null, but there is no assurance that such errors were random.

Another concern is the impact on our conclusions of unobserved variables (eg, body mass index, duration of diabetes) as noted above. Although there is no strong prior reason to suspect that such variables were distributed in such a way as to confound our  result, more obese subjects might have received consistently poorer care and, independently, had a higher risk of bad outcomes. The impact of censorship may also have resulted in possible bias, as those faring most poorly might be expected to leave prematurely more often. It is reassuring that censorship was not associated with baseline characteristics of disease severity nor  with treatment group, but the size of loss—more than half of the cohort—introduces concern for unmeasured bias.

The employees in this study may not represent a generalizable population, as they work for a stable employer with rich and uniform benefits in the heavy manufacturing sector, both less common features than a generation ago. Our study panel requirements demanded a group stably employed during a period of years, further rendering it less representative of the larger workforce.

Perhaps most difficult to fully address is the possibility of endogenous differences among persons with diabetes leading some to both seek better care for their disease—picking better qualified doctors and/or advising them what tests to order—and take better are of themselves in other ways, collectively resulting in better outcomes. Nonetheless, it is noteworthy that in the primary test of  the hypothesis, the baseline characteristics created an uneven playing field, with more ostensibly sick patients having a higher rate of better care; thus, the deck was stacked against those with better care having better outcomes, an effect that began to be visually apparent in the third observation year (see Figure 5). It is also reassuring that our result survived the various sensitivity tests. We are exploring instrumental variables and other approaches to examine the causal pathway further, including assessment of the relationships between the process measures and intermediate outcomes such as medication change, adherence, frequency of exams, and the like.


Limitations notwithstanding, these results provide further support for process measures and efforts to promote their application in  practice, starting with the obvious; the proportion of employees with diabetes getting the standard of care based on systematic  reviews1,38 was disturbingly low (just under 15%) in our fully insured population. If even a modest portion of the association with outcome is causal, there is a considerable opportunity for benefit from driving better processes of care.

Author Affiliations: From Alcoa Aluminum (FJB), Pittsburgh, PA; Yale Occupational & Environmental Medicine (DG, MS, OT), Yale School of Medicine, New Haven, CT; Stanford University School of Medicine (IMC, MRC), General Medical Disciplines, Stanford, CA.

Author Disclosures: Dr Bayer reports employment with Alcoa Aluminum, who provided data for this study. The other authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.

Authorship Information: Concept and design (FJB, DG, MS, OT, MRC); acquisition of data (FJB, MRC); analysis and interpretation of data (FJB, DG, MS, IMC, OT, MRC); drafting of the manuscript (FJB, IMC, MRC); critical revision of the manuscript for important intellectual content (FJB, DG, IMC, OT, MRC); statistical analysis (FJB, DG, MS, MRC); provision of study materials or patients (FJB); obtaining funding (FJB, MRC); administrative, technical, or logistic support (FJB, IMC); and supervision (MRC).

Financial Source: This study was supported by National Institutes for Health grant 5RO1AG026291-04 and continuing support from Alcoa Aluminum. The funders had no role in the design of this study; collection, management, analysis, and interpretation of the data; conduct of this study; or preparation or approval of the manuscript. Alcoa Aluminum reviewed the manuscript prior to publication.

Address correspondence to: Mark R. Cullen, MD, Stanford University School of Medicine, General Medical Disciplines, 1265 Welch Rd, MSOB X-338, Stanford, CA 94305. E-mail:
1. Chowdhury P, Balluz L, Town M, et al; Centers for Disease Control and Prevention (CDC). MMWR: Surveillance of certain health behaviors and conditions among states and selected local areas—Behavioral Risk Factor Surveillance System, United States, 2007. MMWR Surveill Summ. 2010;59(SS-1):1-220.

2. Saydah SH, Fradkin J, Cowie CC. Poor control of risk factors for vascular disease among adults with previously diagnosed diabetes. JAMA. 2004;291(3):335-342.

3. American Diabetes Association. Economic costs of diabetes in the U.S. in 2007 [published correction appears in Diabetes Care. 2008;31(6): 1271]. Diabetes Care. 2008;31(3):596-615.

4. Lillioja S, Mott DM, Spraul M, et al. Insulin resistance and insulin secretory dysfunction as precursors of non-insulin-dependent diabetes mellitus: prospective study of Pima Indians. N Engl J Med.  1993;329(27): 1988-1992.

5. Rodbard HW, Blonde L, Braithwaite SS, et al; AACE Diabetes Mellitus  Clinical Practice Guidelines Task Force. American Association of Clinical Endocrinologists medical guidelines for clinical  practice for the management of diabetes mellitus. Endocr Pract. 2007;13(suppl 1):1-68.

6. Diabetes Control and Complications Trial and Research Group. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med. 1993;329(14):977-986.

7. The Diabetes Control and Complications Trial Research Group. Lifetime benefits and costs of intensive therapy as practiced in the diabetes control and complications trial [published correction appears in JAMA. 1997;278(1):25]. JAMA. 1996;276(17):1409-1415.

8. Epidemiology of Diabetes Interventions and Complications (EDIC). Design, implementation, and preliminary results of a long-term followup of the Diabetes Control and Complications Trial cohort. Diabetes Care. 1999;22(1):99-111.

9. Early Treatment Diabetic Retinopathy Study Research Group. Early photocoagulation for diabetic retinopathy: ETDRS report number

9. Ophthalmology. 1991;98(5 suppl):766-785.

10. Goldberg RB, Mellies MJ, Sacks FM, et al; the Care Investigators. Cardiovascular events and their reduction with pravastatin in diabetic and glucose-intolerant myocardial infarction survivors with average cholesterol levels: subgroup analyses in the cholesterol and recurrent events (CARE) trial. Circulation. 1998;98(23):2513-2519.

11. Knowler WC, Barrett-Connor E, Fowler SE, et al; Diabetes Prevention Program Research Group. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002; 346(6):393-403.

12. Litzelman DK, Slemenda CW, Langefeld CD, et al. Reduction of lower extremity clinical abnormalities in patients with non-insulindependent diabetes mellitus: a randomized, controlled trial. Ann Intern Med. 1993;119(1):36-41.

13. Heart Outcomes Prevention Evaluation Study Investigators. Effects of ramipril on cardiovascular and microvascular outcomes in people with diabetes mellitus: results of the HOPE study and MICRO-HOPE substudy. Lancet. 2000;355(9200):253-259.

14. Ohkubo Y, Kishikawa H, Araki E, et al. Intensive insulin therapy prevents the progression of microvascular complications in Japanese patients with non-insulin dependent diabetes mellitus: a randomized prospective 6-year study. Diabetes Res Clin Pract. 1995;28(2):103-117.

15. Stratton IM, Adler AI, Neil HA, et al. Association of glycaemia with macrovascular and microvascular complications of type 2 diabetes (UKPDS 35): prospective observational study. Br Med J. 2000;321(7258): 405-412.

16. UK Prospective Diabetes Study (UKPDS). Group Intensive bloodglucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications with type 2 diabetes (UKPDS 33) [published correction appears in Lancet. 1999;354(9178):602]. Lancet. 1998;352(9131):837-853.

17. UK Prospective Diabetes Study Group. Cost effectiveness analysis of improved blood pressure control in hypertensive patients with type 2 diabetes: UKPDS 40. BMJ. 1998;317(7160):720-726.

18. Beckles GL, Engelgau MM, Narayan KM, Herman WH, Aubert RE, Williamson DF. Population-based assessment of the level of care among adults with diabetes in the U.S. Diabetes Care. 1998;21(9): 1432-1438.

19. CDC Diabetes Cost-Effectiveness Study Group, Centers for Disease Control and Prevention. The cost-effectiveness of screening for type 2 diabetes [published correction appears in JAMA. 1999;281(4):325]. JAMA. 1998;280(20):1757-1763.

20. Fleming BB, Greenfield S, Engelgau MM, Pogach LM, Clauser SB, Parrott MA. The Diabetes Quality Improvement Project: moving science into health policy to gain an edge on the diabetes epidemic. Diabetes Care. 2001;24(10):1815-1820.

21. Kenny SJ, Smith PJ, Goldschmid MG, Newman JM, Herman WH. Survey of physician practice behaviors related to diabetes mellitus in the U.S; physician adherence to consensus recommendations. Diabetes Care. 1993;16(11):1507-1510.

22. Saaddine JB, Cadwell B, Gregg EW, et al. Improvements in diabetes processes of care and intermediate outcomes: United States, 1988- 2002. Ann Intern Med. 2006;144(7):465-474.

23. American Diabetes Association. Standards of medical care in diabetes [published correction appears in Diabetes Care. 2005;28(4):990]. Diabetes Care. 2005;28(suppl 1):S4-S36.

24. Grant RW, Buse JB, Meigs JB; University HealthSystem Consortium (UHC) Diabetes Benchmarking Project Team. Quality of diabetes care in U.S. academic medical centers. Diabetes Care. 2005;28(2): 337-442.

25. Imperatore G, Cadwell BL, Geiss L, et al. Thirty-year trends in cardiovascular risk factor levels among US adults with diabetes: National Health and Nutrition Examination Surveys, 1971-2000. Am J Epidemiol. 2004;160(6):531-539.

26. Jencks SF, Huff ED, Cuerdon T. Change in the quality of care delivered to Medicare beneficiaries, 1998-1999 to 2000-2001 [published correction appears in JAMA. 2002;289(20):2649]. JAMA. 2003;289(3): 305-312.

27. Koro CE, Bowlin SJ, Bourgeois N, Fedder DO. Glycemic control from 1988 to 2000 among U.S. adults diagnosed with type 2 diabetes: a preliminary report. Diabetes Care. 2004;27(1):17-20.

28. Mangione CM, Gerzoff RB, Williamson DF, et al; TRIAD Study Group. The association between quality of care and the intensity of diabetes disease management programs. Ann Intern Med. 2006;145(2): 107-116.

29. McClain MR, Wennberg DE, Sherwin RW, Steinmann WC, Rice JC. Trends in the diabetes quality improvement project measures in Maine from 1994 to 1999. Diabetes Care. 2003;26(3):597-601.

30. Roubideaux Y, Buchwald D, Beals J, et al. Measuring the quality of diabetes care for older American Indians and Alaska Natives. Am J Public Health. 2004;94(1):60-65.

31. Sawin CT, Walder DJ, Bross DS, Pogach LM. Diabetes process and outcome measures in the Department of Veterans Affairs. Diabetes Care. 2004;27(suppl 2):B90-B94.

32. Selby JV, Swain BE, Gerzoff RB, et al; TRIAD Study Group. Understanding the gap between good processes of diabetes care and poor intermediate outcomes: Translating Research into Action for Diabetes (TRIAD). Med Care. 2007;45(12):1144-1153.

 33. US Department of Health and Human Services. Health Communication. Washington, DC: US Department of Health and Human Services; 2010. Healthy People 2010; vol 1.

34. American Diabetes Association. Standards of medical care for patients with diabetes mellitus [published correction appears in Diabetes Care. 2003;26(3):972]. Diabetes Care. 2003;26(suppl  ):S33-S50.

35. Cullen MR, Vegso S, Cantley L, et al. Use of medical insurance claims data for occupational health research. J Occup Environ Med. 2006;48(10): 1054-1061.

36. Chronic Condition Data Warehouse. CMS Chronic Condition Data Warehouse Condition Categories. Published October 2010. Accessed November 23, 2013.

37. US Food and Drug Administration. National Drug Code Directory. Current through September 17, 2013. Accessed November 23, 2013.

38. Renders CM, Valk GD, Griffin SJ, Wagner EH, Eijk Van JT, Assendelft WJ. Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review. Diabetes Care. 2001;24(10):1821-1833.

39. Miller DR, Safford MM, Pogach LM. Who has diabetes? best estimates of diabetes prevalence in the Department of Veterans Affairs based on computerized patient data. Diabetes Care. 2004;27(suppl 2): B10-B21.

40. Kern EF, Maney M, Miller DR, et al. Failure of ICD-9-CM codes to identify patients with comorbid chronic kidney disease in diabetes. Health Serv Res. 2006;41(2):564-580.
Copyright AJMC 2006-2017 Clinical Care Targeted Communications Group, LLC. All Rights Reserved.
Welcome the the new and improved, the premier managed market network. Tell us about yourself so that we can serve you better.
Sign Up

Sign In

Not a member? Sign up now!