Martin Slade, MPH

 To examine the association between processes measures of diabetes care and time to progression for 4 diabetes complications: coronary artery disease (CAD), stroke, heart failure (HF), and renal disease (RD).

This retrospective study followed outcomes from 2003 through 2009 in a cohort of 1797 employees with diabetes who worked for a large US manufacturer and were enrolled in the same health insurance plan.

 Quality of care was measured by consensus standards for testing glycated hemoglobin, lipids, and microalbuminuria. Employees with diabetes who received all 3 measures of care in the baseline year (2003) were compared with those who received less complete testing. Cox proportional hazard regression models were used to assess potential associations between diabetes care and time to complications, controlling for potential confounders.

 Observed differences between the 2 groups in time to event were significant for 2 of the 4 complications: HF (hazard ratio [HR] = 0.39, 95% confidence interval [CI], 0.19-0.81; 

 = .0117) and RD (HR = 0.48, 95% CI, 0.24-0.95; 

 = .0339) and any of the 4 complications (HR = 0.66, 95% CI, 0.48-0.91; 

 = .0101). Differences in time to complication for CAD (HR = 0.70, 95% CI, 0.49-1.02;

 = .0635) and stroke (HR = 0.63, 95% CI, 0.38-1.07; 

 = .0891) showed the same trend but were not significant.

Employees with diabetes who received all 3 quality measures experienced fewer complications, risk-adjusting for other factors. These results provide support for the importance of care quality.

The proportion of patients with diabetes receiving standard processes of care based on systematic reviews is disturbingly low and in our fully insured population is just under 15%.

		The patients in our cohort who received standard processes of care developed fewer complications than those who did not, despite being sicker at the outset.

		Our results provide support for process measures and efforts to promote their application in practice.

		If even a modest portion of outcomes are causally associated with better processes of care, there is great potential for benefit.

In 2010, the estimated prevalence of diabetes among adults ranged from 5% to 13% across the United States and its territories,1  accounting for substantial morbidity, mortality, and associated economic costs.

Type 2 diabetes mellitus often develops 9 to 12 years before diagnosis

 and more than 50% of patients have at least 1 complication by that time.

 A significant body of research has established that effective treatments can significantly decrease the development and/or progression of complications.

However, diabetes care remains suboptimal and varied in the United States.

 In an effort to improve outcomes, The National Diabetes Quality Improvement Project (1997) developed a comprehensive set of process and intermediate outcome measures to assess quality of care for diabetes patients that are now considered standards of care.

These measures include annual  screenings for lipids and microalbuminuria, at least 2 measurements of glycated hemoglobin (A1C) at least 30 days apart, and annual flu vaccinations, dilated eye exams, and foot examinations.

 have used these performance measures to assess care provided to patients with diabetes. These   studies provide evidence of the substantial gaps between national performance measures for diabetes care and actual care received by persons with diabetes in the United States.

The present study examines 3 process measures of diabetes care: A1C tests, lipid tests, and urine screening tests for  microalbuminuria; and their association with 4 subsequent complications of diabetes: coronary artery disease (CAD), stroke, heart  failure (HF), and renal disease (RD); in a cohort of employees of a large national manufacturing company. This cohort provides an opportunity to study this issue in a geographically, ethnically, and socioeconomically diverse population with rich and uniform healthcare benefits. This study contributes to the literature by identifying systematic reasons for differences in care among privately insured Americans and examining whether adherence to recommended processes of care is associated with better outcomes.

The study setting was a large (approximately 36,000 employees) US-based manufacturing company with uniform healthcare benefits in 22 states that generated claims data during the years of the study. We examined the relationships between the 3 measures of the quality of diabetes care and the risk of major diabetes complications to determine whether employees with diabetes who received all 3 quality-of-care measures in a baseline year (2003) demonstrated a lower risk for developing any of 4 complications over the 6-year observation period (2004-2009). Baseline characteristics suspected to impact outcome risk and/or likelihood of receiving optimal care included in the multivariate model were age, sex, ethnicity, marital status, income, insulin use, comorbidities, and smoking. Due to data limitations, we were unable to assess the possible confounding roles of obesity and duration of diabetes. Data on annual flu vaccinations, dilated eye exams, and foot examinations were not available; thus, these elements were not included in our model.

This was a retrospective cohort study using administrative data on employees collected between January 1, 2001, and December 31, 2009. The majority of the employees held hourly manufacturing jobs; minorities and women were well represented. Although employees could select from a menu of health benefits, only a single preferred provider organization (PPO) network was available to  the entire population. Employees who did not opt for this PPO were excluded (3%). The panel was restricted to those employed by the manufacturer for some part of 2001 and 2002, and for all of 2003, the year during which quality of care measures were assessed. Health outcomes were assessed from claims between January 1, 2004, and December 31, 2009. 

During the “lead-in” period (2001-2002), diabetes status was ascertained from the claims data based on 

International Classification of Diseases, Ninth Revision

) codes for the condition on a submitted medical claim for at least 1 of the following: a hospitalization, emergency department visit, 2 office visits, or 1 prescription for a diabetes-specific medication. Participants were  included in the final data set if they were between 18 and 64 years old and employed throughout 2003 and for at least 1 month in the observation period (2004-2009). Employees with diabetes who had any 1 of the 4 end point complications coded in a medical claim in 2001 or 2002 and women with a claim containing an

code for gestational diabetes were excluded. Those with claims for 1 of the 4 complications in the baseline year (2003) were included in the panel, but were excluded from the analysis for that complication. A total of 1797 subjects were available for analysis.

Process measures of diabetes care (ie, 2 A1C tests at least 30 days apart and at least 1 test each for lipids and microalbuminuria) were assessed in the baseline year (2003).

 Each employee with diabetes was categorized into 1 of 2 mutually exclusive groups: those who received all 3 measures of care in 2003 and those who did not. Cox proportional hazard regression models were used to assess the associations between diabetes care and time to each of the 4 complications (CAD, stroke, HF, and RD) or any of the 4 complications.

The databases available for analysis have been described in detail in previous publications.

 Briefly, health data were obtained from the health insurance plan, extraction of onsite occupational health medical records available for about 40% of the locations, and other linked employer-managed administrative databases. Data included 

 codes from the Chronic Condition Data Warehouse list

 for disease diagnosis and National Drug Codes

 for prescription information. End point complications were identified based on 

 codes during a face-to-face exam or hospitalization. For end point data, the subset of 

 codes from the Chronic Condition Data Warehouse list for causes of kidney disease and heart disease unrelated to diabetes (eg, infectious or genetic etiology) were excluded. Demographic and health behavior data were obtained from the health medical record and human resources databases.

Vision claims were not available. Therefore, claims for routine eye exams and screening for diabetic retinopathy were not usable as measures of quality of diabetes care.

Sightlines DxCG Risk Solutions software (Verisk Analytics, Jersey City, New Jersey) was used to assign risk scores to the cohort during the baseline assessment and capture potential illness-related influences on treatment decisions. This actuarial program uses medical and pharmacy data with proprietary risk-adjustment algorithms to predict future health spending, and its risk scores are comparable to similar scores used by the Centers for Medicare & Medicaid Services and other insurance bodies for global risk estimates. A score of 1 in 2003 implies an actuarial prediction that an individual would consume the median amount of healthcare  or the population in 2004. Databases were linked by an encrypted unique identifier to ensure human subject privacy. This study was approved by the authors’ institutional review boards.

Hazard ratios for each outcome (CAD, stroke, HF, RD, and any of the 4 conditions) were calculated for quality of diabetes care (exposures) and covariates. Time to event, defined as the number of months from the start of the observation period (January 1, 2004) to the first medical claim for a complication, was used for all primary analyses. Employees with diabetes who no longer  received employer-provided health benefits were censored at the time of their last month of coverage. Records (n = 901) were  censored during the observation period for the following reasons: retirement, layoff or termination (n = 647), change from PPO to health maintenance organization or Consolidated Omnibus Budget Reconciliation Act (COBRA) coverage (n = 77), and death or  long-term disability (n = 30). For 119 subjects, the reason for loss of coverage could not be definitely established from the available  records. Differences between the baseline characteristics of censored and uncensored employees were assessed with x

 tests. The Kaplan-Meier method was used to identify crude time-to-event models for the associations between the exposure and outcome measures.

Cox proportional hazard models were used to evaluate bivariate and multivariate association, which enabled time-to-outcome assessment with risk adjustment based on socioeconomic and lifestyle risk factors, comorbidities, and severity of diabetes. The base model, calculating time to event as a function of quality of care, was specified with demographic covariates. Covariates including modifiable risks (smoking), clinical characteristics (insulin use and health severity risk score), and socioeconomic status indicators (individual income, job status [hourly or salary], and marital status) were then added to the base model. Finally, the fully adjusted model was used to assess the combined explanatory effects for all measured factors. Hazard ratios (HRs) for primary outcomes were calculated based on Cox proportional hazard analyses stratified by hourly job status, salary, sex, and insulin use. As a sensitivity test, kappa statistics, correlation analyses, and Cox proportional hazard analyses were used to assess outcome  differences based on 2 years (2003 and 2004) of continuous high-quality care (leaving 2005-2009 available for outcome observation). Other sensitivity tests included looking at each stratum of sex, job status, and insulin use in the full model. All analyses were conducted using SAS version 9.2 (SAS Institute Inc, Cary, North Carolina). 

A total of 1797 patients met criteria for inclusion. The cohort consisted primarily of white (69.2%), male (83.1%), married (74.2%), hourly employees (75.7%), a significant number of whom earned less than $35,423 per year (27.2%). More than half (55.1%) were between the ages of 18 and 51 years. The mean age for the total population was 49.0 years (standard deviation = 8.4). Smoking data were reported as never (14.4%), past/current (17.3%), and unknown (68.3%). The unknown group represents primarily locations for which health medical record data were unavailable. As a measure of diabetes severity, 20.1% of the population had insulin prescriptions during the baseline year. Health severity risk scores were also used to assess comorbidities, with 75.1% of the cohort receiving a score of 2.1 or lower (1 = average health risk spending probability, 2 = risk likelihood of double the average health expenditures). Regarding the quality of diabetes care process measures, a majority of patients received at least 1 A1C test (67.6%) and lipid testing (61.8%) in the baseline year. Other measures of care were less common: 43% of patients had at least 2 tests for A1C and only 24.0% were tested for microalbuminuria in the baseline year.

Characteristics of the baseline sample are shown in 

; the same subjects stratified by treatment status are shown in 

. At baseline, the group receiving all 3 process measures was smaller (n = 267) than the comparison group  (n = 1530). Differences between the 2 groups were assessed with 2-tailed

 tests for independent samples. Despite the sample size differences, there were no statistically significant differences between the 2 groups during the baseline period (2003) for demographic, socioeconomic status, or modifiable risk variables. However, there was evidence that the group receiving all 3 process measures was sicker at baseline. They were significantly more likely to be receiving insulin than the comparison group (27.7% vs 18.8%; 

 = .0007) and were also more likely to fall into the higher quartiles of health severity risk score (

 shows the characteristics of those who were censored compared with those who remained in employment throughout the   follow-up period. Although workers who left were older and less well paid on average at baseline, differences between censored employees and non-censored employees were not significant for race, marital status, occupational group (salary or hourly), insulin use, health severity risk score, and importantly, likelihood of receiving the treatment.

In total, 366 persons with diabetes (20%, n = 1797) had medical claims for at least 1 of the 4 complications with a mean time to complication of 29.1 months. The most frequent complication in the cohort was CAD (16.9%) with a mean time to complication of 26.6 months, followed by stroke (8.7%, 33.1 months), HF (5.8%, 29.7 months), and RD (4.9%, 38.1 months). Those getting all 3 process measures of care fared better for all end points. Hazard ratios for 2 of the 4 complications were significant: HF (HR = 0.39, 95% confidence interval [CI], 0.19-0.81; 

 = .012) and RD (HR = 0.48, 95% CI, 0.24-0.95; 

 = .034). The HRs for CAD (HR = 0.70, 95% CI, 0.49-1.02; 

 = .064) and stroke (HR = 0.63, 95% CI, 0.38-1.07; 

 = .089) showed the same trend but were not significant. Hazard ratios with CIs for each and any of the  4 end points are summarized in 

The HR for submitting a medical claim for any of the 4 complications was significantly lower for those receiving all 3 process measures (HR = 0.66, 95% CI, 0.48-0.91;

 = .01). Covariates associated with increased risk included increasing age 46-51 years (HR = 1.88, 95% CI, 1.36-2.61;

= .0001), 52-56 years (HR = 2.06, 95% CI, 1.47-2.89; 

 <.0001), and 57-64 years (HR = 3.09, 95% CI, 2.15-4.46;

 <.0001); health severity  risk scores of 2.1 or higher (HR = 1.91, 95% CI, 1.36-2.68; 

 = .0002); and smoking (HR = 1.44, 95% CI, 1.01-2.07; 

 = .047).  Differences in all other covariates were not statistically significant. The Kaplan-Meier estimates of cumulative hazards for all end points are depicted in 

We conducted 2 sensitivity analyses. The first used 2 years (2003 and 2004) of continuous process of care measures to reduce the likelihood of random misclassification. Results showed the same trends and similar point estimates (data not shown), although with shorter follow-up (2005-2009) these results were no longer significant. Likewise we tested for robustness within strata by sex, hourly versus salaried job status, and initial insulin use. Results revealed comparable point estimates for all strata with the exception of the women, in whom HR estimates for each complication hovered around 1. In general, the point estimates within strata were similar to those found for the full cohort, but with wider CIs.

This study compared 2 groups of employees with diabetes to assess how differences in process measures of care might have affected the onset of complications associated with diabetes. Significant differences in time to complication were observed between the 2 groups for 2 of the 4 complications  (HF and RD) and for any of the 4 complications. Remarkably, those employees getting optimal process scores were, on average, sicker at the outset based on greater insulin use and increased risk severity scores; hence, they would have been expected a priori to have worse outcomes.

Many studies have assessed whether interventions at the provider level improve processes of care and intermediate outcomes, but the effect of such process improvements on complications remains less clear because the outcomes themselves are rarely assessed.

 This study estimates the impact of process measures of quality care by analyzing data in a national sample across multiple physician groups administering diabetes care within the same health insurance plan structure. This study is the first to our knowledge confirming, in practice, the expectations for benefit from compliance with recommended process measures of care in which follow-up was long enough to observe the major clinical end points of interest.

That said, there remain significant limitations to our methods and our ability to draw causal inference from the results. We relied on claims data for recognition of our population with diabetes, for ascertainment of complications, and for assessment of the critical covariate of interest—execution of all of the quality of care diagnostic measures in the baseline year. Each step entails opportunity for  misclassification. Although the diagnosis of diabetes is readily inferred from claims with high sensitivity and specificity,

comparable data comparing claims with verifiable sources such as medical records or examinations do not exist for any of the major complications with the exception of RD,

which has been found to be identified with high specificity but less sensitivity than diabetes. That would not, however, bias our findings for patients who had been identified as having RD. Thus, it is possible that the end points misclassified cohort members in both directions and that some with complications already evident were not appropriately excluded. The impact of such misclassifications, assuming they were random, would likely drive our result toward the null, but there is no assurance that such errors were random.

Another concern is the impact on our conclusions of unobserved variables (eg, body mass index, duration of diabetes) as noted above. Although there is no strong prior reason to suspect that such variables were distributed in such a way as to confound our  result, more obese subjects might have received consistently poorer care and, independently, had a higher risk of bad outcomes. The impact of censorship may also have resulted in possible bias, as those faring most poorly might be expected to leave prematurely more often. It is reassuring that censorship was not associated with baseline characteristics of disease severity nor  with treatment group, but the size of loss—more than half of the cohort&mdash;introduces concern for unmeasured bias.

The employees in this study may not represent a generalizable population, as they work for a stable employer with rich and uniform benefits in the heavy manufacturing sector, both less common features than a generation ago. Our study panel requirements demanded a group stably employed during a period of years, further rendering it less representative of the larger workforce.

Perhaps most difficult to fully address is the possibility of endogenous differences among persons with diabetes leading some to both seek better care for their disease—picking better qualified doctors and/or advising them what tests to order&mdash;and take better are of themselves in other ways, collectively resulting in better outcomes. Nonetheless, it is noteworthy that in the primary test of  the hypothesis, the baseline characteristics created an uneven playing field, with more ostensibly sick patients having a higher rate of better care; thus, the deck was stacked against those with better care having better outcomes, an effect that began to be visually apparent in the third observation year (see Figure 5). It is also reassuring that our result survived the various sensitivity tests. We are exploring instrumental variables and other approaches to examine the causal pathway further, including assessment of the relationships between the process measures and intermediate outcomes such as medication change, adherence, frequency of exams, and the like.

Limitations notwithstanding, these results provide further support for process measures and efforts to promote their application in  practice, starting with the obvious; the proportion of employees with diabetes getting the standard of care based on systematic  reviews

 was disturbingly low (just under 15%) in our fully insured population. If even a modest portion of the association with outcome is causal, there is a considerable opportunity for benefit from driving better processes of care.

From Alcoa Aluminum (FJB), Pittsburgh, PA; Yale Occupational & Environmental Medicine (DG, MS, OT), Yale School of Medicine, New Haven, CT; Stanford University School of Medicine (IMC, MRC), General Medical Disciplines, Stanford, CA.

 Dr Bayer reports employment with Alcoa Aluminum, who provided data for this study. The other authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.

 Concept and design (FJB, DG, MS, OT, MRC); acquisition of data (FJB, MRC); analysis and interpretation of data (FJB, DG, MS, IMC, OT, MRC); drafting of the manuscript (FJB, IMC, MRC); critical revision of the manuscript for important intellectual content (FJB, DG, IMC, OT, MRC); statistical analysis (FJB, DG, MS, MRC); provision of study materials or patients (FJB); obtaining funding (FJB, MRC); administrative, technical, or logistic support (FJB, IMC); and supervision (MRC).

This study was supported by National Institutes for Health grant 5RO1AG026291-04 and continuing support from Alcoa Aluminum. The funders had no role in the design of this study; collection, management, analysis, and interpretation of the data; conduct of this study; or preparation or approval of the manuscript. Alcoa Aluminum reviewed the manuscript prior to publication.

Articles

Adherence to process of care measures was associated with reduced risk of 2 diabetes complications or any of 4 complications in a national industrial cohort.

Martin Slade, MPH

Articles

Process of Care Compliance Is Associated With Fewer Diabetes Complications