The American Journal of Managed Care June 2015
The American Journal of Managed Care June 2015
Ashok Reddy, MD; Anne Canamucio, MS; and Rachel M. Werner, MD, PhD
Maxim Topaz, PhD, MA, RN; Youjeong Kang, PhD, MPH, RN; Diane E. Holland, PhD, RN; Brenda Ohta, PhD, MSW; Kathy Rickard, MSN, RN; and Kathryn H. Bowles, PhD, RN, FAAN, FACMI
Bernard J. Tyson
Improving Diabetic Patient Transition to Home Healthcare: Leading Risk Factors for 30-Day Readmission
Hsueh-Fen Chen, PhD; Taiye Popoola, MBBS, MPH; Kavita Radhakrishnan, PhD, RN; Sumihiro Suzuki, PhD; and Sharon Homan, PhD
Quality of Care and Relative Resource Use for Patients With Diabetes
Troy Quast, PhD
David Auerbach, PhD, MS; Ateev Mehrotra, MD, MPH; Peter Hussey, PhD; Peter J. Huckfeldt, PhD; Abby Alpert, PhD; Christopher Lau, PhD; and Victoria Shier, MA
Seth A. Seabury, PhD; Darius N. Lakdawalla, PhD; J. Samantha Dougherty, PhD; Jeff Sullivan, MS; and Dana P. Goldman, PhD
Cost-Effectiveness of Combinatorial Pharmacogenomic Testing for Treatment-Resistant Major Depressive Disorder Patients
John Hornberger, MD, MS, FACP; Qianyi Li, MS; and Bruce Quinn, MD, PhD
William R. Doucette, PhD; Jane F. Pendergast, PhD; Yiran Zhang, MS, BS Pharm; Grant Brown, PhD; Elizabeth A. Chrischilles, PhD; Karen B. Farris, PhD; and Jessica Frank, PharmD
John Kralewski, PhD, MHA; Bryan Dowd, PhD, MS; Ann Curoe, MD, MPH; Megan Savage, BS; and Junliang Tong, MS
Helaine E. Resnick, PhD, MPH; and Michael E. Chernew, PhD
Quality of Care and Relative Resource Use for Patients With Diabetes
Troy Quast, PhD
Quality of care and relative resource use for patients with diabetes are not necessarily positively related. Further, the relationship varies by year, plan type, and region.
Objectives: To investigate the relationship between quality of care and relative resource use for patients with diabetes enrolled in commercial insurance plans.
Study Design: Retrospective cohort study employing data from the Healthcare Effectiveness Data and Information Set for 2009 to 2011.
Methods: Correlations between quality of care and various relative resource use measures are estimated. In addition to overall estimates, the sample is disaggregated by year, plan type, and geographic region. Correlations are also estimated for year-to-year changes in quality and relative resource use.
Results: The overall results are generally consistent with previous findings regarding the relationship between quality of care and relative resource use. However, the disaggregated results indicate nuanced associations; for instance, the relationship appears to vary by year. Also, while there is a positive relationship between quality and evaluation and management services for preferred provider organizations, the relationship is negative for the other 2 plan types studied. The analysis of year-to-year changes indicates that changes in quality are negatively related to inpatient costs.
Conclusions: The findings suggest, given that quality and relative resource use are not necessarily positively related, that it may be possible to improve diabetes care quality at minimal cost. However, the disaggregated results suggest that the potential to increase quality can vary significantly by resource type, plan type, and geographic region. Thus, the most effective policies to improve quality may vary by plan.
Am J Manag Care. 2015;21(6):452-459
This study employs data from commercial plans to investigate the relationship between quality and relative resource use for patients with diabetes.
- The results, similar to those of previous studies, indicate that quality and relative resource use are largely negatively related for the full sample.
- However, the relationship varies significantly by year, plan type, and region.
- Year-to-year changes in quality and relative resource use are also negatively related, especially for inpatient resources.
- Results suggest that there may be opportunities to increase quality of diabetes care with minimal effects on cost. However, the best approach may need to be tailored to the specific environment.
To improve healthcare, it is critical to understand the relationship between quality and cost. If they are not necessarily positively related, improvements in quality could be achieved at relatively little cost. A recent proposal9 by top healthcare experts from both political parties was largely centered on this notion. On the contrary, if quality and cost are positively related, this knowledge would allow policy makers to identify goals that are feasible and the appropriate steps to achieve them.
Unfortunately, determining how quality and cost are related is difficult—very few data sets contain both quality and cost measures.10 Further, defining quality and cost is not straightforward; while some measures provide insight into certain aspects of quality, 2 issues make measuring cost especially difficult. First, prices for healthcare vary significantly across geographic regions and health plans. Thus, cost estimates may differ simply due to different price bases. Second, variation in case mix across plans may lead to cost differences that reflect enrollee characteristics rather than treatment differences.11
Relative resource use (RRU) data addresses some of these issues, and these data have been used previously, such as to analyze the effects of changes in Medicare payment systems in inpatient rehabilitation facilities12 and to compare procedures for total joint arthroplasty.13 A number of approaches to estimate RRU have been implemented by those in academia and industry.14 The analyses in this paper employ data published by the National Committee for Quality Assurance (NCQA). Health plans submit membership and claims data—including quality measures based on Healthcare Effectiveness Data and Information Set (HEDIS) standards that have been used extensively in industry and academia—to the NCQA that are audited for accuracy. Using these data, the NCQA calculates RRU measures based on standardized prices that abstract from price differences across plans, and they further adjust the data for case mix differences.
This study employs NCQA data to investigate the relationship between the quality of care and RRU of health plans in treating enrollees with diabetes. Diabetes is one of the most prevalent chronic conditions in the United States, with 22.3 million having the condition in 2012.15 Quality of care is compared with various categories of resource use, including procedure and surgery, evaluation and management services, and ambulatory pharmacy. The categories: 1) procedure and surgery and 2) evaluation and management, are further subdivided into inpatient and outpatient measures. This distinction is potentially important, as one may expect that higher quality care is associated with increased outpatient resource use and decreased inpatient resource use. For instance, more outpatient resources (such as preventive care visits) may lead to fewer hospitalizations.
While these data have previously been used to investigate the relationship between quality and cost,16-18 this study makes a number of contributions. First, data for multiple years are utilized, allowing for more precise estimates of the relationship. Second, the relationship is analyzed along a number of dimensions, including by year, plan type, and geographic region. Finally, first differences are used to relate changes, rather than levels, in quality and utilization. By analyzing changes, the effects of differences across plans that are constant over the sample period are mitigated.
The sample in this analysis consists of 407 commercial health plans that submitted annual HEDIS data for any year in the 2009-2011 period. Before submitting their data, the data collection and measurement calculations were audited by NCQA. After limiting the sample to only those plan/years that had valid data for all variables, the number of observations is 813.
The RRU measures are based on standardized prices provided by the NCQA. Specifically, health plans multiply the standardized prices by the number of units of the service that were provided to obtain the standard costs. For each member diagnosed with diabetes, the total standard costs are calculated by adding the standard costs across all areas of care (ie, including nondiabetes care). The plan’s actual standard costs are divided by the expected standardized cost for the plan, taking into account the plan’s case mix and the average utilization of other plans. Finally, this ratio is indexed such that the average is 1.0.
RRU measures are calculated for 2 broad categories: medical services and ambulatory pharmacy services. The medical services category is disaggregated into inpatient facility (exclusive of physician services), procedure and surgery, and evaluation and management services. The 2 latter subcategories are further disaggregated into inpatient and outpatient services. The RRU specifications can change slightly by year, and thus, some caution is warranted in interpreting the results by year shown below.
Quality is measured as an unweighted composite of 10 individual components of the HEDIS Comprehensive Diabetes Care measure: A1C testing; A1C control (3 measures: greater than 9%, less than 8%, less than 7%); eye exam (retinal) testing; low-density lipoprotein cholesterol (LDL-C) screening; LDL-C control (less than 100 mg/dL); medical attention for nephropathy; and blood pressure control (2 measures: less than 130/80 mm Hg, less than 140/90 mm Hg). (The indicator for blood pressure less than 130/80 mm Hg was not included in the 2011 measure.) As is the case for RRU, the quality measure is indexed across plans such that the average is 1.0. Unlike RRU, the quality measure is not adjusted for case mix, but rather indexed based on submission by other plans.
All of the data management and calculations were performed using Stata version 12 (StataCorp LP, College Station, Texas). The estimates consist of correlation coefficients between the quality measure and the various RRU measures.
The analysis exploits the availability of multiple years of data. The first level of analysis pools the data across all years, then correlations are calculated after subsetting the data by year, plan type, and geographic region. These estimates provide insight as to whether the observed overall relationships are stable or whether they vary significantly across these dimensions. The final set of analyses is based on year-to-year changes (first differences) in the quality and RRU measures.
An important caveat to the results follows from the multiple comparisons below. Specifically, the likelihood of type I error (incorrectly identifying a statistically significant correlation) increases with the number of correlations estimated. For instance, in the analyses of the 7 regions, the probability of erroneously identifying at least 1 statistically significant effect for a given RRU measure is roughly 30%. (This probability is based on a 5% significance level and is calculated as 1 minus the probability that the null hypothesis is incorrectly rejected in at least 1 of the 7 tests.) This issue is addressed by employing the Simes procedure that accounts for multiple tests.19
Table 1 reports correlation coefficients between the diabetes quality measure and various RRU measures. The first column lists the 2 primary measures, total medical and total ambulatory pharmacy. The submeasures within medical are listed below the row for total medical. The top number in each cell of the body of the table is the coefficient, while the lower number is the associated P value. It has been indicated if the coefficient is statistically significant at the 5% level after applying the Simes correction for multiple tests.
The second column of Table 1 contains the correlation coefficients when the observations are pooled. For instance, the correlation between the quality measure and the total medical RRU measure is approximately –0.05 with P = .13. While not statistically significant, the negative point estimate is consistent with earlier findings but of a lower magnitude.7 The correlations for the medical subcategories indicate that the overall negative relationship is driven by the inpatient dimensions of both procedure and surgery and evaluation and management services and by inpatient facility. Conversely, the estimate for the outpatient dimension of procedure and surgery services indicates a positive relationship. The positive overall relationship for ambulatory pharmacy is also consistent with previous results, but the estimate is again of a lesser magnitude.
The disaggregated estimates may provide deeper insight into the relationship between quality and relative resource use. The remaining columns of Table 1 report the correlation coefficients when the sample is subset by year and plan type. There is interesting variation in the estimates by year. The total medical correlation only differs from 0 in 2009, and then it is of marginal statistical significance. Within the 2 medical subcategories, a relatively consistent pattern emerges of negative correlations for the inpatient RRU measures and positive (but not statistically significant) correlations for the outpatient measures. Further, there is also a positive estimate for the ambulatory pharmacy measure in 2009, but the association dissipates in the 2 subsequent years.
The final 3 columns of Table 1 contain correlations when the sample is subset by plan: health maintenance organization (HMO), HMO and point of service (POS) combined, and preferred provider organization (PPO). (Three plan types were excluded because each was composed of 17 or fewer observations: HMO/POS/PPO combined, HMO/PPO combined, and POS.) While the total medical point estimates are negative, none are statistically significant. By contrast, for HMO/POS combined there is a large positive relationship for the outpatient measure. Finally, for ambulatory pharmacy there are positive associations for HMO and HMO/POS combined but no association for PPO.