A longitudinal case-control design was used to evaluate the effects of the patient-centered medical home model on medical costs and utilization among high-risk patients.
Evaluate the effects of the patient-centered medical home (PCMH) model on medical costs and utilization in the nonpediatric population, particularly among high-risk patients.
Longitudinal case-control design, comparing per member per month (PMPM) cost and utilization per 1000 patients for members enrolled in PCMH and non-PCMH practices from 2009 to 2011.
Commercial health maintenance organization members in nonpediatric practices that adopted the PCMH model in 2009 were matched to patients in nonpediatric practices that did not adopt the model until 2011 or later. Propensity score matching was used to identify a pool of similar controls, and difference-in-differences regression analysis was used to compare PCMH and non-PCMH patients relative to baseline. Analysis was conducted using the complete pool of matched patients (N = 6940 cases and 6940 controls), then using the 10% of patients with the highest DxCG risk scores (N = 654 cases and 734 controls).
There were no significant cost or utilization differences for the overall population. Total cost decreased significantly more for the PCMH group than for controls in the high-risk group in years 1 and 2 (reductions of $107 and $75 PMPM), driven by lower inpatient costs. The PCMH group experienced a significantly greater reduction in inpatient admissions in all 3 years (61, 48, and 94 hospitalizations per 1000).
PCMH practices had significantly reduced costs and utilization for the highest risk patients, particularly with respect to inpatient care. As high-risk members represent a high-cost group, the most benefit can be gained by targeting these members.
Am J Manag Care. 2014;20(3):e61-e71High-risk patients enrolled in nonpediatric primary care practices which adopted the patient-centered medical home (PCMH) model had significantly lower per member per month medical costs and utilization per 1000 members compared with non- PCMH practices after adjusting for baseline characteristics.
The patient-centered medical home (PCMH) has been advanced as a promising framework for transforming primary care. In 2007, the American Academy of Family Physicians, American Academy of Pediatrics, American College of Physicians, and American Osteopathic Association issued the “Joint Principles of the Patient-Centered Medical Home,” which outlined the PCMH model. The medical home model emphasizes a team-based approach to primary care, in which a physician-leader coordinates care by other providers across multiple sites and specialties. It encourages increased access, both in terms of expanding practice hours and opening new channels of communication with patients. Organizations such as the Patient-Centered Primary Care Collaborative have initiated numerous pilot programs aimed at studying the impact of PCMH adoption,1 and the PCMH model was written into the Patient Protection and Affordable Care Act of 2010 as an area for study.2
A number of previous studies have shown early promise for the PCMH model as a vehicle for controlling costs and improving the quality of healthcare delivered by primary care practices,3-6 including for targeting subpopulations such as children with special health needs.7 However, reviews often point to the incomplete nature of this work, citing methodological concerns,5,7,8 insufficient time for practices to implement reforms, and inadequate policy support beyond the level of individual practices.4 This study aims to contribute to this literature by comparing the effects of adopting the PCMH model on the healthcare cost and utilization in the nonpediatric population, using propensity score matching in order to reduce variability in the PCMH and non- PCMH groups studied. Additionally, the analysis employs difference-indifferences regression analysis in order to further control for remaining differences in patients’ characteristics as well as cost and utilization at baseline.
This study aims to assess the impact of PCMH adoption on the patients identified as having the greatest health risks. While the Joint Principles envision the PCMH model as being applicable to all patients, other pilots have targeted only high-risk patients with complex needs.9 The high cost of care associated with relatively few individuals makes such targeting a potentially powerful mechanism: one study noted that virtually all of the growth in expenditures for Medicare over the period from 1987 to 2002 occurred among beneficiaries with 5 or more chronic illnesses10; another paper noted that only 10% of Medicare beneficiaries accounted for 70% of healthcare costs.11 In order to evaluate whether the benefits of medical homes are limited to such high-risk, high-cost subpopulations, this study reports cost and utilization comparisons 2 ways: first, for all matched patients; and subsequently, limited to the patients with risk scores in the 90th percentile or above for the study population.
The majority of the PCMH practices (15/17) included in this study were part of Pennsylvania’s Chronic Care Initiative, a multi-stakeholder effort to improve primary care, which launched a 3-year pilot project that started in May 2008 in the Philadelphia area. The largest commercial health plans— led by Independence Blue Cross, all 3 Medicaid managed care plans, and 32 practices caring for 250,000 members—were convened by the governor to establish the first of several regional PCMH programs. Practices received significant additional payments to participate in a learning collaborative which supported practice transformation and provided the care management and coordination services required by patients with chronic conditions. The learning collaborative was based on Wagner’s Chronic Care Model12 and led by the MacColl Institute, with Edward H. Wagner, MD, MPH, facilitating the first session.
Practices were required to send a physician and a practice support leader to 7 days of sessions. Practice coaches provided ongoing support and education on installing and using a registry to track and monitor patients and implementing a team-based approach involving care managers, health educators, and other nonphysician healthcare personnel to promote self-management skills and patient engagement.13 Additionally, clinical guidelines were used to create evidence-based standing orders to optimize patient care. Practices used their electronic systems to identify and stratify patients in need of care management, selfmanagement support, and goal monitoring. Patient engagement was promoted through the use of report cards, on which concrete data from each visit are logged for patients so they can monitor their progress.
To provide a definition of the PCMH model, the authors employed the recognition standards published by the National Committee for Quality Assurance (NCQA). These standards list 9 categories encompassing 30 possible practice improvements (including 10 “must pass” items), each of which has a point value. Three levels of certification are possible, with each defined by a minimum number of “must pass” items achieved and specified point totals. The full list of recognition criteria appears in .14 Practices qualified for PCMH status by achieving NCQA Level 1 recognition or higher during 2009, and the control group was limited to practices which did not receive recognition until 2011 or later.
Study Population and Design
This study employs a longitudinal, case-control design to compare members of commercial health maintenance organizations (HMOs) enrolled in nonpediatric PCMH and non-PCMH practices with respect to healthcare costs and utilization during the period from 2009 to 2011. All figures are reported first for the full matched cohort of cases and controls (N = 6940 cases and 6940 controls), and then using the 10% of patients with highest risk scores, drawn from the pooled population of cases and controls (N = 654 cases and 734 controls).
DxCG risk score refers to the concurrent medical risk score calculated using the commercial risk adjustment model developed by Verisk Health DxCG Risk Solutions, version 3.1 (Verisk Health, Cary, North Carolina).15 The DxCG models use linear, additive formulas obtained from ordinary least squares (OLS) regressions to combine expenses associated with clinical groupings (Condition Categories and Rx- Groups) and demographic factors (age, gender) to generate predictions. Hierarchies are imposed on Condition Categories before regression models are run to decrease their sensitivity to variations in coding and to strengthen the predictive power of the models across a wide range of benefit designs and pricing arrangements.15 The concurrent risk score in this analysis used each individual’s age, gender, and claims information from all medical encounters and enrollment data as inputs to predict annual total medical resource use for the patient.
Patients evaluated were enrolled in 17 PCMH practices, 15 of which were participating in the Pennsylvania Chronic Care Initiative pilot (cases), or 1 of 103 non-PCMH comparison practices in PA (controls). The high-risk patients were slightly more concentrated, appearing in only 14 PCMH practices (12 of which were part of the pilot) and 69 non-PCMH practices. Costs were assessed as per member per month (PMPM) costs and utilization was measured as encounters per 1000 patients per year.
Criteria In order to qualify for inclusion, each member must have been enrolled with the same primary care physician for at least 3 months and have been associated consistently with a PCMH or non-PCMH practice for 6 months or more during each year of the study period, including baseline (2008). Only nonpediatric practices located in Pennsylvania were included in the analysis. Pediatric practices were excluded to reduce the variability in the age of members in the study and minimize the impact of any potential unobserved differences between pediatric practices and nonpediatric practices. Patients with end-stage renal disease or extremely high medical costs (>$100,000 per year) were excluded to limit the impact of extreme outliers on the cost analysis.
The pool of eligible controls was limited to later adopters of the PCMH model in order to reduce potential practice self-selection issues. Patients enrolled in control practices that received NCQA recognition in 2011 were included in analyses for the first 2 program years, but were removed from the final year’s analysis to avoid contaminating the non-PCMH group with late adopters, along with their matched cases. This reduced the numbers included in program year 3 to 1141 cases and 1141 controls in the overall analysis, and 109 cases and 131 controls in the highrisk subgroup. While the guidelines remained largely similar from 2008 to 2011, some changes were made to the NCQA requirements, and a crosswalk table detailing the differences is available from the NCQA.16 An attrition diagram detailing all exclusion steps appears in .
Propensity score matching was used to select a sample of controls which were similar to the PCMH cases with respect to both practice- and patient-level demographics and characteristics. The propensity score included practice size, practice location, age, gender, DxCG risk score, chronic conditions (including asthma, diabetes, congestive heart failure, chronic obstructive pulmonary disease, and coronary artery disease), and median income for member’s zip code of residence. Matching successfully controlled for the significant differences at baseline between the group of cases and pool of potential controls, both for the overall comparison and among the cohort of highest risk patients (and ).
Differences in PMPM cost and utilization per 1000 patients between PCMH and non-PCMH practices for the 3 follow-up years were compared using regression analysis. This method provides an estimate of the differences between treatment and control groups before and after treatment. Since the members included in this study are the same in each time period (ie, panel data), the difference-in-differences model can be simplified and is more statistically powerful. The difference between baseline and each time period can be modeled as follows (separate model for each time period difference):
Y i,1 — Y i,0 = δ + βX i,1 + ε I
where Y i,1 — Y i,0 is the difference between the repeated outcome measure for each observation, δ is the effect of time on all units, X i,1 is the treatment indicator, and β is the treatment effect.17 Cost and utilization regressions controlled for concurrent risk in the comparison year and having a chronic condition in the baseline year, factors that could influence both cost and utilization in the comparison year. For example, when comparing 2010 with baseline, the 2010 risk score was added to the model to adjust for any new diagnoses a member might have acquired in 2010. Presence of a chronic condition at baseline was used as a covariate because chronic members often continue to incur costs, or incur even higher costs, over time. In order to test for the treatment effect for just the high-risk members, a high-risk indicator was introduced as covariate (ie, as a main effect and interaction term with the treatment indicator) into the model using the whole population. Additionally, a random intercept term was used in the model to account for any practice-level effects.
When comparing utilization and PMPM cost for all matched cases and controls during the 3 follow-up years with respect to baseline characteristics, no difference-in-differences comparison reached significance at α = .1 (, ). The regression results limited to the 10% of pooled cases and controls with the highest DxCG risk scores resulted in clear differences between PCMH and non-PCMH. PCMH practices achieved statistically significant decreases in utilization of inpatient medical services in all 3 program years, amounting to reductions of 61, 48, and 94 hospitalizations per 1000 patients. In the first 2 program years, these reductions were accompanied by statistically significant adjusted savings in inpatient costs ($115 PMPM in 2009 and $62 PMPM in 2010). The decline in utilization of inpatient hospital services contributed to lower total medical costs for patients enrolled in PCMH practices during the first 2 study years as well. Cases had an adjusted total savings of $107 PMPM in 2009, representing an 11.2% reduction from baseline. For 2010, the difference was $75 PMPM, corresponding to a 7.9% reduction.
While total medical costs decreased, there were areas in which high-risk patients in PCMH practices experienced increases in costs and utilization. This cohort saw a statistically significant increase in specialist visits in 2009, and corresponding increases in PMPM spending for specialist care in 2009 and 2010 ( and ).
This study offers particular methodological contributions to the PCMH literature. The approach of combining propensity score matching to create comparable case and control pools with difference-in-differences regression analysis to adjust for practice- and patient-level variation and baseline cost and utilization characteristics allows improved control for factors which might otherwise confound efforts to study the effects of PCMH adoption. Inclusion of a non-PCMH control group and assessing differences over time allows the analyses to control for trends which may have affected all practices, regardless of PCMH status. Along with controlling for practice size, excluding practices which transitioned to the PCMH model in 2010 helped to limit the impact of self-selection on results. Because adoption of the PCMH reforms does not occur instantaneously, some non-PCMH practices may have incorporated aspects of the medical home without having yet risen to the level of eligibility for NCQA recognition. Confining the control group to later adopters diminishes this issue.
The findings of this study add new texture to the existing PCMH literature. After controlling for baseline differences, no statistically significant differences between patients enrolled in PCMH and non-PCMH practices were observed. However, when looking at the patients with highest risk scores in the pool of matched patients and practices, PCMH model adoption was shown to lead to a significant relative reduction in total costs in years 1 and 2, and significantly lower numbers of inpatient admissions in all 3 years. This suggests that the average patient may not be the relevant unit of observation for evaluating the impact of PCMH adoption. Rather, high risk patients with multiple comorbidities are the most logical targets for interventions aimed at supporting self-management, conveying test results in a timely and clear fashion, and coordinating follow-up and specialist care. Researchers may miss cost and utilization improvements if they confine their analyses to the typical patient, since healthcare costs are primarily driven by relatively rare events concentrated in few individuals. For example, during the baseline year, all cases and controls had 73 and 78 admissions per 1000 patients, respectively; but among the high-risk pool, these numbers increased to 566 and 540.
The observation that relative cost reductions are driven by decrease in inpatient admissions among high-risk patients suggests that the PCMH model is having its intended effect— improvements to information technology permit physicians to better assess patient needs, and better coordination of care means that ongoing issues can be managed at lower levels of care intensity (self-management, primary care) rather than after manifesting as crises requiring hospitalization. Even the observation of increased spending for specialist care can be interpreted as being consistent with this conceptualization: as providers gain access to better quality information about patient needs through improved medical record-keeping and care is coordinated across multiple sites, the patients with the highest medical risk may be appropriately directed to more frequent contact with specialists. This could drive up the cost of 1 component of care, while the use of appropriate early interventions helps control costs overall.
Despite extensive controls through matching, regression analysis, and study design, some self-selection issues may persist. A number of the initial pool of control practices received NCQA recognition in 2011, meaning that there may have been some “wind up” time in the prior year for practices identified as controls. However, this should have had the effect of reducing the apparent difference between PCMH and non- PCMH practices for the 2010 analyses.
Additionally, other studies of the medical home model have focused on patient satisfaction and quality improvement measures, which are essential aspects of the PCMH model and central to providing exceptional primary care, but these attributes are not the focus of this study. Over a sufficient time frame, improved integration of care may lead to better outcomes for patients with lower levels of health risk as well, so ongoing assessments of PCMH adoption should be conducted with these considerations in mind.
While no differences were observed when assessing patients from the full distribution of risk scores, this study demonstrated that adoption of the PCMH model was associated with significantly reduced costs and utilization for those members at highest risk, particularly with respect to inpatient care. High-risk members are the most costly to health plans, so it logically follows that the most benefit can be gained by targeting these members with programs such as the medical home. When evaluating PCMH programs, it is important to focus both interventions and evaluations on relevant populationsAuthor Affiliations: Independence Blue Cross, Philadelphia, PA (SH, RC, CC, RS, SN).
Source of Funding: This study was funded by Independence Blue Cross, which is an independent licensee of the Blue Cross and Blue Shield Association. All of the authors were employed by the Independence Blue Cross during the course of the study.
Author Disclosures: The authors (SH, RC, CC, RS, SN) all report employment with Independence Blue Cross, which funded this study.
Authorship Information: Concept and design (SH, RC, RS, SN); acquisition of data (SH); analysis and interpretation of data (SH, RC, CC, RS, SN); drafting of the manuscript (SH, RS); critical revision of the manuscript for important intellectual content (SH, CC, RS, SN); statistical analysis (SH); administrative, technical, or logistic support (RC, RS); supervision (RC, CC, SN).
Address correspondence to: Susannah Higgins, MS, 1901 Market St, Philadelphia, PA 19103. E-mail: firstname.lastname@example.org. The Patient-Centered Primary Care Collaborative. Proof in practice: a compilation of patient centered medical home pilot and demonstration projects. http://www.pcpcc.org/sites/default/files/media/PilotGuidePip .pdf. Published 2009.
2. Patient-centered medical homes. Health Affairs website. https://www .healthaffairs.org/healthpolicybriefs/brief.php?brief_id=25. Published September 14, 2010.
3. Reid RJ, Coleman K, Johnson EA, et al. The group health medical home at year two: cost savings, higher patient satisfaction, and less burnout for providers. Health Aff (Millwood). 2010;29(5):835-843.
4. Jaen CR, Ferrer RL, Miller WL, et al. Patient outcomes at 26 months in the patient-centered medical home National Demonstration Project. Ann Fam Med. 2010;(8, suppl 1):S57-S67, S92.
5. Peikes D, Zutshi A, Genevro JL, Parchman ML, Meyers DS. Early evaluations of the medical home: building on a promising start. Am J Manag Care. 2012;18(2):105-116.
6. Devries A, Li CH, Sridhar G, Hummel JR, Breidbart S, Barron JJ. Impact of medical homes on quality, healthcare utilization, and costs. Am J Manag Care. 2012;18(9):534-544.
7. Homer CJ, Klatka K, Romm D, et al. A review of the evidence for the medical home for children with special healthcare needs. Pediatrics. 2008;122(4):e922-e937.
8. Peikes D, Dale S, Lundquist E, Genevro J, Meyers D. Building the evidence base for the medical home: what sample and sample size do studies need? Mathematica Policy Research white paper. Rockville, MD: October 2011. AHRQ Publication No. 11-0100-EF.
9. Berenson RA, Hammons T, Gans DN, et al. A house is not a home: keeping patients at the center of practice redesign. Health Aff (Millwood). 2008;27(5):1219-1230.
10. Thorpe KE, Howard DH. The rise in spending among Medicare beneficiaries: the role of chronic disease prevalence and changes in treatment intensity. Health Aff (Millwood). 2006;25(5):w378-w388.
11. Bodenheimer T, Berry-Millett R. Follow the money—controlling expenditures by improving care for patients needing costly services. N Engl J Med. 2009;361(16):1521-1523.
12. Wagner EH, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Q. 1996;74(4):511-544.
13. Patient-centered primary care collaborative. Pennsylvania Chronic Care Initiative. http://www.pcpcc.net/printpdf/1396. Published 2008.
14. Standards and Guidelines for Physician Practice Connections—Patient- Centered Medical Home (PPC-PCMH). Washington, DC: National Committee for Quality Assurance; 2008.
15. Verisk Health Inc. Sightlines DxCG Risk Solutions: Concepts and Methodologies Guide for UNIX. Waltham, MA: 2010.
16. COMPARISON: PPC-PCMH 2008 With PCMH 2011. Washington, DC: National Committee for Quality Assurance; 2011.
17. Buckley J, Shang Y. Estimating policy and program effects with observational data: the “difference-in-differences” estimator. Practical Assessment, Research & Evaluation. 2003;8(24).