In 2012, electronic health record use and participation in accountable care organization or patient-centered medical home initiatives were associated with performing care processes expected to improve healthcare outcomes.
Objectives: To examine whether physicians using health information technology and participating in new models of payment and delivery were more likely to perform care processes associated with improved care delivery.
Study Design: Nationally representative, cross-sectional data on US office-based physicians from the 2012 National Ambulatory Medical Care Survey Physician Workflow Survey.
Methods: Multivariate regression analysis of whether physicians routinely performed 14 specific care processes in 4 categories: population management, quality measurement, patient communication, and care coordination. Key independent measures were electronic health record (EHR) use and accountable care organization (ACO) or patient-centered medical home (PCMH) participation.
Results: A majority of physicians reported routinely conduct at least 1 care process related to care coordination (89%), patient communication (69%), and population management (67%); less than half reported performing at least 1 quality measurement process routinely (44%). EHR use and ACO or PCMH participation were independently associated with a higher likelihood of performing care processes. Physicians who were using EHRs in combination with participation in ACO or PCMH initiatives had the highest likelihood of routinely performing the care processes: physicians who used an EHR and participated in ACO or PCMH initiatives were between 6 and 22 percentage points more likely to routinely perform the care processes than physicians with EHRs alone.
Conclusions: In 2012, physicians using EHRs and participating in ACO or PCMH initiatives were more likely than other physicians to be routinely engaging in care processes expected to improve healthcare outcomes. Yet, many US physicians were not performing these processes routinely. This analysis highlights several specific areas where more work is necessary to facilitate wider adoption of these activities.
Am J Manag Care. 2016;22(4):258-265
National policies are supporting the use of health information technology (IT) and testing new models of payment and delivery, such as accountable care organizations (ACO) and patient-centered medical homes (PCMH). This study examined whether use of health IT and participation in new models of care are associated with improved care delivery.
There is wide consensus that changes are necessary in the way healthcare is delivered in the United States in order to realize reductions in healthcare spending and improvements in population health outcomes.1,2 National policies currently support 2 programs that may substantially change the way care is delivered; one related to health information technology (IT) adoption and the other related to payment reform and the use of new care delivery models.3
The Health Information Technology Act (HITECH) Act of 2009 was designed to provide the infrastructure necessary for improvements in care delivery by supporting greater adoption of IT tools, including electronic health records (EHRs), which can facilitate high-quality care.4 The HITECH Act authorized the Medicare and Medicaid EHR Incentive Programs, which provide financial assistance to eligible professionals for the “meaningful use” (MU) of certified EHRs with functionalities associated with enhanced quality of care, such as electronic prescribing and medication alerts.5
Concurrently, the 2010 Affordable Care Act (ACA) is supporting the development and implementation of new delivery and payment models, such as patient-centered medical homes (PCMHs) and shared savings arrangements like accountable care organizations (ACOs). Although EHRs are not required for participation in all types of PCMH or ACO programs, it is widely believed that providers need a robust health IT infrastructure to be fully successful in these payment and delivery arrangements.6-7
Early indicators suggest strong physician participation in initiatives to support health IT adoption and to reform healthcare payment and delivery.8-12 However, evidence on whether provider participation in these initiatives has translated to better care delivery is just beginning to emerge.13-15 Areas identified as priorities for improvement include care processes, such as population management and prevention, quality measurement and reporting, care coordination, and patient engagement.2 Although studies prior to HITECH and the ACA found health IT and external reporting or payment incentives to be associated with a higher likelihood of performing these care processes, they are performed at low rates even when these factors are in place.16-20 At least 1 study of primary care physicians found evidence that those in PCMH practices using EHRs had greater quality improvements and changes in utilization over time on some measures than those in non-PCMH practices with or without EHRs.21,22
We examined 4 main questions about the relationship between EHR use, participation in new payment and delivery models, and the extent to which physicians perform care processes that may lead to improved outcomes. First, how routinely did US physicians perform population management, quality measurement, patient communication, and care coordination processes? Second, were physicians using EHRs and participating in ACO or PCMH initiatives more likely than other physicians to perform these 4 types of care processes? Third, given that health IT and new payment models often are envisioned to work symbiotically to improve care,23,24 were physicians using EHRs and participating in ACO or PCMH initiatives more likely to routinely perform these types of care processes than those using EHRs alone? Finally, since previous studies have shown room for improvement in the extent to which EHR adopters use their EHRs to engage in these care processes,25 were certain EHR-related factors associated with use of computerized tools to routinely perform these processes? The results of this study may be useful to policy makers and researchers concerned with the level of adoption of these advanced care processes and the potential policies and tools to support their greater diffusion.
Data Source and Analysis Sample
We used data from the 2012 National Ambulatory Medical Care Survey (NAMCS) Physician Workflow Survey, the second wave of a panel survey conducted by the National Center for Health Statistics to collect nationally representative information on physicians’ attitudes toward and experiences with EHRs.26 The first wave of the Physician Workflow Survey was conducted in 2011 as a follow-up to the 2011 NAMCS Electronic Health Records Survey.27
The sample for the 2012 NAMCS Physician Workflow Survey came from the 2011 NAMCS Electronic Health Records Survey (ie, nonfederal office-based physicians, excluding radiologists, anesthesiologists, and pathologists). Eligibility status was determined for 8198 of the 10,302 physicians sampled, and those deemed eligible were mailed the Physician Workflow questionnaire. In 2012, 2567 physicians responded for an unweighted response rate of 45%. There were no significant differences in characteristics between responders and nonresponders.
Measuring Care Processes
The 2012 NAMCS survey included 14 separate items that queried physicians on 14 specific care processes in 4 categories: population management, quality measurement, patient communication, and care coordination. For each care process, the survey asked “Is this done routinely?” (yes/no) and then “Is this process computerized?” (yes, usually/yes, sometimes/no).
Use of care processes. In the multivariate analyses described below, we used 2 sets of dependent variables. First, to examine factors associated with routinely performing the care processes overall, we assigned the dependent variables a value of 1 if the physician reported routinely performing each process, and 0 otherwise. Second, to examine EHR-related factors associated with routinely performing the care processes using computerized tools, we assigned the dependent variables a value of 1 if the physician reported the process was performed routinely and the process was computerized (either usually or sometimes), and 0 otherwise. Missing responses, which ranged from 2% to 11% across the items, were assigned the value of 0.
For ease of communicating results across the 14 processes queried in the survey, we also created 1 measure for each of the 4 categories indicating whether at least 1 of the processes in the category was performed routinely. We reported multivariate results for these category-level measures in the main text and reported multivariate results for all 14 individual processes in the [eAppendices available at www.ajmc.com]). The results for the category-level measures were substantively similar to the results for the individual process measures.
EHR use and characteristics. We measured EHR use based on the question, “Which of the following best describes [your primary practice] location’s current EHR adoption status?” with response options: 1) “We do not have an EHR system,” 2) “We are not actively using an EHR system but have one installed,” and 3) “We are actively using an EHR system.” Our main measure of EHR use assessed whether or not the physician reported their primary practice location was actively using an EHR. We also reported the percent of physicians who responded, “We are not actively using an EHR system but have one installed” or answered yes to another question, “At the reporting location, are there plans for installing a new EHR system within the next 12 months?”
We examined 3 EHR-related characteristics among physicians using EHRs: whether the EHR met MU criteria, the length of EHR experience, and the receipt of technical assistance for initial EHR implementation. Physicians who answered “yes” to the question, “Does your current system meet meaningful use criteria as defined by the Centers for Medicare & Medicaid Services (CMS)?” were considered to have EHRs that met MU criteria. Length of EHR experience was calculated based on the difference between year of the survey (ie, 2012) and year reported in response to the item: “In which year did you install your EHR system?” Receipt of technical assistance was based on questions about whether the physician’s primary practice location received assistance “in implementing an EHR system” (yes/no/uncertain) and “with training staff in using your EHR system” (yes/no/uncertain).
ACO or PCMH participation. We measured participation in ACO or PCMH arrangements based on responses to 2 questions: 1) “Does [your primary practice location] participate in an Accountable Care Organization or similar arrangement by which you may share savings with insurers (including private insurance, Medicare, Medicaid, and other public options)?” and 2) “Does [your primary practice location] receive any additional compensation beyond routine visit fees for offering Patient-Centered Medical Home (PCMH)-type services or does [the location] participate in a certified PCMH arrangement?”
In multivariate analyses (described below), we used a measure of whether or not the physician reported participating in either an ACO or PCMH arrangement. Results of sensitivity analyses examining ACO and PCMH participation as separate variables were similar to results from the combined variable (results not shown but are available on request).
We first conducted univariate and bivariate descriptive statistics of the key independent and dependent variables. We then performed multivariate logistic regression to examine the relationship between EHR use, ACO or PCMH participation, and routinely performing the care processes while controlling for other physician and office characteristics. We estimated 18 logistic regression models (1 for each of the 14 individual process measures and the 4 category-level measures), regressing the dependent variable (whether or not the physician routinely performed the process of interest) on whether the physician used any EHR, whether the physician participated in an ACO or PCMH, and an interaction between the EHR use and ACO/PCMH participation variables. The models also included physician and practice characteristics as control variables: physician age, physician specialty, practice size, practice ownership, practice specialty, county metropolitan status, and region (eAppendix Table 1).
To assess whether EHR use and ACO or PCMH participation were independently associated with routinely performing the care processes, we used the logistic regression results to calculate the average incremental effects of EHR use and ACO or PCMH participation. To assess whether physicians using EHRs and participating in ACO or PCMH initiatives are more likely to routinely perform these care processes than those using EHRs alone, we used the regression results to calculate predicted probabilities for combinations of the interaction.
Finally, we conducted multivariate logistic regression to assess whether, among EHR adopters, certain EHR-related factors were associated with a higher likelihood that EHR users routinely perform the care processes using computerized tools. The analysis sample for these regressions was the subset of office-based physicians who were using an EHR. We estimated 18 logistic regression models (1 for each of the 14 individual process measures and the 4 summary measures), regressing the dependent variable (whether or not the physician routinely performed the process of interest using computerized tools) on the 3 EHR-related characteristics: met MU criteria, EHR installation year, and staff received EHR training. The models also included the same control variables as above and the ACO or PCMH participation variable. We used the regression results to calculate the average incremental effects of the EHR related factors.
All analyses were conducted using Stata 11.2 (StataCorp LP, College Station Texas), using weights to account for nonresponse and adjusting standard errors for the complex survey design. We used a regression model that predicts the likelihood of responding to the survey, to develop weights to ensure that our survey was nationally representative.
EHR Use and Participation in ACO or PCMH Initiatives
In 2012, a majority of office-based physicians were using an EHR (62%), with about half of all physicians using an EHR that was certified to meet MU criteria (48%) (). Over 1 in 5 physicians (22%) were participating in either an ACO (16%) or PCMH (9%) (Figure 1)—4% reported participating in both models, 13% in ACO only, and 6% in PCMH only (data not shown). A majority of physicians participating in these models used an EHR certified for MU (Figure 1). Overall, 18% of physicians reported using an EHR and participating in an ACO or PCMH. Additionally, 44% of physicians reported using an EHR but not participating in one of these care delivery models, and the remaining 38% of physicians did not use an EHR.
Physician Performance of Care Processes
The majority of physicians reported performing at least 1 care process routinely in the categories of care coordination (89%), patient communication (69%), and population management (67%) (). Less than half (44%) reported performing quality measurement processes routinely. There was variation in the extent to which physicians routinely performed specific processes within each category (eg, the population management processes ranged from 13% for creating lists of patients by lab results to 58% for providing patients with reminders for follow-up or preventive care). Among physicians who routinely performed a given process, the majority reported that the process was computerized.
Relationship Between EHR Use, Participation in ACO or PCMH Initiatives, and Performance of Care Processes
Physicians using EHRs were significantly more likely to perform care processes across all 4 categories (). For example, physicians using EHRs were 15 percentage points more likely than physicians without EHRs to routinely perform at least 1 population management process. Similarly, physicians participating in new delivery models were significantly more likely to routinely perform these processes. The magnitude of the incremental effects for EHR use and ACO or PCMH participation were similar (ie, there were no statistically significant differences between the incremental effects [test not shown]).
Physicians who were using EHRs in combination with participation in ACO or PCMH initiatives had the highest likelihood of routinely performing the care processes (). Among physicians not participating in either type of initiative, using an EHR was associated with a 14 to 27 percentage point greater likelihood of routinely performing at least 1 care processes in 3 of the 4 categories (not care coordination). However, across all categories, physicians who had an EHR and participated in ACO or PCMH initiatives were between 6 and 22 percentage points more likely to routinely perform the care processes than physicians with EHRs alone. The same results were found in analyses of the individual care processes in each category (eAppendix Table 3).
Relationship Between EHR-Related Factors and Performance of Care Processes Among Physicians Using EHRs
Among the 62% of physicians using an EHR in 2012, those with EHRs certified to meet MU criteria were significantly more likely to routinely perform at least 1 care process in a computerized manner across all 4 categories (Table 2). For example, physicians using EHRs certified to meet MU criteria were 15 percentage points more likely than physicians using other EHRs to routinely perform at least 1 population management process in a computerized manner. The same results were found in analyses of the individual care processes in each category
(eAppendix Table 4).
Physicians at practices with longer experience with their current EHR were more likely to routinely perform 1 or more processes in a computerized manner across all categories. Assistance with initial EHR implementation and assistance with training staff to use the EHR were not significantly associated with the likelihood of routinely performing any care process in a computerized manner in the categories.
The National Quality Strategy has prioritized several areas for improvement, including population management and prevention, quality measurement and reporting, care coordination, and patient engagement. 2 This study finds that US physicians’ rates of performing these care processes varied; although a majority reported routinely conducting at least 1 care process related to care coordination, patient communication, and population management, less than half reported performing at least 1 quality measurement process routinely.
Potential mechanisms to enable more widespread adoption of these care processes include use of health IT and payment and delivery reform.6 Across 4 categories of care processes examined in this analysis, physicians who used EHRs were significantly more likely to routinely engage in these processes. With the exception of care coordination activities—where fewer than half of all physicians reported routinely using computerized tools to engage in certain patient communication activities or conduct care coordination activities—these processes were usually performed with computerized tools, especially by physicians with EHRs that met MU criteria compared with those using other EHRs. Moreover, EHR users who participated in shared savings or medical home delivery models had the highest likelihood of performing these care processes routinely. Given the cross-sectional nature of this study, these results do not establish a causal relationship between payment reform, EHR use, and these care processes. Nonetheless, this finding is consistent with other research that shows that healthcare providers are most likely to perform these care processes when practicing in a payment environment that incentivizes and supports such care.6,23
Although physicians using robust EHRs and participating in new models of healthcare payment and delivery were more likely to perform care processes expected to lead to improved healthcare outcomes, most US physicians were not routinely performing specific population management and quality measurement processes that require the aggregation and analysis of individual patient data, such as creating patient lists or reports on quality measures. Quality measurement processes were not performed uniformly even among the one-fifth of physicians who were using EHRs and participating in novel payment and delivery models.
Several of the care processes that physicians were less likely to engage in as of 2012 are targeted in Stage 2 of the Medicare and Medicaid EHR Incentive Program (ie, “Meaningful Use”). For example, to qualify for incentive payments and avoid Medicare payment adjustments, providers will be required to meet several population management, patient communication, and care coordination objectives, including: generating lists of patients by specific conditions for use in quality improvement, disparities reduction, or outreach activities; providing patients with the ability to view online, download, and transmit their health information; and providing summary of care records in a standardized electronic format during transitions across settings of care.28
This analysis is subject to limitations of self-reported survey data, including the potential for measurement error from recall and nonresponse bias. For example, nonresponse bias could affect the analysis if physicians engaging in certain care processes were more likely to respond to the survey. In such a case, our estimates of the percent of physicians engaging in these processes may be biased upwards. The survey was weighted based on characteristics of responders and nonresponders to minimize potential for this bias.
Our measures of ACO or PCMH participation are based on single survey items and may capture participation in arrangements with varying levels of intensity. For example, the group of physicians reporting PCMH participation may include physicians in practices with formal PCMH certification from an accrediting body, as well as physicians participating in other medical home initiatives with less rigorous requirements. Length of time in the ACO or PCMH arrangement, or level of implementation, was not captured; length and level of implementation likely varies within the group of physicians reporting participation in these initiatives.
Finally, the cross-sectional study design precludes the possibility of drawing causal conclusions about the relationship between EHR use, participation in new delivery models, and routinely performing the care processes. For example, it is possible that physicians using EHRs and participating in ACO or PCMH initiatives in 2012 were more likely to perform these care processes due to other unobserved factors. We cannot definitively conclude that relationships observed in this analysis will generalize to later adopters as they begin to use EHRs or participate in new delivery or payment models.
In 2012, EHR use and participation in ACO or PCMH initiatives were associated with increased likelihood that physicians were engaging routinely in processes related to population management, quality measurement, patient communication, and care coordination processes. Yet, many US physicians were not performing these processes routinely. Our analysis highlights several specific areas—including population management processes that require the aggregation and analysis of individual patient data and communication with patients and other care team members—where additional technology and policy supports may be important to facilitate wider adoption of these activities.
Author Affiliations: Office of the National Coordinator for Health Information Technology (JK, VP), Washington, DC; Centers for Disease Control and Prevention (EJ), Hyattsville, MD; Mathematica Policy Research (CD), Princeton, NJ.
Source of Funding: None.
Author Disclosures: Dr Jamoom is on the advisory board for the AcademyHealth Special Interest Advisory Group for Health IT. The remaining authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (JK, VP, EJ, CD); acquisition of data (EJ); analysis and interpretation of data (JK, VP, EJ, CD); drafting of the manuscript (JK, VP); critical revision of the manuscript for important intellectual content (JK, VP, EJ, CD); statistical analysis (JK, VP, EJ, CD).
Address correspondence to: Vaishali Patel, PhD, MPH, Office of the National Coordinator for Health Information Technology, 330 C St, SW, Rm 7025A, Washington, DC 20201. E-mail: email@example.com.
1. National Research Council. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington DC: The National Academies Press, 2001.
2. 2011 report to Congress: national strategy for quality improvement in health care. National Quality Strategy website. http://www.ahrq.gov/workingforquality/nqs/nqs2011annlrpt.htm. Published March 2011. Accessed March 24, 2016.
3. Buntin MB, Jain SH, Blumenthal D. Health information technology: laying the infrastructure for national health reform. Health Aff (Millwood). 2010;29(6):1214-1219. doi: 10.1377/hlthaff.2010.0503.
4. Buntin MB, Burke MF, Hoaglin MC, Blumenthal D. The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff (Millwood). 2011;30(3):464-471. doi: 10.1377/hlthaff.2011.0178.
5. Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363(6):501-504. doi: 10.1056/NEJMp1006114.
6. Bitton A, Flier LA, Jha AK. Health information technology in the era of care delivery reform: to what end? JAMA. 2012;307(24):2593-2594. doi: 10.1001/jama.2012.6663.
7. Bates DW, Bitton A. The future of health information technology in the patient-centered medical home. Health Aff (Millwood). 2010;29(4):614-621. doi: 10.1377/hlthaff.2010.0007.
8. Hsiao CJ, Jha AK, King J, Patel V, Furukawa MF, Mostashari F. Office-based physicians are responding to incentives and assistance by adopting and using electronic health records. Health Aff (Millwood). 2013;32(8):1470-1477. doi: 10.1377/hlthaff.2013.0323.
9. Muhlestein D. Why has ACO growth slowed? Health Affairs blog. http://healthaffairs.org/blog/2013/10/31/why-has-aco-growth-slowed/?goback=.gde_2409100_member_5801792352376868865. Published October 31, 2013. Accessed December 11, 2013
10. Lewis VA, Colla CH, Carluzzo KL, Kler SE, Fisher ES. Accountable care organizations in the United States: market and demographic factors associated with formation. Health Serv Res. 2013;48(6, pt 1):1840-1858. doi: 10.1111/1475-6773.12102.
11. Auerbach DI, Liu H, Hussey PS, Lau C, Mehrotra A. Accountable care organization formation is associated with integrated systems but not high medical spending. Health Aff (Millwood). 2013;32(10):1781-1788. doi: 10.1377/hlthaff.2013.0372
12. Patient-centered medical homes fact sheet. National Committee for Quality Assurance website. http://www.ncqa.org/Portals/0/Public%20Policy/2013%20PDFS/pcmh%202011%20fact%20sheet.pdf. Published 2013. Accessed December 11, 2013.
13. Zutshi A, Peikes D, Smith K, Azur M, Genevro J, Parchman M, Meyers D. The medical home: what do we know, what do we need to know? a review of the earliest evidence on the effectiveness of the patient-centered medical home model [AHRQ pub No. 12(14)-0020-1-EF]. Agency for Healthcare Research and Quality website. http://pcmh.ahrq.gov/page/medical-home-what-do-we-know-what-do-we-need-know-review-earliest-evidence-effectiveness-of-the-patient-centered-medical-home-model. Published March 2013. Accessed November 2, 2013.
14. Peikes D, Zutshi A, Genevro JL, Parchman ML, Meyers DS. Early evaluations of the medical home: building on a promising start. Am J Manag Care. 2012;18(2):105-116.
15. Fisher ES, Shortell SM, Kreindler SA, Van Citters AD, Larson BK. A framework for evaluating the formation, implementation, and performance of accountable care organizations. Health Aff (Millwood). 2012;31(11):2368-2378. doi: 10.1377/hlthaff.2012.0544.
16. Casalino LP, Wu FM, Ryan AM, et al. Independent practice associations and physician-hospital organizations can improve care management for smaller practices. Health Aff (Millwood). 2013;32(8):1376-1382. doi: 10.1377/hlthaff.2013.0205.
17. Alexander JA, Maeng D, Casalino LP, Rittenhouse D. Use of care management practices in small- and medium-sized physician groups: do public reporting of physician quality and financial incentives matter? Health Serv Res. 2013;48(2, pt1):376-397. doi: 10.1111/j.1475-6773.2012.01454.x.
18. Rittenhouse DR, Shortell SM, Gillies RR, et al. Improving chronic illness care: findings from a national study of care management processes in large physician practices. Med Care Res Rev. 2010;67(3):301-320. doi: 10.1177/1077558709353324.
19. Casalino L, Gillies RR, Shortell SM, et al. External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. JAMA. 2003;289(4):434-441.
20. Rundall TG, Shortell SM, Wang MC, et al. As good as it gets? chronic care management in nine leading US physician organisations. BMJ. 2002;325(7370):958-961.
21. Kern LM, Edwards A, Kaushal R. The patient-centered medical home, electronic health records, and quality of care. Ann Intern Med. 2014;160(11):741-749. doi: 10.7326/M13-1798.
22. Kaushal R, Edwards A, Kern LM. Association between the patient-centered medical home and healthcare utilization. Am J Manag Care. 2015;21(5):378-386.
23. Kellermann AL, Jones SS. What it will take to achieve the as-yet-unfulfilled promises of health information technology. Health Aff (Millwood). 2013;32(1):63-68. doi: 10.1377/hlthaff.2012.0693.
24. Mostashari F, Colbert JA. Four key competencies for physician-led accountable care organizations. Am J Account Care. 2014;2(1):15-16.
25. DesRoches CM, Audet AM, Painter M, Donelan K. Meeting meaningful use criteria and managing patient populations: a national survey of practicing physicians. Ann Intern Med. 2013;158(11):791-799. doi: 10.7326/0003-4819-158-11-201306040-00003.
26. CDC/National Centers for Health Statistics. About the Ambulatory Care Surveys. http://www.cdc.gov/nchs/ahcd/about_ahcd.htm. Accessed March 24, 2016.
27. Jamoom E, Beatty P, Bercovitz A, Woodwell D, Palso K, Rechtsteiner E. Physician adoption of electronic health record systems: United States, 2011 [NCHS data brief No. 98]. CDC website. http://www.cdc.gov/nchs/data/databriefs/db98.htm Updated January 11, 2013. Accessed March 24, 2016.
28. CMS, HHS. Medicare and Medicaid Electronic Health Record Incentive Program—stage 2 [final rule]. Government Printing Office website. https://www.gpo.gov/fdsys/pkg/FR-2012-09-04/pdf/2012-21050.pdf. Published September 4, 2012. Accessed March 24, 2015.