Currently Viewing:
The American Journal of Managed Care November 2016
Currently Reading
Referrals and the PCMH: How Well Do We Know Our Neighborhood?
Andrew Schreiner, MD; Patrick Mauldin, PhD, Jingwen Zhang, MS; Justin Marsden, BS; and William Moran, MD, MS
A New Chapter in Health Reform
Michael E. Chernew, PhD, and A. Mark Fendrick, MD
Prescribers' Perceptions of Medication Discontinuation: Survey Instrument Development and Validation
Amy Linsky, MD, MSc; Steven R. Simon, MD, MPH; Kelly Stolzmann, MS; Barbara G. Bokhour, PhD; and Mark Meterko, PhD
Enhancing Patient and Family Engagement Through Meaningful Use Stage 3: Opportunities and Barriers to Implementation
Jaclyn Rappaport, MPP, MBA; Sara Galantowicz, MPH; Andrea Hassol, MSPH; Anisha Illa, BS; Sid Thornton, PhD; Shan He, PhD; Jean Adams, RN, ACIO; and Charlie Sawyer, MD, FACP
Integrated Care Organizations: Medicare Financing for Care at Home
Karen Davis, PhD; Amber Willink, PhD; and Cathy Schoen, MS
Reconsidering the Economic Value of Multiple Sclerosis Therapies
Tiffany Shih, PhD; Craig Wakeford, MA; Dennis Meletiche, PharmD; Jesse Sussell, PhD; Adrienne Chung, PhD; Yanmei Liu, MS; Jin Joo Shim, MS; and Darius Lakdawalla, PhD
Health Systems Tackling Social Determinants of Health: Promises, Pitfalls, and Opportunities of Current Policies
Krisda H. Chaiyachati, MD, MPH; David T. Grande, MD, MPA; and Jaya Aysola, MD, DTMH, MPH
Maternal Mental Health and Infant Mortality for Healthy-Weight Infants
Susan E. White, PhD, RHIA, CHDA, and Robert W. Gladden, MA, BS
The Role of Internal Medicine Subspecialists in Patient Care Management
Jonathan L. Vandergrift, MS; Bradley M. Gray, PhD; James D. Reschovsky, PhD; Eric S. Holmboe, MD; and Rebecca S. Lipner, PhD
Medical Home Transformation and Breast Cancer Screening
Amy W. Baughman, MD, MPH; Phyllis Brawarsky, MPH; Tracy Onega, PhD, MS; Tor D. Tosteson, ScD; Qianfei Wang, MS; Anna N.A. Tosteson, ScD; and Jennifer S. Haas, MD, MSc

Referrals and the PCMH: How Well Do We Know Our Neighborhood?

Andrew Schreiner, MD; Patrick Mauldin, PhD, Jingwen Zhang, MS; Justin Marsden, BS; and William Moran, MD, MS
A descriptive analysis of specialty referral patterns in an academic, internal medicine patient-centered medical home (PCMH).

Characterize patterns of referral from a patient-centered medical home (PCMH) and observe the association of provider experience, patient chronic disease burden, and risk of utilization on referral placement.

Study Design: Descriptive analysis of referral patterns in an academic, internal medicine PCMH.

Methods: We examined referrals (eg, specialist visit, testing, ancillary services) placed between July and December of 2014 in an academic PCMH caring for a total of 12,000 patients. All referrals originated from the outpatient PCMH clinic and were divided into resident or faculty clinic based on the assigned primary care provider. Patients with a referral during the 6-month study period served as the unit of analysis, and we developed a generalized linear model to identify variables associated with referral placement. We estimated the association of the patients’ risk of healthcare utilization using a risk stratification tool.

Results: The faculty placed 1709 referrals for 3055 unique patients seen compared with 2388 referrals for 2434 unique patients seen by residents. For those patients receiving referral, a mean of 1.72 referrals were placed, with residents having significantly more referrals per patient (1.9 ± 1.3 vs 1.5 ± 0.9; P <.0001). For patients at highest risk of utilization, residents were referred at a rate of 0.327 compared with 0.226 (P = .0035) in the faculty clinic.

Conclusions: In an academic setting, provider and patient factors play a role in referral patterns. Residents refer highest-risk patients more often than their faculty counterparts, while there is no difference for lower-risk patients.

 Am J Manag Care. 2016;22(11):721-725
Take-Away Points
  • Provider experience may matter; resident physicians placed more referrals per patient than their faculty counterparts.
  • Chronic disease may also impact referral patterns: diagnoses of chronic obstructive pulmonary disease, peripheral vascular disease, depression, obesity, peptic ulcer disease, and drug abuse increase the likelihood of referral. Iron deficiency anemia decreased the likelihood of referral.
  • The intersection of the patient’s risk of utilization and provider experience reveals residents refer high-risk patients more often than faculty, and that this difference in rate of referral narrows as we move down the spectrum of risk.
Patient-centered medical homes (PCMHs) seek to improve care coordination for patients through the use of multidisciplinary teams and learning health systems. Ambulatory referral processes provide an opportunity to utilize these teams and systems to enhance the quality of patient care. Referrals for specialist consultation, ancillary services, and high-cost procedures in the ambulatory care setting are a source of great expense, miscommunication, and general frustration.1 

Issues, including stresses on clinical volume, increased cost, fragmentation of care, and lack of process transparency associated with referral processes are well documented in the literature,1-3 even from as long ago as the 1960s when Kunkle and colleagues described the process as “needlessly inefficient.”4 Although this “inefficient” label may have been intended for the specific process of information transfer and implementation, it may apply to our current referral practices, as well. As we seek to optimize value in healthcare, we need to know how ambulatory referrals impact our goal of improving quality while lowering cost and improving the patient care experience. Referral volume is immense: studies in the 1990s and 2000s observed Medicare beneficiaries receiving 2 referrals per patient per year and seeing an average of 5 specialists in a 365-day period.5,6 Bodenheimer and colleagues showed that more than one-third of primary care patients receive a specialty referral in a given year.5

In this study, we wanted to characterize current patterns of referral (eg, specialist visit, testing, ancillary services) initiated from our academic PCMH using the model originally described by Mehrotra and colleagues in their narrative review of the literature.1 We focused on the patterns of referral through the lenses of provider experience and the patient’s risk of healthcare utilization.1,7-9 In our academic National Committee for Quality Assurance–certified level 3 PCMH, we compared referral patterns of internal medicine residents and faculty to assess the association of referrals with provider years of practice. We also incorporated a risk stratification tool for the PCMH patients so clinicians and researchers can observe the association of the patients’ risk of healthcare utilization on referral patterns.


We compared referral patterns between the faculty and resident practices in the Medical University of South Carolina’s (MUSC) academic internal medicine PCMH. Utilizing the electronic health record (EHR), we searched for all referrals placed for these patients during the 6-month period between July and December of 2014. Qualifying referrals included orders for specialty consultation, ancillary services (eg, physical, speech, and occupational therapies), home- and community-based services (eg, home health, durable medical equipment, and rehabilitation), and high-cost imaging (eg, computerized tomography and magnetic resonance imaging scans) during the study period (Table 1). All referrals were generated from the PCMH. All consultation orders placed by providers in the inpatient setting were excluded. Data was divided into resident or faculty clinic based on the assigned primary care physician. The PCMH structure attributes all patients to an individual primary care physician; the clinic recognizes resident physicians as the primary providers in the EHR, but they practice under faculty supervision. 

In addition to classifying referral patterns based on provider experience, we looked at referral patterns stratified by patient risk of hospital utilization, a composite of hospitalization and emergency department (ED) visits. We utilized a risk stratification tool that was devised, developed, and validated at the MUSC, and detailed further in the literature.10 Using this tool, the patients in the PCMH were stratified into 5 quintiles of risk. The fifth quintile represents the highest likelihood of utilization, and the first quintile, the lowest. Risk stratification was performed prior to identifying faculty or resident clinic association. Additionally, the risk tool was applied to the PCMH as a whole, not only to those patients receiving a qualifying referral.

Patients with a referral during the 6-month study period served as the unit of analysis. Referral statistics were calculated and distribution was analyzed. A generalized linear model was applied to identify variables associated with referral placement; a Poisson distribution with log link was assumed as our dependent variable (number of referrals) and assessed for multicollinearity. Multicollinearity exists when 2 or more of the predictor variables are moderately or highly correlated, limiting conclusions from the model. Backward selection determined the variables selected for the model (based on P ≤.20).

A z test for comparing 2 population proportions was also used. SAS version 9.3 (SAS Institute Inc, Cary, North Carolina) was used for statistical analyses. This project was approved by the MUSC Institutional Review Board.


During our 6-month study period, a total of 4097 referrals were placed for 2387 patients. Table 1 classifies the types of referrals ordered. Table 2 describes the patients receiving a referral between the 2 study clinics. With regards to referral volume, 1709 referrals were placed for 1111 patients in the faculty clinic during the study period (Table 2). Patients receiving a referral from a faculty member were older and more often male, white, and married compared with resident patients referred. Patients who were referred by a resident were more often poor or reliant on Medicare and/or Medicaid compared with faculty patients referred. These demographic discrepancies persist in the resident and faculty clinics as a whole, irrespective of referral status. During the 6-month study, 3055 unique patients were seen and 6298 individual visits were generated by the faculty. In this context, the faculty placed 0.364 referrals per patient and 0.271 referrals per visit. In contrast, the residents placed 2388 referrals for 1276 patients while seeing 2434 unique patients and conducting 5640 visits during the study period. The residents placed more referrals per patient seen (0.524 vs 0.364; P <.0001) and more referrals per visit (0.423 vs 0.220; P <.0001) compared with the faculty. Of the patients referred, an average of 1.72 referrals were placed. With the risk stratification model already applied, this was analyzed in the context of those patients having been referred (Table 2). Of those referred, the resident clinic had significantly more referrals per patient (1.9 ± 1.3 vs 1.5 ± 0.9; P <.0001).

The generalized linear model (Table 3) revealed 5 parameters with a significance of P ≤.05 with the outcome of referral. At this level, chronic obstructive pulmonary disease (COPD), peripheral vascular disease (PVD), depression, and obesity increased the likelihood of referral, whereas assignment to the faculty clinic decreased the likelihood. Three parameters at the P ≤.1 level of significance included peptic ulcer disease and drug abuse, which increased the likelihood of referral; iron deficiency anemia decreased the likelihood. The rate of referral (referrals divided by the patients assigned to the respective clinic) was calculated by tier of utilization in both the faculty and resident clinic groups, as seen in the Figure. For those at the highest risk of utilization (fifth tier), residents referred patients at a rate of 0.327 versus 0.226 in the faculty clinic (P = .0035). As we move down the spectrum of risk, the rate gap narrows, with no significant difference in referral rates between faculty and residents. The fourth tier of utilization has a referral rate of 0.160 for the residents and 0.198 for the faculty (P = .0535).


In this descriptive analysis, there were more referrals placed in the resident clinic (2388 vs 1709) despite fewer total visits. For those patients referred, the average number of referrals per patient (for those patients referred) was significantly greater in the resident clinic (1.9 vs 1.5; P <.0001). Multiple factors may play a role in this difference.

With regard to healthcare setting, reduced provider continuity in the resident clinic could contribute to this increase in referrals. Multiple providers (both residents and faculty) navigating a crowded EHR might result in the placing of redundant referrals, ordering additional services, or requesting further testing unnecessarily. Haggerty and colleagues described continuity in the referral process in 3 domains: information fidelity, coherent management, and ongoing therapeutic relationships.11 Failure to deliver continuity in these domains may potentially increase referral volume and may help to explain the results.

Patient-level factors also play a role, such as the patient’s risk of utilization, access to resources, chronic medical conditions, and desire for referral.3,12,13 In considering patient utilization risk, a substantially greater total of high-risk (quintile 5 utilization) patients are seen in the resident clinic as opposed to the faculty clinic (1878 vs 199, respectively). Higher utilization may necessitate an increased need for assistance in managing these patients. It may also suggest higher complexity, which impacts referral decision making by increasing the likelihood that there will be difficult conditions to manage outside the scope of the primary provider. Additionally, increased patient complexity may limit the time a primary provider can allot to each condition, leading to an increase in referral placement. However, the involvement of more subspecialists increases the potential for miscommunication, additional testing, and polypharmacy, which may contribute to higher rates of ED visits and hospitalizations.

Resident clinic patients likely also have less access to specialty services. In our study, the resident patients receiving referrals relied on public payers more often and were often more impoverished than faculty patients. These factors decrease a patient’s ability to be seen in specialty clinics, receive ancillary services, or obtain high-priced testing, and this lack of access—likely resulting in a lower rate of referral completion—might paradoxically drive an increase in orders placed. Lastly, the patient’s chronic medical conditions likely impact referral patterns. Chen and colleagues showed the impact of patient comorbidities, expectations, and the diagnosis attached to referral on referral patterns.8 The generalized linear model sought to evaluate this issue in the study sample. The presence of obesity, depression, COPD, and PVD all increased the likelihood of referral. Although these conditions’ contribution to morbidity can be appreciated, it is interesting that they lead to high referral patterns in that they are almost all managed by primary care physicians, except at the extremes of disease.

Further investigation into the diagnosis for which providers generate referral may be valuable in further characterizing these orders. With regards to provider experience, the results of previous studies suggest providers with less experience refer more often,14,15 and our findings agree. A more focused investigation into the impact of provider experience on referral patterns may further address this issue.

Copyright AJMC 2006-2020 Clinical Care Targeted Communications Group, LLC. All Rights Reserved.
Welcome the the new and improved, the premier managed market network. Tell us about yourself so that we can serve you better.
Sign Up