Data from a national survey of Veterans Health Administration specialists indicate that referral templates may improve the appropriateness, clarity, and completeness of primary care–specialty care referrals.
Objectives: Referrals from primary to specialty care are a critical first step in coordination of specialty care, but shortcomings in the appropriateness, clarity, or completeness of referrals are common. We examined (1) whether 3 tools to coordinate specialty care are associated with better referral characteristics and (2) whether greater perceived helpfulness of these tools is associated with better referral characteristics among specialists who use all 3 of them.
Study Design: National online survey about care coordination among medical specialists receiving referrals in the Veterans Health Administration.
Methods: Adjusted odds ratios (ORs) for associations between use and helpfulness of 3 coordination tools (service agreements, referral templates, and e-consults) and perceived frequency of 3 referral characteristics (appropriateness, clarity, and completeness).
Results: Among specialists (N = 497), use of referral templates was associated with perceptions that referrals were more frequently appropriate (adjusted OR, 1.5; 95% CI, 1.0-2.4), clear (adjusted OR, 1.6; 95% CI, 1.0-2.5), and complete (adjusted OR, 1.9; 95% CI, 1.1-3.2). Use of e-consults was associated with more frequent referral clarity (adjusted OR, 1.7; 95% CI, 1.0-3.0). Among specialists using all 3 tools, those reporting that templates were very helpful also perceived more frequent referral clarity (adjusted OR, 3.1; 95% CI, 1.1-8.5) and completeness (adjusted OR, 3.6; 95% CI, 1.5-8.7). Service agreements were not associated with any referral characteristic.
Conclusions: Well-designed referral templates may help improve the clarity and completeness of primary care—specialty care referrals. Existing templates may provide models that can be adapted in collaboration with primary care and broadly applied to improve referrals. Work is needed to improve the impact of service agreements and e-consults on referrals.
Am J Manag Care. 2019;25(8):e237-e242Takeaway Points
Referrals to specialty care from primary care may be inappropriate, unclear, or incomplete, which can contribute to suboptimal specialist evaluations.
More than 100 million ambulatory care visits resulted in a specialty care referral in 2009, and the number continues to rise.1 As the number of providers involved in a patient’s care increases, so does the risk of care fragmentation. Care fragmentation occurs when patient care and information is shared across multiple providers without accounting for the needs and actions of all involved. Fragmented care can lead to patient and provider dissatisfaction, resource waste, and potentially devastating health consequences.2 Risks to patients include missed and unmet needs,3 duplicated tests,4 medication errors,5 and confusion about their treatment.6 These risks increase exponentially with more sources of medical care,7 raising costs and putting sicker patients in greater danger.2
Referral from primary care to specialty care creates the link between the 2 services and sets the stage for the direction and scope of the patient’s specialty evaluation and care plan. Referrals are therefore a critical first step in coordination of specialty care. Ideally, referrals should reflect a mutual understanding between the primary care provider (PCP) and specialist about when evaluation or care for a condition exceeds a reasonable level for management in primary care (ie, appropriateness for referral). The referral from primary care should also convey a clear question and sufficient historical information about the patient and their condition to focus the consultation (ie, the clarity and completeness of the referral). However, referrals that do not meet these standards are common8 and can result in delayed, duplicative, or incomplete specialty care evaluations, with attendant compromises in the quality of patient care.
Veterans make more than 11 million visits a year to medical specialists within the Veterans Health Administration (VHA),9 which is among the largest integrated healthcare systems in the United States. Preventing adverse outcomes through care coordination is a cornerstone of the VHA’s effort to deliver high-quality specialty care. The VHA has implemented several approaches to improve the clinical appropriateness and content of referrals. Service agreements (ie, care coordination agreements) between local primary and specialty care services outline expectations for each stage of the referral process and include guidelines about clinically appropriate referrals and referral content.10 Referral templates created by specialty services within the shared electronic health record (EHR) are used to structure referrals and guide PCPs in terms of what content to include.3 E-consults are a third coordination tool, intended to shuttle less-complex questions to consultation by chart review so that referrals for face-to-face visits need only be placed for appropriate clinical situations that require a more intense level of service.11 Specialists can request further specification of the referral question or inclusion of additional historical information at the time of e-consult or if they convert an e-consult to a traditional referral.
Specialty services commonly use these tools (service agreements, templates, and e-consults), but little is known about the degree to which any of them improve the appropriateness, clarity, and completeness of referrals from primary care and, thereby, more effectively serve to coordinate care between PCPs and specialists.
We used data from an online survey of VHA specialists’ experience with care coordination to examine the relationships between the use of each of these 3 referral tools and the frequency of desirable referral characteristics. We addressed the following questions: Is the use of referral tools to coordinate specialty care associated with specialists’ perceptions of better referrals? Among specialists who use all 3 tools, are those who rate the tools as very helpful more likely to report better referrals?
We used data from an online survey about specialty care coordination among 2533 clinicians from 13 medical specialties across the VHA in 2016 to 2017 (25% response rate).12 The study was focused on the experience of clinicians in medical subspecialties who receive referrals. Participants were recruited using a combination of random sampling, posting the survey link to a VHA specialist listserv, and a convenience sample of facility specialty section chiefs who encouraged their physicians to respond. Email addresses were tracked to avoid participation more than once; responses themselves were anonymous. Incentives were not offered, consistent with VHA policy. The survey was administered using SurveyMonkey.13 The study was approved by the institutional review board at the Bedford Veterans Affairs Medical Center.
Respondents reported on both their use (yes/no) and perceived helpfulness of several tools that could be used to coordinate specialty care. We examined 3 tools that we hypothesized to have a relationship to desirable elements of the PCP’s referral request: service agreements, referral templates, and e-consults. Respondents were asked: “If you used them in the last 3 months, how helpful were these tools in promoting coordination of care with PCPs?” Based on the distribution of responses, and to create meaningful categories, we categorized response options as “not used” (not available to me or available to me but did not use in the last 3 months), “at most somewhat helpful” (not at all helpful, a little helpful, or somewhat helpful), and “very helpful” (very helpful or extremely helpful). Secondarily, we collapsed all ratings of helpfulness to create a category for “used” (vs “not used”).
In a separate section of the survey, respondents reported the appropriateness, clarity, and completeness of referrals by answering 3 questions: “How often did consult requests reflect an understanding on the part of the PCP about what constitutes an appropriate referral to your specialty clinic?”, “How often was the reason for the consult request sufficiently clear, such that you understood what the referring PCP was asking of you?”, and “How often did the consult request itself include sufficient clinical history and other information to meet your immediate needs?”. Response options were provided on a 7-point scale (never, rarely [less than 10% of the time], occasionally [about 30% of the time], sometimes [about 50% of the time], frequently [about 70% of the time], usually [about 90% of the time], and always). Based on the distribution of responses, and to retain meaningful categories, we dichotomized responses as “half the time or less” versus “more than half the time.”
The goal of our analysis was to characterize the associations between 3 care coordination tools (service agreements, templates, and e-consults) and the appropriateness, clarity, and completeness of referrals. We hypothesized that, for each tool, specialists who used the tool to coordinate care with PCPs would be more likely to report that referrals received from PCPs were appropriate, clear, and complete more than half the time. We used logistic regression models to estimate associations between use of each of the 3 tools and the outcomes (separate models for each of specialists’ perceptions of the appropriateness, clarity, and completeness of referrals). Based on their potential impact on specialists’ perceptions of the quality of PCP referrals, we adjusted for specialist age, sex, years in VHA, number of VHA clinical sessions per week, and percentage of consult requests related to procedures (≤25% vs >25%).
We also hypothesized that those who rated a tool as very helpful would be more likely to report that referrals were appropriate, clear, and complete than would specialists who rated the tool as at most somewhat helpful. The analysis for this hypothesis was limited to specialists who reported using all 3 tools, so that all respondents would be able to provide meaningful ratings of the perceived relative helpfulness of all 3 tools. Because crude odds ratios (ORs) and 95% CIs for all analyses were very similar to adjusted results (data not shown), we display only the adjusted results in the Tables.
The analytic sample was composed of 497 specialists who provided complete information on all relevant variables. Thirty-nine percent were female, 48% were younger than 50 years, and 54% had been a VHA specialist for less than 10 years (Table 1). Twenty-one percent had more than 5 clinic sessions weekly, and 58% reported that 25% or fewer of referrals were related to procedures.
E-consults were the most commonly used coordination tool (87%), followed by referral templates (69%) and service agreements (41%). One-third (33%) of respondents used all 3 referral tools.
About half (55%) of specialists reported that referrals were appropriate more than half the time, 67% reported that referrals were clear more than half the time, and 25% reported that referrals were complete more than half the time.
Use of Coordination Tools and Perceptions of Referral Characteristics
Specialists who provided templates to structure PCP referrals were statistically more likely to report that referrals were appropriate, clear, and complete more than half the time (Table 2). Specialists who used e-consults were statistically more likely to report that referrals were clear more than half the time. Use of service agreements was not associated with any referral characteristic (Table 2).
Helpfulness of Tools and Perceptions of Referral Characteristics
Among specialists who reported using all 3 coordination tools (33%; n = 163), 54% rated e-consults as very helpful, 26% rated templates as very helpful, and 17% rated service agreements as very helpful (Table 3). Those describing templates as very helpful were statistically more likely to report that referrals were clear and complete more than half the time compared with those describing templates as at most somewhat helpful. Perceived helpfulness of e-consults and service agreements were not associated with any referral characteristics.
Referrals from primary care to specialty care can be difficult to coordinate, and shortcomings are longstanding.14,15 The referral request from primary care to specialty care is a critical first step in coordination as it focuses and informs the specialist’s consultation. Appropriate, clear, and complete referrals increase the likelihood that the specialist can provide timely, thorough, and efficient care. Our findings about shortcomings in the referral process are consistent with those in the literature.3,8,16-21 Our study extends this knowledge base by examining how commonly used mechanisms to coordinate care affect important referral characteristics.
We found that VHA specialists who use referral templates were more likely to report that referrals were appropriate, clear, and complete more than half the time, and specialists who used e-consults were more likely to report that referrals were clear. Use of service agreements was not associated with any referral characteristic. Among specialists who used all 3 tools together, those who reported referral templates to be very helpful were also more likely to report that referrals were clear and complete more than half of the time.
Only about half of respondents indicated that referrals were appropriate more than half the time. Reducing inappropriate referrals is critical to ensuring timely access to care. However, there are often differences in what specialists and PCPs consider appropriate for referral; there may also be differences in what is considered appropriate for a given modality when other modalities are available (eg, face-to-face vs e-consult). Just 67% of specialists in our study reported that referrals were clear more than half the time. If referrals are not clear, specialists may address the wrong issue, or they may address the right issue but too narrowly or too broadly for the PCP’s and the patient’s purposes.
An even lower percentage of respondents—just 25%—reported that referrals were complete more than half the time. These results show that although data are technically available to all providers through the shared EHR, specialists still look for relevant information to be selected and included alongside the referral question. This can be helpful because specialist errors in identification of relevant data can lead to their repeating work, duplicating tests, or suggesting treatments that have already been found ineffective or harmful. Also, PCPs are likely to have a high-level understanding of the relevant data such that they can provide meaning within the referral over and above that gleaned by specialists from review of the day-by-day record. PCPs are thus in a strong position to translate a list of data into useable and meaningful information. On the other hand, PCPs may not know exactly what information would be useful for the specialist’s evaluation. Including many details just because they might be important is a waste of their effort and limited time.
Referral templates may be useful for improving the appropriateness, clarity, and completeness of referrals. Templates can include a field that specifies the need for a clear question and can be tailored so that they guide the PCP as to what data should be included and whether referral is indicated for a specific given condition. Templates in the VHA are embedded in the EHR as the tool by which to request a referral. They are simple to create and require a minimum of effort to incorporate into the workflow.
Referral templates are usually “homegrown” and vary widely in their content and specificity of instructions they provide. Our data suggest that templates must be carefully crafted and implemented in order to improve referrals. Only 26% of specialists who used all 3 tools reported that templates were very helpful, but those specialists were more than 3 times as likely to report that referrals were clear and complete more than half the time.
It is important to note that in other studies, PCPs have reported that templates can be poorly laid out, be overly rigid in their structure, require irrelevant details, or require that labs and tests be ordered for which interpretation is within the specialist’s scope, but for which responsibility for follow-up lies with the PCP.3,16 Future work should examine specialty- and condition-specific templates already in use and identify which are perceived as most helpful by specialists and PCPs alike. Standardized templates modeled on those rated as very helpful by both parties could improve referrals at low cost and improve the efficiency and quality of specialty care more widely.
We observed an association between e-consult use and referral question clarity. It is possible that PCPs with the option to decide between face-to-face patient consultation and e-consult are prompted to articulate the purpose of the referral more clearly; this is an area for future study. It is notable that use of e-consults was not associated with referral appropriateness given that e-consults are intended as a tool to promote the more clinically appropriate routing of referrals. E-consult use is robust in the VHA, but that usage includes “curbside” questions that might otherwise not be formally asked (and so would not have led to an inappropriate referral).22 Therefore, the impact of e-consults on reducing inappropriate referrals may not be great. Combining coordination tools, for example, by applying referral templates to e-consult requests, may result in a stronger association between e-consult use and referral clarity and completeness.
A minority of specialists (17%) using service agreements found them very helpful in coordination. We found no association between the use or perceived helpfulness of service agreements and any desirable referral characteristic. These findings are consistent with those of a recent study in which VHA PCPs and specialists reported that existing service agreements were usually ineffective, failing to guide timing of referrals and what information needed to be exchanged.19 However, given the low percentage of “very helpful” ratings, these findings should be considered provisional and the impact of service agreements on referral characteristics should be examined again after that tool has matured in the VHA.
Like templates, service agreements tend to be homegrown, with wide variation in their form and content but similar potential for clinician buy-in. However, their scopes are much broader, use is not embedded in the workflow, and they are not routinely developed in partnership with primary care. These features may explain why, although referrals are a key topic of service agreements, we did not observe an association with referral characteristics. In a study conducted outside the VHA, service agreements were most successful when both parties to the agreement already had stable communication pathways and strong working relationships.23 Research is needed on collaborative efforts between PCPs and specialists to develop service agreements, integrate agreements into the clinical workflow, and test their impact on referral characteristics.
Our findings are broadly relevant because service agreements, referral templates, and e-consults are all tools that are used in non-VHA settings. As healthcare systems move toward interoperable EHRs, there is increased opportunity to build the supports for referrals into the workflow (as they often are in the VHA), such that specialty care coordination is improved. Studies like the current one can inform these efforts.
Our study has limitations. It is cross-sectional and observational; we cannot make causal inferences. We examined 3 tools that vary widely in their form and processes across services and facilities. The overall survey generated a 25% response rate. This response rate is better than that for a recent VHA physician online survey,24 but it is possible that respondents were those who were particularly displeased with the state of coordination with PCPs. Although we sampled widely, not all specialties were equally represented in the sample, introducing the possibility of bias. However, the item response distributions that we observed did not suggest that respondents were predominately negative or positive with respect to their consultation experiences. Future work could focus on or oversample certain specialties to better examine potential differences across them. Our findings may not be generalizable to surgical or other nonmedical specialties or to nonambulatory referral contexts. We examined associations between the helpfulness of tools and referral characteristics only among specialists who reported use of all 3 tools. It may be that perceived helpfulness has different associations with referral characteristics among specialists who use 1 or 2 of the examined tools. Of the sample, 87% reported using e-consults, which may have limited the power of the study to identify differences between that group and the minority of specialist providers who do not use e-consults and who may differ in their referral processes in other ways from the majority of providers who use this referral tool. Finally, our study measured only the specialist perspective. It is likely that the PCPs’ views would differ on the helpfulness of the same tools on the frequency of certain characteristics of the referral process as they experience it (eg, in the consultation note from the specialist). Future work should examine both the specialist and PCP perspectives on coordination of specialty care, because approaches to measuring and improving coordination need to work for both parties (and the patient).
Referral templates were associated with specialists perceiving that referrals were appropriate, clear, and complete. Referral templates may be useful for improving care coordination between primary care and specialty care in the VHA and other practice settings. Existing templates can provide models that could be adapted and broadly applied in collaboration with primary care to improve referrals. The use of e-consults was also associated with perceived referral clarity. Service agreements in their current state do not appear to have an association with desirable referral characteristics. Given that both e-consults and service agreements are intended specifically to improve coordination between primary care and specialty care, efforts are warranted to strengthen their impact. With the number of specialty care visits continuing to increase yearly, further efforts to improve the appropriateness, clarity, and completeness of referrals are needed.Author Affiliations: Center for Healthcare Organization and Implementation Research, Edith Nourse Rogers Memorial Veterans Affairs (VA) Medical Center (VGV, SQ, AS, JBW, BGF), Bedford, MA; Section of Endocrinology, Diabetes, and Metabolism, Boston University School of Medicine (VGV), Boston, MA; VHA Office of Reporting, Analytics, Performance, Improvement and Deployment (RAPID — 10EA), field-based at the Edith Nourse Rogers Memorial VA Medical Center (MM), Bedford, MA; Department of Health Law, Policy, and Management, Boston University School of Public Health (MM, BGF), Boston, MA; Department of Allied Health Sciences, College of Agriculture, Health, and Natural Resources, University of Connecticut (MEW), Storrs, CT; Department of Psychology, University of New Hampshire (JBW), Durham, NH.
Source of Funding: Dr Vimalananda was funded by a VA Health Services Research & Development Career Development Award (CDA 15-070). The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the US Department of Veterans Affairs or the US government.
Author Disclosures: The authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (VGV, MM, MEW, BGF); acquisition of data (VGV); analysis and interpretation of data (VGV, MM, MEW, SQ, AS, JBW, BGF); drafting of the manuscript (VGV, MM, BGF); critical revision of the manuscript for important intellectual content (VGV, MM, MEW, AS, JBW, BGF); statistical analysis (SQ, JBW); obtaining funding (VGV); and administrative, technical, or logistic support (SQ, AS).
Address Correspondence to: Varsha G. Vimalananda, MD, MPH, Center for Healthcare Organization and Implementation Research, Edith Nourse Rogers Memorial VA Medical Center, Bldg 70 (152), 200 Springs Road, Bedford, MA 01730. Email: firstname.lastname@example.org.REFERENCES
1. Barnett ML, Song Z, Landon BE. Trends in physician referrals in the United States, 1999-2009. Arch Intern Med. 2012;172(2):163-170. doi: 10.1001/archinternmed.2011.722.
2. Institute of Medicine Committee on Quality Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001.
3. Vimalananda VG, Dvorin K, Fincke BG, Tardiff N, Bokhour BG. Patient, primary care provider, and specialist perspectives on specialty care coordination in an integrated health care system. J Ambul Care Manage. 2018;41(1):15-24. doi: 10.1097/JAC.0000000000000219.
4. Stille CJ, Jerant A, Bell D, Meltzer D, Elmore JG. Coordinating care across diseases, settings, and clinicians: a key role for the generalist in practice. Ann Intern Med. 2005;142(8):700-708. doi: 10.7326/0003-4819-142-8-200504190-00038.
5. Fialová D, Onder G. Medication errors in elderly people: contributing factors and future perspectives. Br J Clin Pharmacol. 2009;67(6):641-645. doi: 10.1111/j.1365-2125.2009.03419.x.
6. Anderson R, Barbara A, Feldman S. What patients want: a content analysis of key qualities that influence patient satisfaction. J Med Pract Manage. 2007;22(5):255-261.
7. Schoen C, Osborn R, How SK, Doty MM, Peugh J. In chronic condition: experiences of patients with complex health care needs, in eight countries, 2008. Health Aff (Millwood). 2009;28(1):w1-w16. doi: 10.1377/hlthaff.28.1.w1.
8. Mehrotra A, Forrest CB, Lin CY. Dropping the baton: specialty referrals in the United States. Milbank Q. 2011;89(1):39-68. doi: 10.1111/j.1468-0009.2011.00619.x.
9. Kirsh S, Carey E, Aron DC, et al. Impact of a national specialty e-consultation implementation project on access. Am J Manag Care. 2014;21(12):e648-e654.
10. Greenberg JO, Barnett ML, Spinks MA, Dudley JC, Frolkis JP. The “medical neighborhood”: integrating primary and specialty care for ambulatory patients. JAMA Intern Med. 2014;174(3):454-457. doi: 10.1001/jamainternmed.2013.14093.
11. Kirsh SR, Ho PM, Aron DC. Providing specialty consultant expertise to primary care: an expanding spectrum of modalities. Mayo Clin Proc. 2014;89(10):1416-1426. doi: 10.1016/j.mayocp.2014.04.016.
12. Vimalananda VG, Fincke BG, Qian S, Waring ME, Seibert RG, Meterko M. Development and psychometric assessment of a novel survey to measure care coordination from the specialist’s perspective. Health Serv Res. 2019;54(3):689-699. doi: 10.1111/1475-6773.13148.
13. SurveyMonkey website. surveymonkey.com. Accessed July 1, 2019.
14. Williams TF, White KL, Fleming WL, Greenberg BG. The referral process in medical care and the university clinic’s role. J Med Educ. 1961;36(8):899-907.
15. Kunkle EC. Communication breakdown in referral of the patient. JAMA. 1964;187:663.
16. Zuchowski JL, Rose DE, Hamilton AB, et al. Challenges in referral communication between VHA primary care and specialty care. J Gen Intern Med. 2015;30(3):305-311. doi: 10.1007/s11606-014-3100-x.
17. Stille CJ, Primack WA. Interspecialty communication: old problem, new hope? Arch Intern Med. 2011;171(14):1300. doi: 10.1001/archinternmed.2011.326.
18. Taplin SH, Rodgers AB. Toward improving the quality of cancer care: addressing the interfaces of primary and oncology-related subspecialty care. J Natl Cancer Inst Monogr. 2010;2010(40):3-10. doi: 10.1093/jncimonographs/lgq006.
19. Kim B, Lucatorto MA, Hawthorne K, et al. Care coordination between specialty care and primary care: a focus group study of provider perspectives on strong practices and improvement opportunities. J Multidiscip Healthc. 2015;8:47-58. doi: 10.2147/JMDH.S73469.
20. Gandhi TK, Sittig DF, Franklin M, Sussman AJ, Fairchild DG, Bates DW. Communication breakdown in the outpatient referral process. J Gen Intern Med. 2000;15(9):626-631. doi: 10.1046/j.1525-1497.2000.91119.x.
21. Forrest CB, Glade GB, Baker AE, Bocian A, von Schrader S, Starfield B. Coordination of specialty referrals and physician satisfaction with referral care. Arch Pediatr Adolesc Med. 2000;154(5):499-506. doi: 10.1001/archpedi.154.5.499.
22. Gupte G, Vimalananda V, Simon SR, DeVito K, Clark J, Orlander JD. Disruptive innovation: implementation of electronic consultations in a Veterans Affairs health care system. JMIR Med Inform. 2016;4(1):e6. doi: 10.2196/medinform.4801.
23. Carrier E, Dowling MK, Pham HH. Care coordination agreements: barriers, facilitators, and lessons learned. Am J Manag Care. 2012;18(11):e398-e404.
24. Linsky A, Simon SR, Stolzmann K, Bokhour BG, Meterko M. Prescribers’ perceptions of medication discontinuation: survey instrument development and validation. Am J Manag Care. 2016;22(11):747-754.