Objective: To examine the effect of referral management on diabetes care.
Study Design: Cross-sectional analysis.
Patients and Methods: Translating Research Into Action for Diabetes (TRIAD) is a multicenter study of managed care enrollees with diabetes. Prospective referral management was defined as "gatekeeping" and mandatory preauthorization from a utilization management office, and retrospective referral management as referral profiling and appropriateness reviews. Outcomes included dilated eye exam; self-reported visit to specialists; and perception of difficulty in getting referrals. Hierarchical models adjusted for clustering and patient age, gender, race, ethnicity, type and duration of diabetes treatment, education, income, health status, and comorbidity.
Results: Referral management was commonly used by health plans (55%) and provider groups (52%). In adjusted analyses, we found no association between any referral management strategies and any of the outcome measures.
Conclusions: Referral management does not appear to have an impact on referrals or perception of referrals related to diabetes care.
(Am J Manag Care. 2004;10(part 2):137-143)
During the 1980s, referral management was introduced into managed care to reduce unnecessary services and contain healthcare costs.1,2 These strategies may be prospective (eg, "gatekeeping," mandatory preauthorization from a utilization management office) or retrospective (eg, profiling of referral patterns, retrospective review of appropriateness). Referral management has been unpopular among patients and physicians.3-6 In some,7-9 but not all,10,11 settings, it may have led to decreased use of specialists.
The effect of referral management on diabetes care remains unclear. Persons with diabetes, like persons with other chronic diseases, use more healthcare services and have greater healthcare expenditures than patients without chronic diseases.12,13 As a result, patients with chronic diseases may be particularly sensitive to strategies designed to decrease use of unnecessary services.14,15 However, the effects of referral management strategies other than gatekeeping, including practice profiling, have been relatively understudied. To our knowledge, only 1 study has examined referral management in cases of diabetes, and that study could not assess diabetes processes of care.16
The Translating Research Into Action for Diabetes (TRIAD) study is a multicenter, prospective cohort study designed to examine how managed care structure influences the processes and outcomes of diabetes care.17 Using TRIAD, we examined the association between individual and multiple referral management strategies and specialist use and patient dissatisfaction with diabetes care. We hypothesized that during the previous year, greater use of referral management strategies would be associated with 1) a lower probability of study participants receiving a dilated eye exam, 2) fewer self-reported visits to specialists, 3) increased perception of difficulty in getting specialist referrals, and 4) greater dissatisfaction with the quality of diabetes care. We examined these 4 outcomes because they represent 4 possible mechanisms of action of referral management strategies. We also hypothesized that the associations would be stronger with prospective referral management strategies than with retrospective referral management strategies.
TRIAD has been previously described.17 The underlying hypothesis of TRIAD is that structural and organizational characteristics of health systems and provider groups affect processes of care, which, in turn, influence health and economic outcomes. Six Translational Research Centers collaborate with 10 health plans and 68 provider groups, which serve approximately 180 000 patients with diabetes; centers are available on the web: www.trialstudy.org. Managed care health plans are defined as entities that deliver, administer, or assume risk for health services in order to influence the quality, access, cost, and outcomes of healthcare for a defined population. Provider groups include groups of physicians with contractual arrangements with 1 or more health plans that provide managed care services. 18 The groups often are engaged directly in diabetes care management and may determine compensation arrangements and financial incentives for physicians and specialty referral policies.
Study Population and Data
For the purposes of this analysis, we examined health plans (n = 7) and provider groups (n = 51) that answered questions regarding referral management strategies and their participants with medical record information (a total of 6941 participants). Participants from 1 site (located in New Jersey and Pennsylvania) were excluded from this analysis due to lack of information on referral management strategies used by provider groups. Study participants were 18 years of age or older, community dwelling, English or Spanish speaking, continuously enrolled in the health plan for at least 18 months, and not pregnant; and they had at least 1 claim for health services during the previous 18 months. Participants were sampled from provider groups that had at least 50 participants with diabetes enrolled in the study's health plans. Recruitment was completed in September 2001. Institutional Review Board approval was obtained from each participating institution.
Participant data were obtained from a survey that was administered either by computer-assisted telephone interview or in writing, and from a review of medical records. Of contacted eligible individuals, 91% responded to the survey. If individuals who could not be contacted had the same rate of eligibility as those who were contacted, and if they were counted in the denominator, the survey response rate would be 69% (this is commonly called the Council of American Survey Research Organizations (CASRO) response rate19). Survey questions assessed sociodemographic characteristics, diabetes- related service use, and general health status and quality-of-life measures,20,21 among other variables. Health plan and provider group data were assessed by using standardized interviews of health plan and provider group medical directors and leadership personnel. Interviews determined the presence of referral management strategies and other structural variables.
Outcome measures were obtained from participant surveys. They were the receipt of a dilated eye exam, perception of difficulty in getting specialist referrals, any specialist visit, and participant dissatisfaction with the quality of diabetes care over the previous year. Each of the outcome measures was examined as a dichotomous measure. The last 2 outcome measures were adapted from questions from the Consumer Assessment of Health Plans Study 2.0 (CAHPSÂ® 2.0) survey.22 We chose to score perception of difficulty in getting referrals independently from CAHPSÂ® 2.0 because of response patterns in TRIAD. (See Appendix for a detailed explanation of scoring and the TRIAD patient survey questions.) In the participant survey, specialists were defined as doctors that patients may have seen for special health needs, like surgeons, cardiologists, allergists, dermatologists, and others who specialize in a single area of healthcare. Dentists were specifically excluded.
Health plan and provider group medical directors were asked whether referral management strategies were used by their organizations. Prospective referral management was defined as preapproval from primary care physicians for specialist referrals (gatekeeping) or mandatory preauthorization from a utilization management office for a referral to a specialist; these occurred before the referral had taken place. Retrospective referral management was defined as practice profiling of primary care physician referral patterns and retrospective review of referral appropriateness. We examined each of these strategies in unadjusted frequencies and then created 2 variables: the number of prospective strategies and the number of retrospective strategies, which both ranged from 0 (no strategies) to 2 strategies. Next, we examined the association between the number of prospective strategies and the outcome measures; then, the association between the number of retrospective strategies and the outcome measures.
In a separate analysis, we accounted for the total number of strategies by creating an "intensity of referral management" variable, the unweighted sum of all of the referral management strategies both as a continuous and a categorical variable. When we examined the strategies as a continuous variable, we examined the impact of the total number of strategies; when we examined the strategies as a categorical variable, we looked for the presence of a threshold number of strategies that would affect our outcome measures. A participant could be exposed to a maximum of 4 strategies used by the health plan and 4 strategies used by the provider group, and the models accounted for the simultaneous effect of referral management strategies at the health plan and the provider group levels.
We used hierarchical logistic regression models (SAS GLIMMIX Macro with penalized quasi-likelihood estimation method [SAS, Cary, NC]) with random intercepts for health plan and provider group to account for the clustered study design (health plan, provider group, and participant levels) and dependency of participant characteristics within health plans and provider groups. To ensure that simultaneous modeling of referral management strategies at the health plan and provider group level did not diminish the effect of these strategies, we also created models that examined referral management at the level of the health plan without controlling for referral management strategies at the provider group level, but found no difference.
In adjusted models, we also included patient age, sex, race and ethnicity, education, income, diabetes duration and treatment, and self-reported health status. Because of concerns that we were overadjusting by including health status in the model, we also constructed an adjusted model that did not include self-reported health status. It produced little change in the results. In a sensitivity analysis, we used the Charlson index to adjust for medical comorbidity,23 but found little change in the results. Using the method described by Smith and Bates,24 we conducted a confidence limits analysis to determine a limit on the likely magnitude of any actual effect in outcomes between groups with and without referral management strategies. Such an analysis can be used instead of a post-hoc power calculation.
Characteristics of participants in this substudy of the TRIAD population are listed in Table 1. The mean age of the participants was 61 years, and 54% were women. The population was diverse. The majority of participants were treated with oral antidiabetic medications, insulin monotherapy, or insulin in combination with oral antidiabetic therapy; fewer than 10% controlled their diabetes with diet and exercise alone. More than three fourths of participants (78%) had a dilated eye exam in the past year, and more than half (57%) saw a specialist in the past 12 months. Of the patients who needed to see a specialist, only 6% reported a perception of any problem getting a referral to a specialist; and in these cases, the problem was perceived as small rather than big. Dissatisfaction with diabetes care was low, with fewer than 2% of participants rating care as "poor."
The prevalence of specific referral management strategies is shown Table 2. At the level of the health plan, the largest number of participants were exposed to gatekeeping, followed by practice profiling and retrospective review of referrals. At the level of the provider group, the largest number of participants also were exposed to gatekeeping, followed by retrospective review of referrals, preauthorization from a utilization management office, and practice profiling. Approximately 55% of participants were affected by at least 1 health plan strategy, and 52% of participants were affected by at least 1 provider group strategy.
Table 3 shows the association between referral management strategies and outcome measures. It compares outcome rates between groups and plans with referral management strategies and between groups and plans without such strategies after adjustment for patient covariates. The probability of an outcome is expressed along with differences in probabilities ("risk differences"). For example, patients in health plans with 1 prospective referral management strategy had a 63% probability of seeing a specialist over a year; patients in health plans with no prospective referral management strategies had a 61% probability of seeing a specialist over a year. A risk difference of "2" between a health plan with 1 prospective strategy and a health plan with no prospective strategy means that the patient's probability of the outcome (eg, seeing a specialist over a 1-year period) is 2 percentage points higher in health plans with no prospective strategies.
Neither prospective nor retrospective referral management strategies were significantly associated with performance of a dilated eye exam over the past year, a visit to a specialist, or perceived difficulty in getting referrals (Table 3). Because of the high percentage of satisfied participants and the lack of variation in response, unadjusted models with patient dissatisfaction as a dependent variable did not converge, or could not yield estimates of effect. There were no differences between models unadjusted and adjusted for patient covariates. (See Table 4 for risk differences unadjusted for patient covariates.) When we looked at the number of strategies or the intensity of referral management, neither the linear nor the categorical variable was associated with any outcome measures (results not shown).
We realized our small sample size gave us limited ability to detect a difference in outcomes between organizations with and without referral management strategies. Therefore, we calculated the likelihood that the difference between plans with and without referral management strategies and between groups with and without referral management strategies was greater than 10 percentage points for each outcome measure.24 Our goal was to see whether we could have missed large differences between organizations with and without referral management strategies. Given the standard deviations and risk differences, the likelihood that groups with no prospective referral strategies would perform dilated eye examinations 10 percentage points more often than plans with such strategies was 11.5%, for rates of specialist referral was 0.2%, and for problems with difficulty of referral to specialists was 0.3%. In other words, the probability that outcomes differed by more than 10 percentage points between groups with and without referral management strategies was fairly low. Similar results were seen when plans with no retrospective referral strategies were compared 1) with plans that had retrospective referral strategies and 2) with plans that had both retrospective and prospective referral strategies. The exception was the association between rates of specialty referral and health plans strategies, where the possibility that the difference between health plans with and without referral strategies exceeded 10 percentage points was more than 12%.
We found no relationship between prospective and retrospective referral management strategies and performance of dilated eye exam, self-reported specialist use, or perception of difficulty in seeing a specialist in patients with diabetes across different models of managed care. These results extend more recent reports that show little, if any, effect of gatekeeping on specialist use.16,25 These results are reassuring in that others have speculated that referral management strategies may negatively affect access to needed services for persons with chronic illness.26,27
Our results may reflect a trend toward more relaxed practices of gatekeeping, preauthorization, profiling, and retrospective review of referrals. Institution of referral management strategies at the provider group level usually occurs in response to health plan strate- gies, but actual denial of claims at the provider group level is uncommon.28 The lack of association between referral management strategies and perception of difficulty in getting a referral also could reflect the diffusion of referral management strategies into managed care and their acceptance by patients. Finally, our results could reflect the presence of other diabetes management strategies such as disease management programs that did not necessarily hinge on the involvement of a specialist, and that would reduce both the perception of need and actual need for a specialty referral.
Our analysis has several limitations. We examined a select group of health plans and provider groups with an interest in the quality of diabetes care, and these results do not necessarily extend to other managed care plans. The lack of more significant differences in diabetes processes of care by presence or number of referral management strategies may have been due to inadequate power. We did not examine how diabetes care management strategies modified the relationship between referral management strategies and our outcomes of choice, as we had limited power and this question was beyond the scope of our paper. However, further investigation on how other health systems' interventions interact with referral management strategies could provide insight into the reasons why referral management appears to have little association with specific outcomes.
This analysis is cross-sectional, and we did not examine how long referral management strategies had been in place. It is possible that immediately after implementation, such strategies reduced service use or were perceived more negatively, but the effect waned over time. Although accepted by diabetes quality organizations,29 these measures have limitations in that they may not capture management strategies30 and may not necessarily be appropriate for all persons with diabetes; for example, performance of annual dilated eye exams in participants with excellent glycosolated hemoglobin measures may not represent optimal resource use.31 We did not analyze actual utilization and cost associated with referral management strategies, and it is possible that these strategies would have some effect on these end points. Finally, it is possible that that these mechanisms, gatekeeping in particular, may serve other functions such as to integrate care,32 but we did not assess this function.
Referral management strategies have little effect on rates of dilated eye exams, perception of difficulty in getting referral to specialists, or specialist referral in a population with chronic disease.
We acknowledge the TRIAD participants, other investigators, and staff that made this study possible.
From the Division of General Internal Medicine, Department of Medicine, University of Michigan, Ann Arbor, Mich (CK); the Division of Diabetes Translation, Centers for Disease Control and Prevention, Atlanta, Ga (DFW, TJT, KMVN); the Division of Endocrinology and Metabolism, Departments of Medicine and Epidemiology, University of Michigan (WHH); the Division of General Medicine, Department of Medicine, University of Medicine and Dentistry of New Jersey, Newark, NJ (MMS); the Division of Research, Kaiser Permanente, Oakland, Calif (JVS); the Diabetes Translational Research Center, Indiana University School of Medicine, Indianapolis, Ind (DGM); the Pacific Health Research Institute, Honolulu, HI (JDC); and the Division of General Internal Medicine and Health Services Research, Department of Medicine, David Geffen School of Medicine at UCLA, Los Angeles, Calif (CMM). A complete list of the members of the TRIAD Study Group is available at www.triadstudy.org.
TRIAD was funded through the Centers for Disease Control and Prevention (grant U48/CCU516410-02).
An abstract of this paper was presented at the American Diabetes Association 63rd Scientific Sessions, New Orleans, La, June 13-17, 2003.
Address correspondence to: Catherine Kim, MD, MPH, 300 North Ingalls Building, Room 7C13, Ann Arbor, MI 48109. E-mail: firstname.lastname@example.org.
Arch Intern Med.
1. Clancy C, Hillner B. Physicians as gatekeepers: the impact of financial incentives. 1989;149:917-920.
N Engl J Med.
2. Franks P, Clancy C, Nutting P. Gatekeeping revisited-protecting patients from overtreatment. 1992;327:424-429.
J Gen Intern Med.
3. Forrest C, Shi L, von Schrader S, Ng J. Managed care, primary care, and the patient-practitioner relationship. 2002;17:270-277.
4. Grumbach K, Selby J, Damberg C, et al. Resolving the gatekeeper conundrum: what patients value in primary care and referrals to specialists. 1999;282(3):261-266.
J Gen Intern Med.
5. Kerr E, Hays R, Mitchenson A, Lee M, Siu A. The influence of gatekeeping and utilization review on patient satisfaction. 1999;14:287-296.
6. Kerr E, Hays R, Mittman B, et al. Primary care physiciansâ€™ satisfaction with quality of care in California capitated medical groups. 1997;4:308-312.
J Gen Intern Med.
7. Schillinger D, Bibbins-Domingo K, Vranizan K, et al. Effects of primary care coordination on public hospital patients. 2000;15:329-336.
J Fam Pract.
8. Hurley R, Freund D, Gage B. Gatekeeper effects on patterns of physician use. 1991;32:167-174.
Am J Public Health.
9. Martin D, Diehr P, Price K, Richardson W. Effect of a gatekeeper plan on health services use and charges: a randomized trial. 1989;79(12):1628-1632.
Am J Manag Care.
10. Joyce G, Kapur K, Van Vorst K, Escarce J. Visits to primary care physicians and to specialists under gatekeeper and point-ofservice arrangements. 2000;6(11):1189-1196.
Med Care Res Rev.
11. Kapur K, Joyce G, Van Vorst K, Escarce J. Expenditures for physician services under alternative models of managed care. 2000;57:161-181.
12. Simon L, Albright A, Belman M, Tom E, Rideout J. Risk and protective factors associated with screening for complications of diabetes in a health maintenance organization setting. 1999;22:208-212.
13. Krop J, Powe N, Weller W, et al. Patterns of expenditures and use of services among older adults with diabetes. 1998;21:747-752.
14. Ferris T, Perrin J, Manganello J, et al. Switching to gatekeeping: changes in expenditures and utilization for children. 2001;108:283-290.
15. Forrest C, Weiner J, Fowles J, et al. Self-referral in point-ofservice health plans. 2001;285(17):2223-2231.
N Engl J Med.
16. Ferris T, Chang Y, Blumenthal D, Pearson S. Leaving gatekeeping behind-effects of opening access to specialists for adults in a health maintenance organization. 2001;345: 1312-1317.
17. The TRIAD Study Group. The Translating Research into Action for Diabetes (TRIAD) study: a multicenter study of diabetes in managed care. 2002;25:386-389.
Essentials of Managed Health Care.
18. Kongsvedt P. Gaithersburg, Md: Aspen Publishers, Inc; 1995.
Improving Data Quality in a Sample Survey.
19. Frankel L. The report of the CASRO Task Force on response rates. In: Wiseman F, ed. Cambridge, Mass: Marketing Science Institute; 1983.
20. Ware J Jr, Kosinski M, Keller SD. A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. 1996;34:220-233.
Qual Life Res.
21. Brazier J, Jones N, Kind P. Testing the validity of the Euroqol and comparing it with the SF-36 health survey questionnaire. 1993;2:169-180.
CAHPS 2.0 Survey and Reporting Kit.
22. Agency for Health Care Policy and Research. Rockville, Md: AHCPR; 1998.
J Chron Dis.
23. Charlson M, Pompei P, Ales K, MacKenzie C. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. 1987;40(5):373-383.
24. Smith A, Bates M. Confidence limit analyses should replace power calculations in the interpretation of epidemiologic studies. 1992;3:449-452.
25. Forrest C, Nutting P, Werner J, et al. Managed health plan effects on the specialty referral process: results from the Ambulatory Sentinel Practice Network referral study. 2003; 41:242-253.
26. Wickizer T, Lessler D. Do treatment restrictions imposed by utilization management increase the likelihood of readmission for psychiatric patients? 1998;36:844-850.
Health Serv Res.
27. Miller R. Healthcare organizational change: implications for access to care and its measurement. 1998;33 (3 pt 2):653-680.
Ann Intern Med.
28. Kerr E, Mittman B, Hays R, et al. Managed care and capitation in California: how do physicians at financial risk control their own utilization? 1995;123(7):500-504.
29. Fleming B, Greenfield S, Engelgau M, et al. The Diabetes Quality Improvement Project: moving science into health policy to gain an edge on the diabetes epidemic. 2001;24: 1815-1820.
Am J Manag Care.
30. Kerr E, Krein S, Vijan S, Hofer T, Hayward R. Avoiding pitfalls in chronic disease quality measurement: a case for the next generation of technical quality measures. 2001;7(11): 1033-1043.
31. Vijan S, Hofer T, Hayward R. Cost-utility analysis of screening intervals for diabetic retinopathy in patients with type 2 diabetes mellitus. 2000;283(7):889-896.
N Engl J Med.
32. Lawrence D. Gatekeeping reconsidered. 2001; 345:1342-1343.