Currently Viewing:
The American Journal of Managed Care August 2017
Health Insurance and Racial Disparities in Pulmonary Hypertension Outcomes
Kishan S. Parikh, MD; Kathryn A. Stackhouse, MD; Stephen A. Hart, MD; Thomas M. Bashore, MD; and Richard A. Krasuski, MD
Evaluation of a Hospital-in-Home Program Implemented Among Veterans
Shubing Cai, PhD; Patricia A. Laurel, MD; Rajesh Makineni, MS; Mary Lou Marks, RN; Bruce Kinosian, MD; Ciaran S. Phibbs, PhD; and Orna Intrator, PhD
The Effect of Implementing a Care Coordination Program on Team Dynamics and the Patient Experience
Paul Di Capua, MD, MBA, MSHPM; Robin Clarke, MD, MSHS; Chi-Hong Tseng, PhD; Holly Wilhalme, MS; Renee Sednew, MPH; Kathryn M. McDonald, MM, PhD; Samuel A. Skootsky, MD; and Neil Wenger, MD, MPH
What Do Pharmaceuticals Really Cost in the Long Run?
Darius Lakdawalla, PhD; Joanna P. MacEwan, PhD; Robert Dubois, MD, PhD; Kimberly Westrich, MA; Mikel Berdud, PhD; and Adrian Towse, MA, MPhil
The Hospital Tech Laboratory: Quality Innovation in a New Era of Value-Conscious Care
Courtland K. Keteyian, MD, MBA, MPH; Brahmajee K. Nallamothu, MD, MPH; and Andrew M. Ryan, PhD
Association Between Length of Stay and Readmission for COPD
Seppo T. Rinne, MD, PhD; Meredith C. Graves, PhD; Lori A. Bastian, MD; Peter K. Lindenauer, MD; Edwin S. Wong, PhD; Paul L. Hebert, PhD; and Chuan-Fen Liu, PhD
Currently Reading
Risk Stratification for Return Emergency Department Visits Among High-Risk Patients
Katherine E.M. Miller, MSPH; Wei Duan-Porter, MD, PhD; Karen M. Stechuchak, MS; Elizabeth Mahanna, MPH; Cynthia J. Coffman, PhD; Morris Weinberger, PhD; Courtney Harold Van Houtven, PhD; Eugene Z. Oddone, MD, MHSc; Katina Morris, MS; Kenneth E. Schmader, MD; Cristina C. Hendrix, DNS, GNP-BC; Chad Kessler, MD; and Susan Nicole Hastings, MD, MHSc
Impact of Formulary Restrictions on Medication Use and Costs
Xian Shen, PhD; Bruce C. Stuart, PhD; Christopher A. Powers, PharmD; Sarah E. Tom, PhD, MPH; Laurence S. Magder, PhD; and Eleanor M. Perfetto, PhD, MS
Geographic Variation in Medicare and the Military Healthcare System
Taiwo Adesoye, MD, MPH; Linda G. Kimsey, PhD, MSc; Stuart R. Lipsitz, SCD; Louis L. Nguyen, MD, MBA, MPH; Philip Goodney, MD; Samuel Olaiya, PhD; and Joel S. Weissman, PhD

Risk Stratification for Return Emergency Department Visits Among High-Risk Patients

Katherine E.M. Miller, MSPH; Wei Duan-Porter, MD, PhD; Karen M. Stechuchak, MS; Elizabeth Mahanna, MPH; Cynthia J. Coffman, PhD; Morris Weinberger, PhD; Courtney Harold Van Houtven, PhD; Eugene Z. Oddone, MD, MHSc; Katina Morris, MS; Kenneth E. Schmader, MD; Cristina C. Hendrix, DNS, GNP-BC; Chad Kessler, MD; and Susan Nicole Hastings, MD, MHSc
The authors examined 2 high-risk classification methods to compare and contrast the patient populations, and to identify the preferred method for predicting subsequent emergency department visits.

To compare 2 methods of identifying patients at high-risk of repeat emergency department (ED) use: high Care Assessment Need (CAN) score (≥90), derived from a model using Veterans Health Administration (VHA) data, and "Super User" status, defined as more than 3 ED visits within 6 months of the index ED visit. 

Study Design: Retrospective cohort study. 

Methods: Using McNemar’s test, we compared rates of high-risk classification between CAN score and Super User status. We examined differences in patient characteristics and healthcare utilization across 4 levels of risk classification: high CAN and Super User status (n = 198), CAN <90 and non–Super User (n = 622), high CAN and non–Super User (n = 616), or Super User and CAN score <90 (n = 106). We used logistic regression to identify associations between risk classification and any ED visit within 90 days. 

Results: Of 1542 veterans, 52.8% (n = 814) had a CAN score ≥90 and 19.7% (n = 304) were Super Users (P <.0001), indicating discrepant rates of high-risk classification. However, we found no differences in patient characteristics. Rates of subsequent ED use were high: 63.1% of patients had 1 or more ED visits. No levels of risk classification were associated with subsequent ED use within 90 days (P = .25). 

Conclusions: Among the VHA users with multimorbidity and 3 or more prior ED visits or hospitalizations, subsequent ED use was high. Although CAN scores have demonstrated utility for predicting hospitalizations and deaths, prior utilization and multimorbidity without further risk classification identified a high-risk group for repeat ED use.

Am J Manag Care. 2017;23(8):e275-e279
This article has been corrected in Am J Manag Care. 2019;25(3):140.
Takeaway Points

We compared 2 methods of identifying patients at high risk of subsequent emergency department (ED) use: 1) Care Assessment Need (CAN) score and 2) Super User status. 
  • Patients with 2 or more chronic conditions and 3 or more prior ED visits or hospitalizations were identified as a cohort at high risk for subsequent ED visits. Subsequent risk stratification through the CAN score or Super User status did not improve prediction of repeat ED use within 90 days of the index ED visit. 
  • Although the 2 methods had discrepant rates of classification, there were no statistically significant differences by patient characteristics or subsequent ED use.
Emergency department (ED) utilization not resulting in hospital admission, referred to as outpatient ED visits, may be avoidable1 and more costly than an outpatient clinic2; thus, it is considered potentially low-value care. To reduce low-value care, risk prediction models have been developed to identify the patients who account for a disproportionately large amount of healthcare utilization; the goal is to target these patients for interventions that can reduce avoidable utilization.3 Researchers often develop and validate risk prediction models for disease-specific populations3; however, the models may not be generalizable to broader and more medically complex populations. 

Outpatient ED visits are common in the Veterans Health Administration (VHA), the largest integrated healthcare system in the United States, which serves more than 9 million veterans nationally.4 From 2007 to 2008, 80% of ED visits were outpatient; of these, 15% had a repeat ED visit within 30 days—a higher rate than Medicare beneficiaries.1 The VHA has been at the forefront of predictive analytics in healthcare and has implemented Care Assessment Need (CAN) scores for all VHA users. CAN scores use complex multivariate modeling to generate a validated risk prediction of hospitalization and/or death within 90 days or 1 year, using available electronic health records (EHRs) and administrative data.5 CAN scores are utilized to optimize care coordination and resource allocation for high-risk veterans.5 

However, it is unknown whether CAN scores identify patients at higher risk for repeat ED utilization—especially compared with simpler strategies, such as a previous history of high ED utilization.5-11 Thus, in this exploratory study, we examined whether the CAN score provided further information on risk for repeat ED visits for a high-risk cohort of VHA-affiliated patients. First, we compared whether CAN scores and Super User status (ie, having 4 or more ED visits within the last year)12 identified the same patients as high risk. Then, we assessed whether these risk classifications could predict repeat ED visits that occurred within 90 days of an index ED visit. 


Study Cohort

The study cohort met initial eligibility criteria for an ongoing randomized clinical trial at the Durham Veterans Affairs Medical Center (DVAMC), Discharge Information and Support for Patients Receiving Outpatient Care in the ED (DISPO ED), which took place from March 10 to September 30, 2014.13 DISPO ED examined the effectiveness of a nurse-led intervention to reduce repeat ED visits. In addition to having an index outpatient ED visit, inclusion criteria included: 1 or more visits to a DVAMC-affiliated primary care clinic within the previous 12 months (proxy for engagement with the VA system), 1 or more DVAMC ED visit or hospital admission in the 6 months prior to the index ED visit, and 2 or more chronic conditions.13 By the end of the study time period, 17% of all ED visits met these eligibility criteria. Exclusion criteria included current enrollment or previous refusal to participate in DISPO ED, residence in a nursing home, and death on date of the index ED visit. 

Data Sources

We used VHA administrative data files, including the Vital Status Mini File,14 enrollment tables from the VHA’s Assistant Deputy Under Secretary for Health for Policy and Planning,15 Medical SAS datasets,16 and additional domains from the Corporate Data Warehouse. 


Primary outcome: repeat VHA ED visit within 90 days. We determined ED use within 90 days of the index visit through administrative stop codes for ED care at US Veterans Affairs medical centers. We determined outpatient ED encounters by using administrative codes for VHA ED visits and VHA inpatient care administrative datasets. 

Key predictors (CAN score). We extracted the CAN score predicting the percentile of risk of hospital admission in the 90 days closest to the index ED visit date and dichotomized CAN scores using the median split (<90 or ≥90). For example, a CAN score of 90 is associated with an average observed hospitalization rate (≤90 days) of 14% compared with an average of 2.7% in the general VHA population.17

ED Super User. Veterans with more than 4 ED visits to the DVAMC within 6 months (including the index ED visit) were categorized as Super Users, based on prior studies and clinical experience.13

Covariates (sociodemographics). Demographics included race, age, marital status, and gender. To indicate economic status, we determined whether the veteran was exempted from co-payments due to limited financial means and had unstable housing within the 12 months prior to the index ED visit.1

Chronic conditions. We used diagnosis codes associated with encounters in the year prior to the index ED visit to identify anemia, congestive heart failure, chronic lung disease, chronic renal failure, diabetes, hypertension, ischemic heart disease (IHD),  peripheral vascular disease, and mental health conditions, including anxiety disorder, depressive disorder, posttraumatic stress disorder (PTSD), and substance abuse disorder, in accordance with the VHA definition of chronic conditions per the VHA Support Service Center Chronic Disease Registry Development Rules.13,18

Medical complexity (Quan Charlson Comorbidity Index). The Quan Charlson Comorbidity Index predicts mortality within 12 months using 17 comorbidities based on the original Charlson Comorbidity Index,19 but using updated weights identified by Schneeweiss et al.20

Outpatient utilization in year prior to index ED visit. We counted the number of VHA primary care, outpatient specialty services, and mental health clinic encounters.

Statistical Analysis

We first compared high-risk classification by CAN score of ≥90 and Super User status, using McNemar’s test. Second, we examined differences in demographics, chronic conditions, and utilization in the year prior to the index ED visit across the 4 classification groups: high-risk by both (CAN score ≥90 and identified Super User), high-risk by CAN score only (CAN score ≥90 and non–Super User status), high-risk by Super User status only (CAN Score <90 and identified Super User), or not considered high risk by both (CAN score <90 and non–Super User). For categorical variables, we used χ2 analysis. Analysis of variance was used for continuous variables and Poisson regressions for count variables. Finally, we compared repeat ED visits within 90 days (yes/no) for these 4 groups, examining CAN score and Super User status in logistic models, adjusting for the aforementioned demographic, economic, comorbidity, and prior healthcare use covariates.

Copyright AJMC 2006-2020 Clinical Care Targeted Communications Group, LLC. All Rights Reserved.
Welcome the the new and improved, the premier managed market network. Tell us about yourself so that we can serve you better.
Sign Up