Currently Viewing:
The American Journal of Managed Care July 2015
Low-Value Care for Acute Sinusitis Encounters: Who's Choosing Wisely?
Adam L. Sharp, MD, MS; Marc H. Klau, MD, MBA; David Keschner, MD, JD; Eric Macy, MD, MS; Tania Tang, PhD, MPH; Ernest Shen, PhD; Corrine Munoz-Plaza, MPH; Michael Kanter, MD; Matthew A. Silver, MD; and Michael K. Gould, MD, MS
Usefulness of Pharmacy Claims for Medication Reconciliation in Primary Care
Dominique Comer, PharmD, MS; Joseph Couto, PharmD, MBA; Ruth Aguiar, BA; Pan Wu, PhD; and Daniel J. Elliott, MD, MSCE
No Longer a Unicorn: Improving Health Through Accountable Care Organizations
Risa Lavizzo-Mourey, MD, MBA, president and CEO, The Robert Wood Johnson Foundation
ACA-Mandated Elimination of Cost Sharing for Preventive Screening Has Had Limited Early Impact
Shivan J. Mehta, MD, MBA; Daniel Polsky, PhD; Jingsan Zhu, MBA; James D. Lewis, MD, MSCE; Jonathan T. Kolstad, PhD; George Loewenstein, PhD; and Kevin G. Volpp, MD, PhD
Determinants of Medicare Plan Choices: Are Beneficiaries More Influenced by Premiums or Benefits?
Paul D. Jacobs, PhD; and Melinda B. Buntin, PhD
Acupuncture and Chiropractic Care: Utilization and Electronic Medical Record Capture
Charles Elder, MD, MPH; Lynn DeBar, PhD, MPH; Cheryl Ritenbaugh, PhD, MPH; William Vollmer, PhD; Richard A. Deyo, MD, MPH; John Dickerson, PhD; and Lindsay Kindler, PhD, RN
Worksite Medical Home: Health Services Use and Claim Costs
Christopher Conover, PhD; Rebecca Namenek Brouwer, MS; Gale Adcock, MSN, RN, FNP-BC, FAANP; David Olaleye, PhD, MSCe; John Shipway, BS; and Truls Østbye, MD, PhD
Effectiveness and Cost of Influenza Vaccine Reminders for Adults With Asthma or Chronic Obstructive Pulmonary Disease
Jo Ann Shoup, MS; Carlos Madrid, MA; Caroline Koehler, RN, MSN; Cynthia Lamb, BS, RN; Jennifer Ellis, MSPH; Debra P. Ritzwoller, PhD; and Matthew F. Daley, MD
The Value of Colonoscopic Colorectal Cancer Screening of Adults Aged 50 to 64
Kathryn Fitch, RN, MEd; Bruce Pyenson, FSA, MAAA; Helen Blumen, MD, MBA; Thomas Weisman, MD, MBA; and Art Small, MD
It's Time for CMS to Utilize Functional Assessment as a Key Quality Component
Wayne Matthews, MS, PA-C, DFAAPA
Colorectal Cancer Screening in the 21st Century: Where Do We Go From Here?
Jennifer K. Maratt, MD; and Sameer D. Saini, MD, MS
Currently Reading
Pilot of Decision Support to Individualize Colorectal Cancer Screening Recommendations
Amy R. Schwartz, MD; Forrest L. Levin, MS; Joseph A. O'Neil, Jr, BS; and R. Scott Braithwaite, MD, MSc

Pilot of Decision Support to Individualize Colorectal Cancer Screening Recommendations

Amy R. Schwartz, MD; Forrest L. Levin, MS; Joseph A. O'Neil, Jr, BS; and R. Scott Braithwaite, MD, MSc
Colorectal cancer screening involves balancing immediate harms with longer-term benefits; electronic medical record decision support may facilitate personalized benefit/harm assessment.

Objectives: To test the feasibility of using an electronic medical record (EMR)-based decision support system (DSS) that incorporates morbidity and frailty information to individualize colorectal cancer (CRC) screening recommendations.  

Study Design: Our framework used the payoff time, defined as the minimum time until the benefits of screening exceed the harms.

Methods: Subjects were 24 patients eligible for CRC screening and 22 primary care providers (PCPs). Measures included PCP satisfaction with existing reminder systems and with decision support.

Results: The run-in phase, during which the intervention was inactive but its performance was verified, had 14 patients enrolled. The intervention phase, during which payoff time and life expectancy calculations were used to recommend for or against CRC screening, had 10 patients enrolled. Of the 10 patients enrolled in the intervention phase, the DSS recommended in favor of CRC screening for 6 patients. (The PCPs also recommended it for those 6 patients, although 3 refused the screening.) The DSS recommended against CRC screening for 4 patients, while the PCPs recommended against it for 3 of those 4 and ordered the screening for 1 patient. PCPs who had patients enrolled in the intervention phase indicated interest in having payoff time information for all patients eligible for CRC screening. This pilot study was small and was not powered to determine the effect of the intervention on screening behavior.

Conclusions: Colorectal cancer screening involves balancing immediate harms with longer-term benefits; EMR decision support may facilitate personalized benefit/harm assessment.  The payoff time framework is feasible for implementation in EMR decision support.
Am J Manag Care. 2015;21(7):e439-e446
Take-Away Points
We tested the feasibility of using an electronic medical record-based decision support that incorporates morbidity and frailty information to individualize colorectal cancer screening recommendations.
  • Colorectal cancer screening involves balancing immediate harms with longer-term benefits.
  • Our framework used the payoff time: the minimum time until the benefits of screening exceed the harms.
  • Electronic medical record decision support may facilitate personalized benefit/harm assessment.
Colorectal cancer (CRC) is the third most common cancer and the second leading cause of cancer deaths in the United States.1 CRC has a long preclinical phase from the development of adenomatous polyps to symptomatic cancer.2 Randomized controlled trials of fecal occult blood tests (FOBTs) and sigmoidoscopy and case-control studies of colonoscopy have shown that screening reduces CRC mortality,3-8 with the interval between screening and mortality benefit thought to be at least 5 to 7 years.9

While screening for CRC has considerable benefits, it also has harms. The possible harms of colonoscopy include inconvenience, cardiopulmonary complications from sedation, and complications from the colonoscopy itself.9,10 The decision to screen for CRC involves balancing the immediate harms with longer-term benefits; often, advanced age is used as a surrogate for an unfavorable harm-to-benefit profile. The US Preventive Services Task Force (USPSTF) recommends screening beginning at age 50 years and continuing until age 75 years using FOBT, sigmoidoscopy, or colonoscopy, noting that “The lead time between detection and treatment of colorectal neoplasia and a mortality benefit is substantial, and competing causes of mortality make it progressively less likely that this benefit will be realized with advancing age.”11

Comorbidity and frailty may be more important than age in determining life expectancy (LE) and the individualized benefit-to-harm profile. Despite the importance of incorporating comorbidity and frailty into screening decisions, guidelines do not specify how to do this.11-13 In practice, CRC screening is as common among those with severe comorbidities as among healthy persons.14-16

Most research regarding implementation of CRC screening has focused on increasing use, with minimal evaluation of strategies to reduce overuse and misuse.17 Overuse may occur because physicians have difficulty estimating LE, few validated accessible tools for doing so, or little time to do so in the context of competing demands. Because screening is offered largely in the context of clinic visits, ill patients with frequent visits may be inappropriately targeted.15 Quality measures and clinical reminder systems often promote CRC screening regardless of comorbidity. The clinical reminder in the Veterans Administration (VA) electronic medical record (EMR), or Computerized Patient Record System (CPRS), is activated for patients aged 50 to 75 years, regardless of comorbidities. At the time this study was conducted, the VA’s External Peer Review Program chart audits excluded only patients with esophagus, liver, or pancreatic cancer; enrollment in hospice; or estimated LE less than 6 months from the CRC screening measure.18

Individualized CRC screening decisions might be facilitated by incorporating explicit consideration of comorbidity in screening guidelines, the development of tools to estimate LE and incorporate this information in screening decisions, and inclusion of LE and comorbidity in clinical reminder systems. Our objective was to develop a decision support system (DSS) for using comorbidity and frailty information to individualize screening recommendations.

Our DSS incorporated the “payoff time” framework: the minimum time until the benefits attributable to a guideline exceed its harms.19 We estimated the payoff time for CRC screening based on individual characteristics. We then integrated this calculation into an EMR and pilot-tested this DSS.

Applying the Payoff Time to CRC Screening Decisions

We used previously published methods to estimate the mortality payoff for CRC screening.19,20 This requires estimating LE for a particular patient, then estimating the payoff time for CRC screening, adjusting that payoff time (based on comorbidities, frailty, and other factors that influence the balance of benefits and harms), and then comparing the adjusted payoff time to the patient’s LE.

Four-year mortality was estimated from a prognostic index developed in a population-based sample of community-dwelling US adults older than 50 years.21 The index incorporates both comorbid conditions and measures of frailty, and has good discrimination (C statistic = 0.84, derivation cohort; 0.82, validation cohort).

To adapt the prognostic index’s estimates of 4-year mortality to estimates of LE, we used the declining exponential approximation of life expectancy. Payoff time is calculated based on estimated age- and sex-specific CRC incidence and death rates from Surveillance, Epidemiology, and End Results data; the estimated risk reduction for CRC mortality based on data sources used by the USPSTF (assuming benefit from screening begins after 5 years); and estimates of adverse events following colonoscopy.19,20 Next, the payoff time is adjusted based on 18 patient characteristics that may affect the risk for CRC death or colonoscopy-induced death, including smoking, use of anticoagulants, American Society of Anesthesiologists class, and family history of CRC. The individual’s risk for benefit (based on the risk of CRC death) is divided by the individual’s risk for harm (based on the risk of death from colonoscopy-related complications); this yields an individualized risk-to-benefit adjustor. The adjusted payoff time is then compared with the patient’s estimated LE to yield a recommendation to pursue or avoid CRC screening.20

Incorporating the Payoff Time Within a Clinical DSS

We adapted the VA clinical reminder system so that CRC screening recommendations were tailored to individual patients’ likelihood of benefit.

Data to estimate LE and payoff time were obtained from CPRS and supplemented by patients’ self-report. Medical comorbidities, medication use, smoking and alcohol status, body mass index, and demographic information were extracted from CPRS (see eAppendix, available at Data regarding frailty and family history of CRC were obtained by having patients complete a 7-question survey prior to seeing their primary care provider (PCP). Responses were input into CPRS by the research assistant prior to calculation of the payoff time; survey completion and entry generally took about 2 or 3 minutes.

The DSS “turned off” the usual CRC screening reminder when LE was less than the payoff time (see Figures 1a and 1b), modifying the VA reminder algorithm by: a) basing the recommendation to screen (or not) on the payoff time, rather than a blanket “screen” recommendation for patients in the aged 50 to 75 years group, and b) adding an option for resolving the reminder by selecting “Due to comorbidities and/or frailty, colorectal cancer screening is no longer indicated.”

A note explaining the rationale for the screening recommendation was also created in CPRS (see Figure 1c). An explanatory document with full details of the calculations was available to PCPs, but not made a part of the EMR. The final decision regarding screening remained with the PCP and patient (Figure 2). PCPs could screen for CRC using colonoscopy, sigmoidoscopy, or FOBT.


Pilot-Testing the Clinical DSS

This study was approved by the Institutional Review Board at the VA Connecticut Healthcare System (VACHS). PCPs and patients consented to participate.

Primary Care Providers

We enrolled staff PCPs at VACHS in West Haven, Connecticut. PCP focus groups indicated a desire for information regarding LE to guide screening decisions; that the intervention be integrated into CPRS and not interrupt clinical work flow; and that patient-specific information regarding the details of the payoff-time calculation be available.

We surveyed PCPs regarding the existing CRC clinical reminder before the study, and at the conclusion of the study surveyed those PCPs whose patients were enrolled in the intervention phase.


We enrolled a convenience sample of patients from primary care clinics at VACHS in West Haven, CT; patients had clinic appointments that coincided with research assistant availability. Inclusion criteria were being aged 50 to 75 years, being “due” for CRC screening, and having at least 2 comorbid conditions from the mortality index: diabetes, cancer, chronic lung disease, congestive heart failure, or current tobacco use. Exclusion criteria were first visit to the primary care clinic, on panel of a medical resident, and impairment precluding informed consent. Patients undergoing surveillance for adenomatous polyps were not included.

Run-in Phase

The payoff time and clinical reminder intervention was inactive during the run-in phase of the study, during which the decision support parameters were validated, and active during the subsequent intervention phase. Validation involved confirming that all data were accurately extracted from CPRS and the patient survey, and that the decision support algorithm was able to accurately generate LE and payoff time data.

Primary Care Providers

Of 28 PCPs invited to complete our pre-intervention survey, 22 did so. The mean age was 45.5 years (SD = 8.4) with 17 females (77%) and an average of 13.9 years (SD = 7.7) in practice; 20 of 22 were physicians. All indicated that they consider comorbidities in deciding whether to recommend CRC screening. Nonparticipating PCPs mostly had minimal clinical duties or were planning to leave employment in the clinic soon.

PCPs indicated moderate satisfaction (54.5%) with clinical reminders and high ratings of effectiveness (72.7%); 77.3% indicated “The colorectal cancer clinical reminder helps me to screen patients for colorectal cancer.” However, 91% agreed or strongly agreed that “The colorectal cancer clinical reminder sometimes prompts me to screen patients for colorectal cancer who are too sick or frail to benefit from screening.” While 81.8% agreed or strongly agreed that “I feel comfortable determining which patients are appropriate for colorectal cancer screening,” only 31.8% indicated that they “feel confident estimating patient life expectancy to determine appropriateness for colorectal cancer screening.” Most (91%) indicated, “I would like the colorectal cancer clinical reminder to allow me to exclude patients with limited life expectancy” (Table 1).

PCPs showed engagement with the intervention.  The note containing the rationale for the screening recommendation was always signed by the PCP. PCPs often commented on the rationale for screening or not screening in their notes, or selected “due to comorbidities and/or frailty, colorectal cancer screening is no longer indicated” in the tailored CRC screening clinical reminder.

Copyright AJMC 2006-2019 Clinical Care Targeted Communications Group, LLC. All Rights Reserved.
Welcome the the new and improved, the premier managed market network. Tell us about yourself so that we can serve you better.
Sign Up