A study of major US private payers showed an important role and considerable shortcomings of external health technology assessment in coverage decisions on personalized medicine.
This article was published as part of a special joint issue and also appears in the Journal of Oncology Practice.
Health technology assessment (HTA) plays an increasing role in translating emerging technologies into clinical practice and policy. Private payers are important users of HTA whose decisions impact adoption and use of new technologies. We examine the current use of HTA by private payers in coverage decisions for personalized medicine, a field that is increasingly impacting oncology practice.
Literature review and semistructured interviews.
We reviewed 7 HTA organizations used by private payers in decision making and explored how HTA is used by major US private payers (n = 11) for coverage of personalized medicine.
All payers used HTA in coverage decisions, but the number of HTA organizations used by an individual payer ranged from 1 (n = 1) to all 7 (n = 1), with the majority of payers (n = 8) using 3 or more. Payers relied more extensively on HTAs for reviews of personalized medicine (64%) than for other technologies. Most payers (82%) equally valued expertise of reviewers and rigor of evaluation as HTA strengths, whereas genomic-specific methodology was less important. Key reported shortcomings were limited availability of reviews (73%) and limited inclusion of nonclinical factors (91%), such as cost-effectiveness or adoption of technology in clinical practice.
Payers use a range of HTAs in their coverage decisions related to personalized medicine, but the current state of HTA to comprehensively guide those decisions is limited. HTA organizations should address current gaps to improve their relevance to payers and clinicians. Current HTA shortcomings may also inform the national HTA agenda.
(Am J Manag Care. 2011;17(5 Spec No.):SP53-SP60)
Our study explored how private payers use health technology assessment (HTA) in coverage decisions related to personalized medicine, including oncology.
Health technology assessment (HTA) is the systematic evaluation of properties, effects, and/or impacts of healthcare technology to inform healthcare decision makers in health policy or practice.1 The role of HTA in healthcare decisions in the United States is expected to increase with proliferation of new medical technologies and the implementation of healthcare reform.2,3
Private payers, which insure approximately two-thirds of the US population,4 are important users of HTA. Understanding how they make coverage decisions regarding new technologies is critical, given that it identifies the information needed for decisions and helps clinicians understand payer policies and their impact on clinical practice.5 This article examines how private payers use HTA in coverage and reimbursement decisions related to personalized medicine. We focus on personalized medicine—the use of genetics or genomics to guide healthcare decisions—because the rapid pace of development and lack of evidence in this field are particularly challenging to both payers and clinicians.6,7 We also expand the findings of other studies8,9 by further examining the role, strengths, and shortcomings of external HTA in private payers’ decisions related to personalized medicine.
This topic is particularly relevant in oncology, in which significant growth of personalized medicine is occurring.10 There are more than 100 genetic tests in oncology, of which at least 38 new tests have been introduced since 2006.11 Coverage decisions are critical factors in patient access to these technologies and their use in oncology practice.12,13
Definitions and HTA Inclusion Criteria
According to the International Network of Agencies for Health Technology Assessment, HTA is the systematic evaluation of properties, effects, and/or impacts of healthcare technology. It may address the direct, intended consequences of technologies as well as their indirect, unintended consequences. Its primary purpose is to inform technology-related policy making in healthcare. HTA is conducted by interdisciplinary groups that use explicit analytic frameworks and draw from a variety of methods.1
Here we refer to the entities conducting HTA as HTA organizations, and we refer to the output of HTA as HTA reviews. We included as HTA organizations the US entities that conduct or propose to conduct systematic evaluation of personalized medicine that could be used in coverage decisions by US payers. We excluded professional medical societies, because not all of them conduct systematic evidence evaluations in development of guidelines.14
Study Data and Methods
The study was conducted under a protocol approved by the institutional review board of the University of California, San Francisco. We conducted a literature review and semistructured interviews with private payers to examine how they used HTA in coverage decisions for personalized medicine.
First, between June and July 2009, we conducted a literature review to identify which HTA organizations to include. We searched the PubMed database, Google, HTA organizations’ Web sites, and private payer Web sites. An initial list of HTA organizations was forwarded to several experts, who provided input.
Second, between August and October 2009, we conducted semistructured hour-long interviews with senior executives (n = 17) who were directly involved in coverage decisions at 11 US private health plans. These included 6 of the 7 largest national plans, based on membership, and 5 smaller regional plans with membership numbers ranging from 1.6 million to more than 5 million. The 11 plans together covered more than 125 million members.15 We provided interview questions to the payers before the interviews. Verbal consent was obtained in the beginning of each interview.
We asked the interviewees:
• what external HTAs their organizations used in decisions related to personalized medicine;
• how external HTAs were used in the decision process; and
• what they perceived as strengths and shortcomings of the HTAs in informing their decisions related to personalized medicine.
Results are described based on the number of payers versus the number of interviewees. We found similar results among interviewees at the same plan.
HTA Organizations Identified and Described
On the basis of a literature review and input from experts, we identified 7 examples of HTA organizations that might inform private payer coverage decisions related to personalized medicine:
• Blue Cross Blue Shield Technology Evaluation Center (BCBS TEC)16
• Emergency Care Research Institute (ECRI)17
• Evaluation of Genomic Applications in Practice and Prevention (EGAPP)18
• Institute for Clinical and Economic Review (ICER)20
• United States Preventive Services Task Force (USPSTF)21
Six HTA organizations (BCBS TEC, ECRI, EGAPP, Hayes, USPSTF, and UpToDate) had developed genomic technology reviews by the time of our study, and the seventh (ICER) was planning to conduct a genomic technology assessment.
The 7 HTA organizations included 2 private companies, 2 independent panels developed by the government, 1 academic center, and 2 nonprofit organizations (). Four organizations made HTA reviews publically available; others charged a fee. The HTA organizations ranged in years of existence (from the 40-year-old ECRI to the 3-year-old ICER) and in the number of genetic reviews they produced (fewer than 15 by BCBS TEC, EGAPP, and USPSTF; more than 15 by ECRI; and more than 100 by Hayes and UpToDate).
HTA organizations varied in focus. Only 1 of them focused solely on genomics (EGAPP), and another (USPSTF) included only genomic technologies related to preventive services. Other organizations focused on assessing procedures by using novel technologies, imaging tests, and drugs and biologics. At least 3 HTA organizations also assessed laboratory tests and behavioral services (ECRI, Hayes, and UpToDate).
All 7 HTA organizations conducted rigorous evidence assessment and contained a description of the systematic evidence review. However, the HTAs answered differently formulated overarching research questions. USPSTF and EGAPP answered whether a technology should be used in clinical practice; ECRI and UpToDate provided a comprehensive topic review; BCBS TEC and Hayes evaluated evidence on the basis of their respective predefined criteria; ICER was concerned with comparative value of a technology. The majority (n = 5) provided evidence ranking, but only 3 (EGAPP, UpToDate, and USPSTF) provided recommendations for clinical use.
Payers’ Perceptions of the Strengths and Shortcomings of HTA Reviews
All interviewed payers reported conducting internal technology assessment and using external HTA in their coverage decision making for personalized medicine. Payers valued the following strengths of the HTA reviews as related to decisions regarding personalized medicine (): expertise and credibility of reviewers (100%); rigor of scientific evidence evaluation (82%); whether HTA methodology was specific to genomics (73%); independence from external influences (73%). Payers valued evaluation rigor as highly as the HTA reviewer expertise. The majority (64%) considered genomicspecific methodology less important than other HTA strengths.
The reported shortcomings of external HTAs were related to review availability (73%) and to the inclusion of nonclinical factors (91%; Table 2). Availability shortcomings included the small number of genetic reviews (64%), a lack of timeliness relative to payer coverage decisions (55%), and the increasing costs of fee-for-service reviews (45%). Fifty-five percent of payers claimed a heavier reliance on Hayes and/or ECRI, because they issued a higher number of reviews, albeit for a fee. The cost concerns were reported by both payers who used the fee-for-service HTAs and stated that the fees were becoming prohibitive, and by payers who considered using them.
Ten of the 11 payers noted that, although all HTA reviews included evaluation of clinical evidence, few of them incorporated other factors that might be importantin coverage decisions. Payers listed a spectrum of these factors: cost-effectiveness (82%), current level of adoption in clinical care (45%), incorporation of expert opinion (36%), barriers to adoption in care delivery such as a lack of infrastructure or logistical challenges (27%), and local regulations (eg, state coverage mandates; 27%). Interviewees noted that these factors played a role in their coverage decisions, especially regarding technologies with limited evidence and including many personalized medicine tests. All payers stated that cost-effectiveness was currently not a factor in their coverage decisions; however, at least 7 of them believed that it would be a factor in the future as healthcare reform unfolds.
How HTA Organizations Are Used by Private Payers in Decisions Related to Personalized Medicine
All interviewed payers reported using at least 1 external HTA organization in their coverage decision making related to personalized medicine (). The number of HTA organizations used by individual payers ranged from 1 (n = 1) to all 7 (n = 1); the majority of payers (n = 8) used 3 or more different HTA organizations. Large payers reported using more HTA organizations than smaller payers used. HTA reviews from BCBS TEC and USPSTF were reported as being used by most payers (91% and 82%, respectively), whereas ECRI and UpToDate were used by the least number of payers (36% and 45%, respectively). Fifty-five percent of payers stated that using multiple HTAs and comparing them helped them construct a complete evidence profile for a technology, because they had found no one source that was able to provide complete evaluation for genomics. They experienced a higher need for using reviews from multiple HTA organizations for genomics than for other technologies. The majority of payers (91%) found HTA reviews beneficial to their coverage decision making related to personalized medicine and used them for 1 or more of the following purposes:
• to help internal reviewers with question formulation and methodology (91%);
• to validate internal evidence analyses (36%); and/or
• to demonstrate credibility of decisions to providers and patients (36%).
At least 5 payers reported that they would like to use HTA reviews for question formulation more often, but because HTAs were not available in a timely manner, payers’ internal evaluations were often completed before an external HTA was issued.
All payers found systematic evidence analyses by external HTAs useful, but their opinions differed on the usefulness of other HTA review components. Many payers found evidence ranking (45%) and HTA recommendations (55%) helpful. However, others found ranking confusing, preferred to use their own ranking methods, or deemed external recommendations not relevant to their decisions.
Private Payers Rely on External HTA in Coverage Decisions for Personalized Medicine, but HTA Shortcomings Limit the Use
Our study explored how private payers used HTA in coverage decisions related to personalized medicine. We found that they used HTA extensively and relied on multiple HTAs for evaluation of personalized medicine more than for other technologies. HTA shortcomings in support of private payer decisions were lack of availability of reviews on personalized medicine and high costs of subscription-based HTAs as well as insufficient inclusion of nonclinical factors, such as cost-effectiveness and adoption of technology in clinical practice. This and other studies highlighted the necessity of both developing solutions that improve the usefulness of HTA to decision makers and providing findings that suggest specific areas to be addressed by solutions.
Our study confirmed the findings by Deverka8 and Faulkner9 that private payers use HTA in coverage decisions on personalized medicine. We also found that, in our cohort of private payers, HTA may play a more essential role in decisions related to personalized medicine than on other technologies. We also discovered that both large payers (known to have robust internal HTA processes8,23) and smaller payers relied on HTA and used multiple HTA reviews for evaluation of personalized medicine. Future solutions to HTA issues should address the needs of both large and smaller payers.
Lack of availability and relevance of HTA to payers have been discussed in other literature as they relate to personalized medicine9 and in the broader context.3,24 Our findings highlight a dichotomy between the lack of availability and the redundancy of genetic reviews. illustrates these issues for gene expression profile test Oncotype DX (Genomic Health, Redwood City, CA). The relevant EGAPP review was issued after 5 major payers decided to cover Oncotype DX, which rendered this review irrelevant to those payers who preferred using EGAPP. Conversely, BCBS TEC, Hayes, and ECRI all assessed Oncotype DX within the same time period, which raises the question of the benefit of this redundancy to HTA users. In addition to lack of availability, we found that the costs of highvolume, subscription-based HTAs were limitations and a significant concern for payers. Payers expected they would not beable to afford these HTAs, given the inevitability of additional proliferations of genomics. Future solutions should consider the balance between using multiple reviews for comprehen siveness and avoiding redundant reviews to improve capacity while addressing the affordability of HTA reviews.
Other literature discussed the role of nonclinical factors in coverage decisions by private payers25,29,30 and the inclusion of these factors in HTA.24,31 For example, Teutsch et al31 discussed how EGAPP includes contextual factors such as cost-effectiveness, current use, and feasibility of use. Neumann et al32 considered how cost-effectiveness might be incorporated in healthcare decisions and in HTA. Conti et al33 discussed the inclusion of cost-effectiveness in the evaluation of personalized medicine. Our findings suggest several additional nonclinical factors that are essential to private payer decisions and that payers want to incorporate in HTA. Additional studies might explore solutions for how to integrate evaluation of both clinical evidence and nonclinical factors in HTA.
Implications and Opportunities in Oncology
Current shortcomings in HTA of personalized medicine may be particularly relevant in oncology, given the growing number of genomics that guide the use of potentially lifesaving therapies. In addition to HTA organizations, oncology medical societies also conduct genomics evaluations. Private payers take into account not only HTA but also guidelines by medical societies, notably those by the American Society of Clinical Oncology (ASCO) and the National Comprehensive Cancer Network.8,9,29,34
Our findings may be relevant to those societies that conduct systematic evaluations of cancer genomics. For example, ASCO experiences challenges similar to those of HTA, such as lack of timeliness of reviews relative to user needs.14,35 It may be beneficial to cross-pollinate lessons learned and potential solutions among HTA and guideline societies. ASCO, for instance, is implementing a “more aggressive approach to guideline updating” by conducting annual assessments of new evidence. It has also established a process of endorsing other societies’ guidelines to improve access to evidence-based recommendations for its members.14 Such solutions may be beneficial to consider in the HTA context as well.
Considerations for Healthcare Policy Development and HTA Organizations
Recognizing the increasing importance and current shortcomings of HTA, experts have called for more significant investment in HTA and for development of solutions, such as the establishment of a centralized HTA body.2,4,36 Our own and others’ research on the use of HTA by private payers may inform development of such solutions. For example, using multiple HTAs appears to be beneficial for private payer decision making for novel technologies, such as personalized medicine, in which both the evidence and the methods to evaluate it are still evolving. Therefore it may be beneficial to include multiple HTA organizations, especially those focusing on emerging technologies, in the national technology assessment agenda. However, the inclusion of multiple HTA reviews may be discussed in the context of another question: whether standardization or heterogeneity across HTA approaches would be more beneficial. If it is feasible to standardize the HTAs to provide a comprehensive assessment that meets decision-making needs, the use of multiple reviews may be unnecessary. Otherwise, a variety of HTA reviews may need to be a part of a solution with potentially higher costs to the users. Solution development may be informed by future research that provides a detailed account of review redundancy, agreement or disagreement across HTAs on specific topics, and whether the reviews are current.
A dialogue between the HTA organizations and payers is expected to improve evidence development, technology evaluation, and decision making.8,24 Our study highlighted a need for dialogue and potential coordination among HTA organizations, which may improve their overall capacity for reviews of emerging technologies that are challenging for payers and providers. Although such efforts may encounter barriers,3,37 the discussion could provide insights at both the healthcare policy and the HTA organization levels.
In conclusion, private payers use a range of HTAs to inform their coverage decisions regarding personalized medicine, but the current state of HTA to comprehensively guide those decisions is limited. HTA organizations should address current gaps to improve their relevance to payers and clinicians. Current HTA shortcomings may also inform the national HTA agenda.
We thank our interviewees for their input and insight. This study was supported by Grants No. R01CA101849 and P01CA130818 from the National Cancer Institute (Bethesda, MD; Kathryn A. Phillips) and an unrestricted grant from the Blue Shield of California Foundation (San Francisco, CA). The funding organizations and sponsors had no role in the design or conduct of the study; collection, management, analysis, or interpretation of the data; or approval of the manuscript. The views presented are solely the opinions of the authors.
Authors’ Disclosures of Potential Conflicts of Interest: The authors indicated no potential conflicts of interest.
Conception and design: Julia R. Trosman, Stephanie L. Van Bebber, Kathryn A. Phillips.
Financial support: Kathryn A. Phillips.
Administrative support: Stephanie L. Van Bebber.
Collection and assembly of data: Julia R. Trosman, Kathryn A. Phillips.
Data analysis and interpretation: Julia R. Trosman, Stephanie L. Van Bebber, Kathryn A. Phillips.
Manuscript writing: Julia R. Trosman, Stephanie L. Van Bebber, Kathryn A. Phillips.
Final approval of manuscript: Julia R. Trosman, Stephanie L. Van Bebber, Kathryn A. Phillips.
Address Correspondence to: Kathryn A. Phillips, PhD, 3333 California Street #420, Box 0613, San Francisco, CA 94143; E-mail: PhillipsK@pharmacy.ucsf.edu.
1. International Network of Agencies of Health Technology Assessment: INAHTA glossary. http://www.inahta.org/HTAGlossary/#_Health_Technology_Assessment.
2. Emanuel EJ, Fuchs VR, Garber AM: Essential elements of a technology and outcomes assessment initiative. JAMA. 298:1323-1325, 2007.
3. Sullivan SD, Watkins J, Sweet B, et al: Health technology assessment in health-care decisions in the United States. Value Health. 12:S39-S44, 2009 (suppl 2).
4. Fuchs VR: The proposed government health insurance company-no substitute for real reform. N Engl J Med. 360:2273-2275, 2009.
5. Department of Health and Human Services: Coverage and reimbursement of genetic tests and services: report of the Secretary’s advisory committee on genetics, health, and society. http://oba.od.nih.gov/oba/sacghs/reports/CR_report.pdf.
6. President’s Council of Advisors on Science and Technology: Priorities for personalized medicine. http://www.whitehouse.gov/files/ documents/ostp/PCAST/pcast_report_v2.pdf.
7. Aspinall MG, Hamermesh RG: Realizing the promise of personalized medicine. Harv Bus Rev. 85:108-117, 165, 2007.
8. Deverka PA: Pharmacogenomics, evidence, and the role of payers. Public Health Genomics. 12:149-157, 2009.
9. Faulkner E: Clinical utility or impossibility? addressing the molecular diagnostics health technology assessment and reimbursement conundrum. J Managed Care Med. 12:42-55, 2010.
10. Bhasker CR, Hardiman G: Advances in pharmacogenomics technologies. Pharmacogenomics. 11:481-485, 2010.
11. Agency for Healthcare Research and Quality: Update on horizon scans of genetic tests currently available for clinical use in cancers. Agency for Healthcare Research and Quality, Rockville, MD, November 3, 2010.
12. Phillips KA: Closing the evidence gap in the use of emerging testing technologies in clinical practice. JAMA. 300:2542-2544, 2008.
13. Khoury MJ, Berg A, Coates R, et al: The evidence dilemma in genomic medicine. Health Aff (Millwood). 27:1600-1611, 2008.
14. Somerfield MR, Einhaus K, Hagerty KL, et al: American Society of Clinical Oncology clinical practice guidelines: Opportunities and challenges. J Clin Oncol. 26:4022-4026, 2008.
15. Health Plan Enrollment: Market Share Data—Top 25 U.S. Health Plans, Ranked by Total Medical Enrollment. Atlantic Information Services, Washington, DC, 2009.
16. BlueCross BlueShield Association: Technology evaluation center. http://www.bcbs.com/blueresources/tec.
17. ECRI Institute. https://www.ecri.org.
18. Evaluation of Genomic Applications in Practice and Prevention. http://www.egappreviews.org.
19. Hayes. http://www.hayesinc.com.
20. Institute for Clinical and Economic Review. http://www.icer-review.org.
21. Department of Health and Human Services: United States Preventive Services Task Force. http://www.ahrq.gov/clinic/uspstfix.htm.
22. UpToDate. http://www.uptodate.com.
23. Neumann PJ: Lessons for health technology assessment: it is not only about the evidence. Value Health. 12:S45-S48, 2009 (suppl 2).
24. Jönsson B: Health technology assessment: regulators or payers— who will take the lead? Clin Ther. 30:960-963, 2008.
25. Trosman JR, Van Bebber SL, Phillips KA: Coverage policy development for personalized medicine: private payer perspectives on developing policy for the 21-gene assay. J Oncol Pract. 6:238-242, 2010.
26. Evaluation of Genomic Applications in Practice and Prevention (EGAPP) Working Group: Recommendations from the EGAPP Working Group: can tumor gene expression profiling improve outcomes in patients with breast cancer? Genet Med. 11:66-73, 2009.
27. CIGNA: CIGNA medical coverage policies. http://www.cigna.com/customer_care/healthcare_professional/coverage_positions/medical/ mm_0298_coveragepositioncriteria_assay_genetic_expr_breast_cancer_patients.pdf.
28. Empire Blue Cross Blue Shield: Medical coverage policies. http://www.empireblue.com/medicalpolicies/policies/mp_pw_a049879.htm.
29. Meckley LM, Neumann PJ: Personalized medicine: factors influencing reimbursement. Health Policy. 94:91-100, 2010.
30. Steiner CA, Powe NR, Anderson GF, et al: Technology coverage decisions by health care plans and considerations by medical directors. Med Care. 35:472-489, 1997.
31. Teutsch SM, Bradley LA, Palomaki GE, et al: The Evaluation of Genomic Applications in Practice and Prevention (EGAPP) Initiative: methods of the EGAPP Working Group. Genet Med. 11:3-14, 2009.
32. Neumann PJ, Palmer JA, Daniels N, et al: A strategic plan for integrating cost-effectiveness analysis into the US healthcare system. Am J Manag Care. 14:185-188, 2008.
33. Conti R, Veenstra DL, Armstrong K, et al: Personalized medicine and genomics: challenges and opportunities in assessing effectiveness, cost-effectiveness, and future research priorities. Med Decis Making. 30:328-340, 2010.
34. Bennett CL, Somerfield MR, Pfister DG, et al: Perspectives on the value of American Society of Clinical Oncology clinical guidelines as reported by oncologists and health maintenance organizations. J Clin Oncol. 21:937-941, 2003.
35. Lyman GH: ASCO clinical practice guidelines: past, present and future. J Oncol Pract. 4:236-237, 2008.
36. Fuchs VR: Four health care reforms for 2009. N Engl J Med. 361: 1720-1722, 2009.
37. Draborg E, Gyrd-Hansen D, et al: International comparison of the definition and the practical application of health technology assessment. Int J Technol Assess Health Care. 21:89-95, 2005.