Steve Martin, BSN, MSEd

: To update the most recent meta-analysis comparing percutaneous coronary interventions (PCIs) with medical therapy (MT) in patients having stable coronary artery disease (CAD) by including 2 new large trials that double the total number of patients.

: Meta-analysis was used to update previous meta-analyses of PCIs in stable CAD. Eleven previously analyzed randomized controlled trials (RCTs) and 2 new RCTs were included.

: Summary estimates of relative risk (RR) are obtained by applying fixed-effects and random-effects models. Statistical tests for assessing between-study heterogeneity and biases are performed. Cumulative estimates and results from influence analysis are reported.

: No difference between PCIs and MT alone was found for risk of mortality. There was a 12% increase in the RR of cardiac death or myocardial infarction (MI) associated with PCIs, as well as a 22% increase in the RR of nonfatal MI associated with PCIs. Cumulative analysis favored MT over PCIs as early as 1997, but recent study results have increased confidence in this finding. Because of heterogeneity between studies, no certain conclusions are drawn for the use of PCIs in preventing follow-up PCI or coronary artery bypass graft surgery. 

: Recent RCTs comparing PCIs with conservative MT in stable CAD increase confidence in previous findings that the use of PCIs does not offer marginal benefit over that of the use of MT alone for mortality risk, cardiac death or MI, and nonfatal MI.

The weight of evidence has not shown percutaneous coronary interventions (PCIs) to have marginal benefit in the treatment of stable coronary artery disease over that of medical therapy alone; recent large trials increase our confidence in this finding. 

Original favorable coverage decisions by Medicare were not based on whether PCIs provided marginal benefit over that of medical therapy; no randomized controlled trials were available for evaluation at that time.

Early diffusion of PCIs was likely influenced by Medicareâ€™s decision to pay the same rate as open heart surgery and by early evaluation suggesting that PCIs could save money.

It has been 31 years since the 1977 development of percutaneous transluminal angioplasty by Gr&#252;ntzig

 for use in coronary arteries. The early diffusion of percutaneous coronary interventions (PCIs, previously percutaneous transluminal coronary angioplasty

) benefited from favorable Medicare pricing.

 Early Medicare payment for coronary angioplasty was based on coding to 

International Classification of Diseases, Ninth Revision

, Clinical Modification procedure code 36.0 (&#8220;removal of a coronary obstruction&#8221;), which was reimbursed through the inpatient hospital diagnosis related group system as open heart surgery (diagnosis related group 108), despite the lower costs of PCIs.

 cites 1982 costs for coronary artery bypass graft (CABG) surgery as $20,000 and costs for PCIs as $3000. Zweifel

 notes that, while new technology lowers the unit cost of production among industry in healthcare, it drives up the total cost. The use of PCIs in the United States grew from 1800 cumulative procedures from June 1979 through May 1981, to 32,300 procedures in 1983, to more than 200,000 procedures in 1988. From 2000 through 2005, more than 7 million coronary artery angioplasties, arthrectomies, or stent insertions have been performed in the United States.

 Using the mean national Medicare hospital payment rate for fiscal 2006 of $13,793, the procedures could represent hospital cost ranging from $54 billion to $97.4 billion. Estimates of national commercial insurance mean costs for PCIs, including physician fees, approximate $24,400 per case, giving a total cost estimate of $96 billion to $170 billion for the 6-year period from 2000 to 2005. (The $24,400 value is based on the BlueCross BlueShield of Tennessee treatment cost estimator. The treatment cost estimator is a collaborative project of Consortium Health Plans, Blue- Cross BlueShield Association, and Milliman USA. Based on the ClaimsQuest cost modeling system, the treatment cost estimates are episode treatment group&#8211;based. For the $96-billion to $170-billion estimate, there is considerable uncertainty surrounding the values. The source of the uncertainty is accounting for the number of procedures versus the number of patients; that is, a single patient could have both angioplasty and stent procedures performed within a single stay, for which there could be a single-case rate payment, a per diem rate&#8211;based payment, or a payment based on the fees for individual procedures and implanted stents.) Despite the high level of investment and experience with this technology, the marginal benefit of use in stable coronary artery disease (CAD) remains controversial, with study results often in conflict.

of randomized controlled trials (RCTs) of PCIs versus medical therapy (MT) have shown no marginal benefit for PCIs over that of MT alone in death rates, myocardial infarction (MI), or need for subsequent revascularization in patients with nonacute CAD. Since the publication of the most recent meta-analysis,

 2 large RCTs have been added to the literature,

more than doubling the total number of patients studied. The results of these new studies potentially have an important role in the development of policy regarding PCIs. The new studies have been portrayed in the lay press as &#8220;landmark,&#8221;

 implying that there is a historical change of course from the findings of previous studies. We update the meta-analysis of Katritsis and Ioannidis by including the 2 new studies 

and by addressing the consistency, heterogeneity, and bias of previous findings.

We employed eligibility criteria, studied outcomes data, and meta-analytic methods of Katritsis and Ioannidis,

 whose principal outcome measure was relative risk (RR). In addition to summary outcome measures and heterogeneity test results, we present cumulative estimates and influence analysis, and test for the existence of biases.

Relative risks across studies were combined using the Mantel- Haenszel fixed-effects model and the DerSimonian and Laird random-effects model.

In general, both methods give greater weight to studies with smaller variances. Weighting is shown graphically in forest plots, in which the size of the box is proportional to study weight (which is also shown in the plots) and in which the center of the box represents the size of the treatment effect estimated from that study (point estimate). The confidence interval (CI) for the treatment effect from each study is also shown. The pooled treatment effect is indicated by the middle of the diamond. An estimate less than 1.0 favors PCIs, while an estimate of 1.0 or greater favors MT alone. Influence analysis was performed by omitting 1 study at a time from the Mantel-Haenszel or DerSimonian and Laird model. A study is influential if, when omitted, the combined meta-analytic estimate differs significantly from that achieved when the study is included. Cumulative effects are shown in the cumulativeeffects plot, in which the first circle represents the results of the first study only, while subsequent circles represent the weighted results of all previous studies in addition to the current study. Between- study heterogeneity was tested using &#967;

-based Q statistic. Publication and other biases were investigated using funnel plots28 and formally using Egger&#8217;s regression asymmetry test.

We account for any biases detected by applying the &#8220;trim and fill&#8221; method developed by Duval and Tweedie.

Problems in the computation of RR and standard errors of RR arise when a study contains no events (the meta-analysis studies

 report no deaths in the intervention group, so that the estimated RR ratio is zero and its standard error cannot be estimated. To overcome this problem, we add 0.5 to each observed frequency (ie, to each cell of the 2 &#215; 2 contingency table for the trial). When the treated and the control groups of the study contain zero events, presenting effect size estimates as RR ratios is meaningless. We have one such case (by Hambrecht et al

) for death due to all causes, and we discard it from that portion of the meta-analysis.

The primary end points are the following clinical outcomes: death (due to all causes), cardiac death or MI, nonfatal MI, and follow-up procedures that include PCIs and CABG surgery. 

There were 509 deaths (250 in the PCI group and 259 in the MT group), 855 patients had cardiac death or MI (452 in the PCI group and 403 in the MT group), 520 patients had nonfatal MI (287 in the PCI group and 233 in the MT group), and 1628 patients underwent follow-up PCIs or CABG surgery (726 in the PCI group and 902 in the MT group). Pooled estimates for the 13 RCTs 

No difference between PCIs and MT alone was found for risk of mortality. There was a 12% increase in the RR of cardiac death or MI associated with PCIs, as well as a 22% increase in the RR of nonfatal MI associated with PCIs. 

One trial, the Arbeitsgemeinschaft Leitende Kardiologische Krankenhaus&#228;rzte (ALKK),

 reports an RR and a 95% CI that are below 1.0 for mortality (RR, 0.36; 95% CI, 0.15-0.88), while another trial, the Medicine, Angioplasty, or Surgery Study (MASS-II),

 reports an RR and a 95% CI that are above 1.0 for mortality (RR, 3.63; 95% CI, 1.03-12.82). The remaining trials report RRs and CIs for mortality that include 1.0 (

). The pooled RR for mortality is 0.97 (95% CI, 0.82-1.14). For cardiac death or MI, the ALKK46 reports an RR and a 95% CI that terminate at 1.0 from below, while the MASS-II43 reports an RR and a 95% CI that terminate at 1.0 from above (

). The pooled RR for cardiac death or MI is 1.12 (95% CI, 0.99-1.27). No individual trial reports an RR and a CI that do not include 1.0 for nonfatal MI; the pooled RR is 1.22 (95% CI, 1.04-1.44) (

). Evidence from individual RR ratios is mixed for follow-up PCI or CABG surgery, with a pooled RR estimate of 1.00 (95% CI, 0.80-1.26) (

). Additional results are given in the online appendix (

This study adds to the current body of literature on PCIs by considering between-study heterogeneity, bias, consistency of outcomes among studies, inclusion of 2 recent large studies, and historical aspects of PCI acceptance by payers and healthcare providers. Consideration of these features affirms and increases confidence in the previous findings. We also find that contrary to perception, except for the first RCT,

 cumulative effects support the finding that PCIs offer no marginal benefit over MT for the 4 outcomes studied herein. Consideration of how PCIs became covered by Medicare and were accepted by healthcare providers lends credence to the conclusion that PCIs provide no marginal benefit over MT alone. Policy may be further informed by these findings because they may prompt additional service review by payers, employers, and consumers in addition to providers.

A meta-analysis by Katritsis and Ioannidis

 of 11 RCTs comparing PCIs with conservative treatment in patients with stable CAD was updated to include 2 recent large trials.

The following 4 outcomes were considered: (1) For death, the combined estimate of RR is 0.97, implying no difference between PCIs and MT. (2 and 3) For cardiac death or MI and for nonfatal MI, the combined estimates are greater than 1.0 (1.12 and 1.22, respectively), favoring MT. (4) When the clinical outcome is follow-up PCI or CABG surgery, randomeffects estimation accounting for between-study heterogeneity demonstrates a wide 95% CI for the pooled RR, which prevents inferences about the superiority of PCIs versus MT. No evidence of between-study heterogeneity is found for death, cardiac death or MI, and nonfatal MI (Q statistics, 

 = .86, respectively). Because of the small number of studies, the test of homogeneity has low power to detect excess variation (variation beyond sampling error) and cannot be interpreted as evidence of homogeneity. However, fixed-effects and random-effects estimates are remarkably close for these outcomes, implying the absence of between-study heterogeneity. The null hypothesis for unitary RR is rejected for nonfatal MI (

The fixed-effects estimate of RR for follow-up PCI or CABG surgery in patients treated with PCIs compared with MT is 0.81. However, because of substantial between-study heterogeneity (&#967;

 <.01), this estimate is unreliable. By ignoring between-study variability, the fixed-effects model underestimates the standard error of the summary estimate and creates a misleadingly narrow CI. The substantial between-study variability is taken into account in the computation of the randomeffects estimate (RR, 1.00) and is reflected in a wider 95% CI of 0.80 to 1.26. Consequently, no conclusions can be made based on the more conservative random- effects estimate. Four trials, the Clinical Outcomes Utilizing Re vascularization and Aggressive Drug Evaluation (COURAGE), 

 Second Randomized Intervention Treatment of Angina (RITA-2),41 and ALKK,

 favors MT. Because the sources of heterogeneity are unclear, we cannot produce an overall estimate that is conclusive.

) account for 77.5% of total weight for mortality, 83.2% for cardiac death or MI, 81.4% for nonfatal MI, all fixed-effects models, and 41.7% of the total weight for follow-up PCI or CABG surgery; a random-effects model was used because of substantial between-study heterogeneity. The ALKK

 favors PCIs for the outcomes of death, cardiac death or MI, and follow-up PCI or CABG surgery, accounting for 6.5%, 6.4%, and 5.9%, respectively, of the total weight. The MASS-II

 favors MT alone and represents 1.2% and 3.2% of the total weight for death and for cardiac death or MI, respectively. COURAGE,

 favor PCIs for follow-up PCI or CABG surgery, accounting for 41.7% of the total weight, while MASS

 favors MT, accounting for 7.5% of the total weight.

), trials are presented in chronologic order from the earliest (Sievers et al

 [2007]), and cumulative summary estimates through the publication of each study are shown at that study&#8217;s publication date. Publication of the Veterans Affairs ACME Investigators trial in 1997 (ACME-2)

 provided insight that there was unlikely to be a difference in performance between PCIs and MT alone for the 4 outcomes studied. The cumulative meta-analysis plot shows that, although the new trials (OAT

) have not changed the estimated effects of PCIs on mortality, they significantly reduce the CI for the pooled estimate. Increased confidence in the otherwise known findings established by the contributions of OAT

 may engender additional support for a policy cognizant of the lack of marginal benefit of PCIs over that of MT alone in nonacute cases. Cumulative analysis for cardiac death or MI, nonfatal MI, and follow-up PCI or CABG surgery also provides support for these conclusions.

The influence analysis shows that for death and for cardiac death or MI, the studies that have the largest influence are ALKK,

 Omission of other studies makes little or no difference. Follow-up PCI or CABG surgery is dominated by the COURAGE

Factors that may lead to a biased overall effect size estimate are summarized by Egger et al.

 Publication bias (in which smaller studies showing negative effect [or no effect] of the treatment are less likely to get published) is usually the most serious concern, but we did not observe it herein. Quality bias was observed for nonfatal MI (funnel plots in eAppendix), which occurs when there are important differences in methodological quality between small and large studies. The lack of important information about disease and study characteristics in the study by Sievers et al

 provides additional evidence for this explanation. Published as an abstract, the study provides no information about the enrollment period, percentage of men and subjects with diabetes mellitus, existence of symptoms, or mean ejection fraction.

The existence of biases in estimating the combined RR for nonfatal MI does not affect the conclusion that MT alone is favored compared with PCIs. To show this, we performed a sensitivity analysis that excluded the 4 studies 

with large RRs. The overall fixed-effects and random-effects estimate is 1.19 (95% CI, 1.01-1.41). The Duval and Tweedie nonparametric trim and fill method accounts for the bias by estimating the number and RRs of missing trials and adjusts the meta-analysis to incorporate the theoretical missing trials. The combined estimate using all 16 trials (13 actual trials and 3 theoretical trials created by the method of Duval and Tweedie) is 1.18 (95% CI, 1.01-1.40) (

). These estimates are close to those reported earlier, providing indirect evidence that bias did not seriously influence the summary estimate.

The US Food and Drug Administration released the first catheter marketed for PCIs from &#8220;investigational device exemption status&#8221; in late 1980, before publication of any RCTs demonstrating effectiveness.

A 1983 survey of Medicare contractors to whom the coverage decision was delegated, also conducted before publication of any RCTs, found that 61.1% covered single-vessel PCIs, 19.2% covered PCIs of 2 or more vessels without qualification, and another 19.2% covered PCIs of 2 or more vessels with qualification.

 The Medicare coverage policy was that single&#8211;coronary artery PCIs were covered, while PCIs of 2 or more coronary arteries were not covered, although procedure effectiveness and safety had not been established. As Medicare inpatient hospital payment transitioned from cost-based to prospective payment, the effect of the new prospective payment system on medical technology adoption was a major concern of the Office of Technology Assessment.

 Technology was classified as the following 4 types: (1) cost-raising, quality-enhancing new technology; (2) operating cost-saving innovations; (3) capital cost-saving innovations; and (4) service or procedure disadoption. New diagnostic and therapeutic procedures &#8220;that reduce LOS [length of stay] or intensity of care&#8221; were classified as technology type 2. The diffusion of PCI technology occurred in response to prices set by the Centers for Medicare & Medicaid Services, then known as the Health Care Finance Administration (HCFA) for payment of Medicare cases. It is likely the appeal to the HCFA and other payers was that of an inexpensive substitute for CABG surgery. In 1982, Sawi

, on page 172, notes the following: &#8220;[M]ost private carriers reimburse for PTCA [percutaneous transluminal coronary angioplasty] to some extent either knowingly or otherwise. In some cases, the charges for PTCA are &#8216;buried&#8217; in other, chargeable, items, such as catheter laboratory charges, coronary angiograms, etc.&#8221;

A possible explanation for HCFA&#8217;s action to approve the use of PCIs was the fear of discouraging technologic innovation as payment structures changed. Per cutaneous coronary inter ventions were accepted without adequate science to support their use. Payers accepted them largely based on the potential of PCIs to save costs, and healthcare providers accepted them based on favorable pricing. After 2 decades of PCI use, science was able to inform practice. After 3 decades of use, it can be said with confidence that the evidence rejects the hypothesis that the use of PCIs in stable CAD has a marginal benefit over that of MT alone. The downstream consequences of multiple decisions favoring PCIs, made without adequate science to support them, are the following: (1) The estimates of costs for PCIs are likely to have ranged from $15 billion to $28.5 billion in 2006. (2) It is unclear whether there will be adequate study in the near term to assess the value of PCIs in unstable CAD, although 3 studies (Medicine vs Angiography in Thrombolytic Exclusion [MATE],49 Thrombolysis in Myocardial Ischemia (TIMI IIIB),

 and Veterans Affairs Non&#8211;Q-Wave Infarction Strategies in Hospital [VANQWISH]

 have shown no marginal benefit over that of MT alone. (3) The use of PCIs in stable CAD will not suddenly drop to zero; that is, investment without positive return in terms of health over that provided by MT alone will continue for a period. (4) The question of how the fixed costs invested to perform PCIs will be managed will be a much more difficult policy question to address than the decision to cover PCIs in the first place.

The policy implications of covering very expensive health technologies include the following: (1) the need to be able to quantify and compare effectiveness and costs, (2) an understanding of the ethical dimensions of equity and the transfer of income from those who will receive the new technology, and (3) a consideration of the relative societal value of investing in the medical technology compared with, for example, investment in education. When such large sums are considered, the effect on other economic sectors, jobs, and overall global competitiveness in the face of such an investment must be added to the equation.

Our analysis is limited in that the relative effectiveness of PCIs in treating angina is not considered. The presence of bias and between-study heterogeneity limits our ability to draw certain conclusions for the use of PCIs in preventing follow-up PCI or CABG surgery, although the evidence does not favor PCIs. The use of PCIs in unstable CAD is also not considered in the present analysis. 

: BlueCross BlueShield of Tennessee, Chattanooga (WTC, PK, JWB, RSM, KP, SM).

: The authors (WTC, PK, JWB, RSM, KP, SM) are employees of Blue- Cross BlueShield of Tennessee and report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.

: Concept and design (WTC, JWB, RSM, KP, SM); acquisition of data (PK); analysis and interpretation of data (WTC, PK); drafting of the manuscript (WTC, PK, JWB, RSM, KP, SM); critical revision of the manuscript for important intellectual content (WTC, PK, JWB, RSM, KP); statistical analysis (PK); administrative, technical, or logistic support (WTC, PK, RSM, KP); and supervision (WTC, PK).

: William T. Cecil, MBA, BlueCross BlueShield of Tennessee, 801 Pine St, 1E, Chattanooga, TN 37402. E-mail: 

. Transluminal dilation of coronary-artery stenosis. 

. Percutaneous coronary interventions (previously called angioplasty, percutaneous transluminal coronary [PTCA], or balloon angioplasty). 

http://www.americanheart.org/presenter.jhtml?identifier=4454

5. Office of Technology Assessment, US Congress

Tools for Evaluating Health Technologies: Five Background Papers, BPâ€“Iâ€“I-142

. Washington, DC: US Government Printing Office; February 1995.

Percutaneous transluminal coronary angioplasty. In: Strategies for Medical Technology Assessment

. Washington, DC: Office of Technology Assessment, US Congress. September 1982:168-174.

. National Hospital Discharge Survey: 2000 annual summary with detailed diagnosis and procedure data. 

. National Hospital Discharge Survey: 2002 annual summary with detailed diagnosis and procedure data. 

. National Hospital Discharge Survey: 2004 annual summary with detailed diagnosis and procedure data. 

. Studies say newer stents for arteries show promise. 

http://www.nytimes.com/2007/09/05/business/05stent.html?_r=1&scp=1&sq=Studies%20say%20newer%20stents%20for%20arteries%20show%20promise&st=cse&oref=slogin<http://www.nytimes.com/2007/09/05/business/05stent.html?_r=1&amp;scp=1&amp;sq=Studies%20say%20newer%20stents%20for%20arteries%20show%20promise&amp;st=cse&amp;oref=slogin

19. Bucher HC, Hengstler P, Schindler C, Guyatt GH

. Percutaneous transluminal coronary angioplasty versus medical treatment for nonacute coronary heart disease: meta-analysis of randomized controlled trials. 

21. Boden WE, Oâ€™Rourke RA, Teo KK, et al; COURAGE Trial Research Group

. Optimal medical therapy with or without PCI for stable coronary disease. 

. Doctors, insurers may differ on stents. Tennessean. April 2, 2007.

Systematic Reviews in Health Care: Meta-analysis in Context

Meta-analysis of Controlled Clinical Trials

. New York, NY: John Wiley & Sons Inc; 2002.

29. Egger M, Davey Smith G, Schneider M, Minder C

. Bias in meta-analysis detected by a simple, graphical test. 

. Systematic reviews in health care: investigating and dealing with publication and other biases in metaanalysis. 

. Trim and fill: a simple funnel-plotâ€“based method of testing and adjusting for publication bias in meta-analysis. 

35. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. 

37. Dakik HA, Kleiman NS, Farmer JA, et al

. Intensive medical therapy versus coronary angioplasty for suppression of myocardial ischemia in survivors of acute myocardial infarction: a prospective, randomized pilot study. 

. Percutaneous transluminal coronary angioplasty versus medical therapy for stable angina pectoris: outcomes for patients with double-vessel versus single-vessel coronary artery disease in a Veterans Affairs Cooperative randomized trial. 

41. Henderson RA, Pocock SJ, Clayton TC, et al; Second Randomized Intervention Treatment of Angina (RITA-2) Trial Participants

. Sevenyear outcome in the RITA-2 trial: coronary angioplasty versus medical therapy. 

. The Medicine, Angioplasty, or Surgery Study (MASS-II): a randomized, controlled clinical trial of three therapeutic strategies for multivessel coronary artery disease: one-year results. 

45. Sievers N, Hamm CW, Herzner A, Kuck KH

. Medical therapy versus PTCA: a prospective randomized trial in patients with asymptomatic coronary single-vessel disease [abstract]. 

47. Office of Technology Assessment, US Congress

Medical Technology and Costs of the Medicare Program

. Washington, DC: US Government Printing Office; July 1984. Publication OTA-H-227.

49. McCullough PA, Oâ€™Neill WW, Graham M, et al

. A prospective randomized trial of triage angiography in acute coronary syndromes ineligible for thrombolytic therapy: results of the Medicine vs Angiography in Thrombolytic Exclusion (MATE) trial. 

51. Boden WE, Oâ€™Rourke RA, Crawford MH, et al

. Outcomes in patients with acute nonâ€“Q-wave myocardial infarction randomly assigned to an invasive as compared with a conservative management strategy [published correction appears in N Engl J Med. 1998;339(15):1091]. 

Articles

Meta-analyses of percutaneous coronary interventions in stable coronary artery disease are updated to include 2 recent large randomized controlled trials.

Steve Martin, BSN, MSEd

Articles

A Meta-analysis Update: Percutaneous Coronary Interventions