Patients enrolled in the tuberculosis pay-for-performance program received more comprehensive ambulatory care with slightly lower costs and a higher treatment success rate.
Tuberculosis (TB) is a serious public health concern, and Taiwan has implemented a pay-for-performance (P4P) program to incentivize healthcare professionals to provide comprehensive care to TB patients. This study aims to examine the effects of the TB P4P program on treatment outcomes and related expenses.
A population-based natural experimental design with intervention and comparison groups.
Propensity score matching was conducted to increase the comparability between the P4P and non-P4P group. A total of 12,018 subjects were included in the analysis, with 6009 cases in each group. Generalized linear models and multinomial logistic regression were employed to examine the effects of the P4P program.
The regression models indicated that patients enrolled in the P4P program had 14% more ambulatory visits than non-P4P patients (P <.001), but there were no differences in hospitalization rates. On average, P4P enrollees spent $215 (4.6%) less on TB-related expenses than their counterparts. In addition, P4P enrollees had a higher likelihood of being successfully treated (odds ratio, 1.56; P <.001) and were less likely to die compared with nonenrollees.
Patients in the P4P program were less likely to die, were more likely to be treated successfully, and incurred lower costs. Providing financial incentives to healthcare institutions could be a feasible model for better TB control.
Am J Manag Care. 2015;21(1):e35-e42
A population-based natural experimental design with propensity score matching was used to examine the effects of a pay-for-performance (P4P) program for tuberculosis (TB) care in Taiwan. Providing financial incentives could be a feasible model for better TB control.
Tuberculosis (TB) is a serious public health concern and a major cause of death worldwide, especially in Asia and Africa.1 The United Nations Millennium Development Goals state that prevalence and death rates associated with TB should be halved by 2015.2 To achieve the Millennium Development Goals, target, programmatic, and operational issues have been raised.3 The delivery of TB care through the optimal use of currently available service resources is an issue that deserves attention. Studies are needed to provide evidence of how to improve the use, quality, effectiveness, and coverage of TB interventions.3,4
There are a rapidly growing number of pay-for-performance (P4P) program models linking financial incentives and patients’ healthcare outcomes. Many countries have adopted various types of P4P programs to improve healthcare quality while controlling costs.5 There has also been a growing literature examining the effects of P4P programs, yet considerable debate continues about the effectiveness of P4P programs on healthcare outcomes.6-9 Discrepancies in the findings of the empirical studies might be due to the variations in types of financial incentives implemented, the payer mix, and the baseline level of quality care.10
Taiwan’s TB P4P Program
Among the 23 million residents in Taiwan, the annual incidence rate of TB ranged from 72 to 74 per 100,000 persons from 2004 to 2005, and TB has been the 12th or 13th leading cause of death after 2005, and it is also the most lethal infectious disease.11 In the past, TB patients were mainly treated in designated TB centers in Taiwan; however, not every TB patient was properly managed because some patients were distantly located from one of these centers.12,13 Fortunately, Taiwan implemented the National Health Insurance (NHI) program in 1995. The NHI is mandatory and covers over 99% of the population, and 90% of hospitals and clinics nationwide are contracted with NHI. Under NHI coverage, patients can choose preferred healthcare providers for healthcare needs. Therefore, the Taiwan Centers for Disease Control (Taiwan CDC) decided to expand designated TB treatment units to include any NHI-contracted hospitals that had at least 1 TB or chest specialist. This strategy enabled the healthcare providers to treat TB patients with universal health insurance coverage in Taiwan.
In 2001, the Bureau of NHI implemented a pilot P4P program for TB and several other illnesses (including asthma, diabetes, breast cancer, and cervical cancer) to promote evidence-based follow-up care. Since 2004, the TB P4P program has been administered in cooperation with the Taiwan CDC to simplify bureaucratic processes and claim procedures. NHI-contracted hospitals and clinics (with at least 1 TB or chest specialist) can participate in the TB P4P program voluntarily, and physicians can then enroll their TB patients into the program. The new P4P program increased the participation of healthcare providers in TB control from 68 institutions nationwide in 2002, to 751 hospitals and clinics in 2004.
In addition to the regular NHI fee-for-service payments for treating patients with TB (which include physician counseling fees, medication fees, physical examination fees, and laboratory test fees), hospitals and clinics participating in the P4P program also receive extra payments for recommended services, such as diagnosis confirmation fees and comprehensive follow-up and education fees. Special payment rewards are also made for patients completing treatment. For example, the treatment success reward is 2000 New Taiwan (NT) dollars ($1 US = 30 NT dollars as of 2013) for a case of multidrug-resistant TB, and 1000 NT dollars for a regular TB case. Higher payments for specific laboratory tests are also included.14,15 Detailed information on the monetary amount of the financial incentives of the TB P4P program compared with regular payment for TB treatment is listed in the (available at www.ajmc.com). The P4P financial incentive for a typical TB case over an 8-month treatment period is at least 5500 NT dollars, or approximately US$183.
Under the P4P program, the TB case managers, mainly registered nurses (part-time or full-time staff members as needed in each hospital), play a major role. Once enrolled in the P4P program, each TB patient is assigned to a case manager and an attending physician. The case managers are responsible for supervising each enrolled patient (ensuring that each takes prescribed medications and appears at scheduled follow-up visits), as well as providing health education to patients. They also serve as the liaison between public health authorities and healthcare institutions. The P4P-participating providers are required to report treatment processes and case management status to the Taiwan CDC, which facilitates intensive follow-up. The P4P payment is reimbursed by the Bureau of NHI after verification by the CDC.
This study extends the existing studies in 2 ways. First, previous studies have evaluated the preliminary effects of the TB P4P program by using NHI claims data to identify TB cases,16,17 and the healthcare expenses have not yet been evaluated. Furthermore, only limited outcomes measures have been reported regarding communicable diseases.18 Second, the majority of previous studies on P4P programs and healthcare outcomes were conducted in diverse settings in the United States. However, the US healthcare system is characterized by multiple payers; physicians may contract with a number of commercial insurance companies, Medicaid health maintenance organizations, or Medicare groups.
In addition, most P4P programs include relatively small-scale financial intervention—only a few P4P initiatives have expanded to include national coverage in the US healthcare system. Small-scale financial incentive interventions, either from payers or purchasing coalitions, may not capture the attention of physicians.19 Conversely, Taiwan has implemented a P4P program with a national scope under a universal coverage healthcare system, which provides a favorable research setting to investigate the effects of a P4P program. Therefore, the purpose of this study was to evaluate the effects of the TB P4P program on healthcare expenses and treatment outcomes under a universal coverage system in Taiwan.
The NHI P4P program for TB was introduced in 2001. According to Taiwan’s Communicable Disease Control Act, doctors are required to report suspected or confirmed TB cases to the Taiwan CDC within 7 days after diagnosis. To avoid the possible confounding effect of the severe acute respiratory syndrome outbreak in 2003 and the Directly Observed Treatment, Short-Course program—the WHO-recommended treatment model for TB—which was implemented in 2006 in Taiwan, this study only analyzed the TB cases confirmed in 2004 and the healthcare expenses incurred in 2004 and 2005.
This was a population-based retrospective study. The data used in this study were acquired from the Taiwan CDC’s national TB control database; all cases reported and confirmed in 2004 were included in the analysis. Data for healthcare utilization and expenses during 2004 and 2005 came from the NHI claims database. The 2 data sets were linked by the subjects’ personal identification numbers, and the study was approved by the academic research units of the Taiwan CDC.
To minimize the differences between the characteristics of the patients in the intervention (P4P) and comparison (non-P4P) groups, propensity score matching was adopted in the analysis. We created propensity scores that predicted the probability of patients’ enrollment in the P4P program. The covariates included patient characteristics (eg, age, sex, residence area, aboriginal status, Charlson Comorbidity Index [CCI] score, sputum status) and characteristics of healthcare providers (eg, ownership and accreditation level). We employed the Mahalanobis distance calculation method with 1:1 matches between the intervention group and the comparison group based on the propensity score.
Variables of Interest
The dependent variables examined in this study were healthcare utilization, healthcare expenses, and treatment outcomes. TB-related healthcare utilization and expenses were identified by the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes of 010-018 as the primary or secondary diagnosis in the NHI claims database. Healthcare utilization included the number of outpatient visits, emergency department (ED) visits, and hospitalizations related to TB. Healthcare expenses included the expenses for all TB-related outpatient visits, ED visits, and hospitalizations, as well as the total TB-related healthcare expenses incurred by the patients. Finally, the treatment outcomes were classified into treatment success, death, or unfavorable outcomes (ie, lost to follow-up, treatment failure, or still under treatment).
A generalized linear model with logarithmic link and negative binominal distribution was used to estimate the effects of the P4P program on the number of outpatient visits, the number of ED visits, and the number of hospitalizations. The values for healthcare expenses were right-skewed; therefore, we used a generalized linear model with logarithmic link and gamma distribution. The predicted values of healthcare expenses from the regression models were calculated to illustrate the results obtained in the 2 study groups. Finally, we used multinomial logistic regression to examine the effects of the P4P program on treatment outcomes. We used the NCSS (version 2007, Kaysville, Utah) for the propensity score matching and SAS (version 9.1, Cary, North Carolina) for statistical analysis. A P value of less than .05 indicates statistical significance.
A total of 16,784 cases of TB were reported to and confirmed by the Taiwan CDC in 2004. The cases with foreign identification numbers or the identification numbers that had no matches in the NHI claims database (N = 1227) were excluded. There were 15,557 subjects included in the analysis. These subjects were treated in 374 hospitals and 377 clinics in 2004; the majority of these cases were treated in hospitals.
The majority of the TB subjects were male (69.3%), living in nonindigenous (91.9%) and nonaboriginal groups (93.5%), and 48.3% were 65 years and older. Concerning the subjects’ disease characteristics, 56.4% had positive sputum tests, and 58.5% had a CCI score equal to or greater than 1. About 50.6% of the subjects received TB treatment in public or government-run healthcare institutions, and 58% were treated in the outpatient departments of medical center hospitals and regional hospitals, which are referral hospitals (compared to more local district hospitals and clinics).
The basic characteristics of the subjects and the healthcare providers by P4P and non-P4P groups are shown in . The logistic regression used for the propensity score prediction had a goodness-of-fit examined by the Hosmer-Lemeshow test (P = .308 > .05). Before the propensity score matching process, the subjects in the P4P group were less likely to be aboriginal or living in indigenous areas and more likely to have active sputum status than those in the non-P4P group; P4P enrollees tended to be treated in public and higher levels of healthcare institutions. After the propensity score matching process, 12,018 patients were included in the analysis, with 6009 patients in each group. The demographics and disease characteristics of the subjects and the characteristics of their healthcare providers became similar between the 2 groups.
shows TB-related healthcare utilization, including the numbers of outpatient visits, the number of ED visits, and the number of hospitalizations. The P4P enrollees used 14% more TB-related outpatient services (incidence rate ratio, 1.14; P <.001) than the non-P4P subjects; yet, there was no significant difference in the number of ED visits or hospitalizations between the P4P and non-P4P groups. Patients with comorbidities (CCI score ≥1) tended to have higher numbers of outpatient and ED visits and hospital admissions (P <.001). Patients 65 years or older had fewer outpatient visits, but more ED visits and hospital admissions (P <.001). Patients who were male or aboriginals or had a positive sputum test had more ED visits and hospital admissions (P <.001). shows the results from the generalized linear model regressions for TB-related healthcare expenses. After controlling for related variables, patients enrolled in the P4P group incurred more TB-related outpatient expenses than the non-P4P patients (β = 0.28; cost ratio [CR], 1.33; P <.001). The P4P enrollees also incurred higher TB-related ED expenses (β = 0.19; CR, 1.20; P <.001), but lower hospitalization expenses (β = —0.10; CR, 0.90; P <.001) than nonenrollees. Finally, the P4P enrollees had slightly lower total TB-related healthcare expenses (β = —0.05; CR, 0.95; P <.001) than non-enrollees, with a cost savings of US$215, or 4.6%, for P4P enrollees versus nonenrollees (US$4674 vs US$4889).
The results also indicated that patients in any of the following groups had significantly higher total TB-related healthcare expenses: demonstrating comorbidities, 65 years or older, positive sputum test, male, treated in a public institution or higher accredited provider (medical centers and regional hospitals). shows the effects of the TB P4P program on treatment outcomes at the end of the study period. Of the 12,018 study subjects, 9265 patients were cured (treatment success), 1628 patients were deceased, and 1125 patients were either still under treatment, lost to follow-up, or had treatment failure (noted as “other” in the analysis). Since there was no established software to test the goodness of fit for the multinomial logistic regression, we conducted 2 separate tests for the P4P and non-P4P groups of the outcomes suggested by Begg and Gray.20 The Hosmer-Lemeshow tests showed marginal goodness of fit (P = .020 and .344, respectively), yet the areas under the receiver operating characteristic curves were .844 and .847, respectively, which indicated a fairly good fit.
After controlling for potential confounding factors and using patients who were deceased as the reference group, we found that patients enrolled in the P4P program were more likely to complete treatment successfully (odds ratio [OR], 1.56; P <.001). The patients who were aboriginals or treated at higher levels of healthcare providers were more likely to be treated successfully, while patients 65 years and older (with positive sputum tests, treated in public healthcare institutions, or with comorbidities) were more likely to die during the treatment course. Of deceased patients, 73.7% had CCI scores ≥1, 81.9% were aged 65 years or older, 73.3% were sputum-positive, 73.9% were male, 98.3% were nonaboriginal, 75.5% were treated in public institutions, and 82.2% were treated in district hospitals and clinics.
This study aimed to examine the effects of the TB P4P program jointly introduced by Taiwan’s CDC and Bureau of NHI. Findings from the analysis indicated that financial incentives to healthcare providers for better TB treatment resulted in more follow-up visits and higher outpatient expenses. However, the P4P enrollees incurred fewer hospitalization expenses and had slightly lower total TB-related healthcare expenses (4.6%, or US$215 savings) than non-P4P enrollees, implying that reduced TB-related hospitalization expenses might offset the higher expenses associated with outpatient visits. This is the first report on possible savings from the TB P4P program that is similar to the findings of a previous study on the P4P program for diabetes in Taiwan.21
Regarding the P4P program’s effect on treatment outcomes, we found that the P4P enrollees with TB were more likely to be cured (OR, 1.56, or 236 lives saved). These findings are similar to those of previous reports using only NHI claim data in Taiwan.16,17 The results reported by Li et al revealed that both the treatment success rate and the average length of treatment for treatment-success cases improved significantly after the introduction of the P4P program for TB.16 Tsai et al suggested that the P4P program on TB improved the treatment default rate (ie, lost to follow-up) for TB patients.17 The present study used more comprehensive data by combining the Taiwan CDC mandatory reporting data and the NHI claims data, and the statistical models may have produced more precise estimates. Furthermore, this study employed a propensity score matching technique to increase the comparability of the P4P and non-P4P groups, which may enhance the robustness of the findings.
The TB P4P program included not only the incentives for processes and outcomes measures, but also the “information integrated platform,” which improved the cooperation of the public health agencies and healthcare institutions in Taiwan. Via this electronic information—sharing platform, both healthcare providers and public health officials can access the most updated information regarding the treatment progress of individual TB patients, such as their visit records, side effects experienced, prescription records, and follow-up status. Overall, the platform facilitates the monitoring of patient progress by physicians and case managers. Bardach and colleagues have reported that electronic health records might play an important role among small practices in response to financial incentive programs in the United States.22 Therefore, the P4P scheme accompanying a well-designed electronic information system could enhance the patient care quality and effectiveness of case management.
While the P4P program for TB care in Taiwan was implemented nationwide under a universal coverage plan, P4P programs in the United States have tended to be on a smaller scale and implemented by individual health plans. We suggest that the scope of application might be expanded, or that a uniform financial design might be implemented across various payers,8 to strengthen the potential effects in the United States. In addition, the public health authorities might consider incorporating financial incentive components into communicable disease control programs to improve better healthcare outcomes.
Several limitations of the study should be mentioned. The enrollment of hospitals and clinics into the TB P4P program was voluntary, and there may be specific characteristics of these health institutions that introduce selection bias into this study. Furthermore, the enrollment of patients into the P4P program was voluntary, so selection bias might exist, although we used propensity score matching to increase comparability between the enrolled and nonenrolled patients. Finally, other factors that might influence the treatment outcome, such as the patients’ socioeconomic status, health literacy, and severity of TB, were not controlled for in the analysis. The interpretation of the findings should be conservative.
The study showed that the financial incentive program for TB treatment and management was associated with an increased number of follow-up visits. Patients enrolled in the program incurred higher expenses for outpatient services but lower hospitalization expenses and total TB-related healthcare expenses. We conclude that the program enrollees were less likely to die, more likely to finish treatment, and incurred lower costs compared with nonenrolled counterparts. Providing financial incentives to healthcare institutions could be a feasible model for better TB control. More detailed cost-effectiveness studies are needed in the future.Author Affiliations: Centers for Disease Control, Ministry of Health and Welfare (C-YL, S-LY, H-YL), Taipei, Taiwan; Institute of Health Policy and Management, College of Public Health, National Taiwan University (C-YL, S-HC), Taipei, Taiwan; School of Gerontology Health Management; Master's program in Long-Term Care, College of Nursing, Taipei Medical University (M-JC), Taipei, Taiwan.
Source of Funding: None.
Author Disclosures: The authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (C-YL, S-LY, S-HC); acquisition of data (C-YL); analysis and interpretation of data (C-YL, M-JC, S-LY, H-YL, S-HC); drafting of the manuscript (C-YL); critical revision of the manuscript for important intellectual content (C-YL, S-LY, S-HC); statistical analysis (C-YL, M-JC); provision of study materials or patients (C-YL); administrative, technical, or logistic support (C-YL, M-JC, S-LY, H-YL); supervision (C-YL, S-LY, H-YL).
Address correspondence to: Shou-Hsia Cheng, PhD, Institute of Health Policy and Management, College of Public Health, National Taiwan University, 17 Xu-Zhou Rd, Taipei, Taiwan. E-mail: email@example.com.REFERENCES
1. WHO Report 2011: Global Tuberculosis Control. Geneva, Switzerland: World Health Organization; 2011.
2. United Nations. Millennium Development Goals (MDGs). WHO website. http://www.who.int/mediacentre/factsheets/fs290/en/. Accessed January 21, 2015.
3. Zumla A, Cobelens F. Operational research and MDG tuberculosis control targets. Lancet Infect Dis. 2012;12(4):262-263.
4. Zachariah R, Harries AD, Ishikawa N, et al. Operational research in low-income countries: what, why, and how? Lancet Infect Dis. 2009;9(11):711-717.
5. Meddings JA, McMahon LF. Measuring quality in pay-for-performance programs: from ‘one-size-fits-all’ measures to individual patient risk-reduction scores. Dis Manag Health Outcomes. 2008;16(4):205-216.
6. Petersen LA, Woodard LD, Urech T, Daw C, Sookanan S. Does pay-for-performance improve the quality of health care? Ann Intern Med. 2006;145(4):265-272.
7. Christianson JB, Leatherman S, Sutherland K. Lessons from evaluations of purchaser pay-for-performance programs: a review of the evidence. Med Care Res Rev. 2008;65(6 suppl):5S-35S.
8. Van Herck P, De Smedt D, Annemans L, Remmen R, Rosenthal MB, Sermeus W. Systematic review: effects, design choices, and context of pay-for-performance in health care. BMC Health Serv Res. 2010;10:247.
9. Emmert M, Eijkenaar F, Kemter H, Esslinger AS, Schöffski O. Economic evaluation of pay-for-performance in health care: a systematic review. Eur J Health Econ. 2012;13(6):755-767.
10. Dolor RJ, Schulman KA. Financial incentives in primary care practice: the struggle to achieve population health goals. JAMA. 2013;310(10):1031-1032.
11. Lo HY, Chou P, Yang SL, Lee CY, Kuo HS. Trends in tuberculosis in Taiwan, 2002-2008. J Formos Med Assoc. 2011;110(8):501-510.
12. National Development Council (former Research Development and Evaluation Commission), Executive Yuan. Effectiveness analysis of Taiwan National Tuberculosis Program (Chinese version). 2009:87. National Development Council website. http://www.ndc.gov.tw/dn.aspx?uid=34786. Accessed January 21. 2015.
13. Storla DG, Yimer S, Bjune GA. A systematic review of delay in the diagnosis and treatment of tuberculosis. BMC Public Health. 2008;8:15.
14. Bureau of National Health Insurance. National Health Insurance in Taiwan. Taipei: Department of Health; 2010.
15. Bureau of National Health Insurance. Five pay for performance programs: preliminary outcomes (Chinese version). National Health Insurance Bimonthly Journal. 2003;44. http://www.nhi.gov.tw/webdata/webdata.aspx?menu=6&menu_id=168&webdata_id=1543. Accessed January 21, 2015.
16. Li YH, Tsai WC, Khan M, et al. The effects of pay-for-performance on tuberculosis treatment in Taiwan. Health Policy Plan. 2010;25(4):334-341.
17. Tsai WC, Kung PT, Khan M, et al. Effects of pay-for-performance system on tuberculosis default cases control and treatment in Taiwan. J Infect. 2010;61(3):235-243.
18. Nambiar D. Performance incentives for global health: potential and pitfalls. Global Public Health. 2011;6(1):106-109.
19. Rosenthal MB, Frank RG. What is the empirical basis for paying for quality in health care? Med Care Res Rev. 2006;63(2):135-157.
20. Begg CB, Gray R. Calculation of polychotomous logistic regression parameters using individualized regressions. Biometrika.1984;71(1):11-18.
21. Cheng SH, Lee TT, Chen CC. A longitudinal examination of a pay-for-performance program for diabetes care: evidence from a natural experiment. Med Care. 2012;50(2):109-116.
22. Bardach NS, Wang JJ, De Leon SF, et al. Effect of pay-for-performance incentives on quality of care in small practices with electronic health records: a randomized trial. JAMA. 2013;310(10):1051-1059.