Using the 4 Pillars to Increase Vaccination Among High-Risk Adults: Who Benefits?

, , , , ,
The American Journal of Managed Care, November 2017, Volume 23, Issue 11

Pneumococcal; tetanus, diphtheria, and pertussis; and influenza vaccination increased among high-risk adults in a 2-year study.


Objectives: To compare changes in vaccination rates (pneumococcal polysaccharide vaccine [PPSV]; tetanus, diphtheria, and pertussis [Tdap] vaccine; and influenza vaccine) among high-risk adults following an intervention (June 1, 2013, to January 31, 2015) that used the 4 Pillars Practice Transformation Program (4 Pillars Program).

Study Design: Post hoc analysis of data from a randomized controlled cluster trial.

Methods: Eighteen primary care practices received staff education, guidance for using the 4 Pillars Program, and support for a practice immunization champion. Paired t tests were used to compare vaccination rates separately for those with diabetes, chronic lung or chronic heart disease, or other high-risk conditions. Student’s t tests were used to compare vaccination rates across high-risk conditions. Generalized estimating equation modeling was used to determine the likelihood of vaccination.

Results: Based on International Classification of Diseases, Ninth Revision, Clinical Modification codes, 4737 patients aged 18 to 64 years were identified as having diabetes (n = 1999), chronic heart disease (n = 658), chronic lung disease (n = 1682), or another high-risk condition (n = 764). PPSV uptake increased by 12.2 percentage points (PP), Tdap vaccination increased by 11.4 PP, and influenza vaccination increased by 4.8 PP. In regression analyses, patients with diabetes (odds ratio [OR], 2.2; 95% CI, 1.80-2.73), chronic lung disease (OR, 1.50; 95% CI, 1.21-1.87), or chronic heart disease (OR, 1.32; 95% CI, 1.02-1.71) were more likely to receive PPSV than those without the respective high-risk condition. Those with diabetes (OR, 1.14; 95% CI, 1.01-1.28) or chronic lung disease (OR, 1.14; 95% CI, 1.01-1.30) were more likely to receive an influenza vaccine than those without the respective condition. The likelihood of Tdap vaccination was not significantly associated with any of the chronic conditions tested.

Conclusions: An intervention including the 4 Pillars Program was associated with significant increases in vaccination of high-risk adults. However, the overall uptake of recommended vaccines for those with high-risk conditions remained below national goals.

Am J Manag Care. 2017;23(11):651-655Takeaway Points

Using the 4 Pillars Practice Transformation Program (4 Pillars Program), primary care practices can achieve meaningful improvements in adult vaccination rates among high-risk adults younger than 65 years, who are historically a group with low vaccine uptake.

  • There remains a gap between current vaccine uptake and national goals for high-risk adults.
  • The 4 Pillars Program provides step-by-step guidance for implementing evidence-based strategies to improve vaccine uptake.
  • In the program, those with diabetes were more likely to receive the pneumococcal polysaccharide vaccine than those with other high-risk conditions.

Adults with certain chronic medical conditions are at higher risk of complications from some vaccine-preventable diseases because these conditions are known to compromise the immune response to infection or increase vulnerability to the effects of infection.1-3 For example, among adults aged 18 to 64 years, rates of pneumococcal pneumonia are 3.0 to 9.8 times higher for those with chronic heart disease, lung disease, or diabetes compared with healthy adults; for invasive pneumococcal disease, rates are 3.6 to 7.7 times higher.3 Not only are vaccination rates for this group woefully low—20.3% for pneumococcal polysaccharide vaccine (PPSV) in 20144—and far from the Healthy People 2020 goal of 60%,5 there are significant disparities in rates by race,6 health insurance status, and frequency of contact with a medical provider.7 Although the 2013 influenza vaccination rate among high-risk adults (49.5%) was higher than that among those without high-risk conditions (32.9%),8 this value is also below the US goal of 70%.5 Tetanus, diphtheria, and pertussis (Tdap) vaccine uptake among all adults 19 years or older was 20.1% in 2014.4

Recent research on interventions to improve vaccination among high-risk adults is scant. Two studies focused on specialized high-risk populations (patients on dialysis9 and American Indians with diabetes10). The interventions increased PPSV uptake to 65.5% and 92%, respectively, through extensive provider and patient education and outreach to patients, including home vaccination visits. Among patients on dialysis9 and veterans with spinal cord injuries,11 multicomponent interventions resulted in increases in influenza vaccine uptake of 4 to 5 percentage points (PP).

We undertook a 2-year study of 18 primary care practices to test the effectiveness of an intervention designed to increase uptake of adult vaccines using the 4 Pillars Practice Transformation Program (4 Pillars Program). This program is a step-by-step guide for medical practices to implement evidence-based strategies for increasing vaccination rates in primary care or other outpatient settings.12 These strategies are applicable to many practice settings and populations. Overall findings from the randomized controlled cluster trial (RCCT) and pre-post studies have been published.13-15 The purpose of this study was to compare the effect of the intervention on adult PPSV, influenza, and Tdap vaccination rates and likelihood of vaccination among adults aged 18 to 64 years with the 3 most common high-risk medical conditions (diabetes, chronic lung disease, and chronic heart disease) in a post hoc analysis.


The trial was approved by the Human Research Protection Office of the University of Pittsburgh. The methods have been published previously14 and are briefly presented herein.

Sample Size and Sites

Eligible primary care family medicine (FM) and internal medicine (IM) practices from a practice-based research network in Pittsburgh (FM PittNet), a clinical network in southwestern Pennsylvania (Community Medicine, Inc), and a safety-net clinical network in Houston were solicited for participation. When 25 sites (a sufficient number per sample size calculations for an RCCT) had agreed to participate, solicitation ceased. All sites used a common electronic health record (EHR), EpicCare. Eligibility requirements included having at least 100 patients 18 years or older, preliminary baseline vaccination rates less than 50% for at least 1 adult vaccine (influenza, pneumococcal, Tdap), and a willingness to make office changes to increase vaccination rates. Participating practices were stratified by location (urban, suburban, or rural) and discipline (FM or IM), then randomized. The practices in this analysis were the 18 private practices or residency sites in southwestern Pennsylvania and did not include 1 site in Pittsburgh, which dropped out, and 6 publicly funded practices in Houston, from which data on high-risk conditions were not available.

4 Pillars Program and Intervention

The 4 Pillars Program14,15 is founded on 4 evidence-based16,17 key domains: Pillar 1: convenient vaccination services; Pillar 2: communication with patients about the importance of immunization and the availability of vaccines; Pillar 3: enhanced office systems to facilitate immunization; and Pillar 4: motivation through an office immunization champion (IC). The 4 Pillars Program includes background on the importance of protecting patients against vaccine-preventable diseases, barriers to increasing vaccination from both provider and patient perspectives, and strategies to eliminate those barriers. Practices were expected to implement strategies from each of the 4 pillars.

The intervention was designed using the diffusion of innovations theory18 and included the 4 Pillars Program, provider education, and 1-on-1 coaching of the IC for each practice. The IC was responsible for using the 4 Pillars Program to guide the practice’s intervention activities, participating in the biweekly telephone call with a research liaison for coaching, ensuring that chosen strategies were being implemented, and working to maintain motivation of the staff.

The overall study included a 2-year RCCT in which the year 1 controls were crossed over into active intervention and the year 1 intervention groups became maintenance groups after the first year.12-14 In this analysis, all patients from the 18 southwestern Pennsylvania sites were combined and vaccination among eligible high-risk patients was examined at the end of baseline (May 31, 2013) and the end of the intervention (January 31, 2015), at which time all sites had completed the intervention. The effects of the intervention among the types of high-risk conditions were compared in a post hoc analysis.

Data Collection

De-identified demographic data (date of birth, sex, race, health insurance coverage as a proxy for income); office visit dates; International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes for high-risk conditions, including immune and autoimmune diseases, cancers, chronic kidney diseases, diabetes, chronic lung diseases, and chronic heart diseases (codes 42, 135, 141-208.91, 250.0-250.93, 279-279.9, 282.6-284, 288-288.2, 393-398.99, 402.0-404.93, 410-412, 141-141.9, 416-416.9, 428-428.9, 438-438.9, 446-446.7, 491-496, 500-505, 506.4, 506.9, 508-508.9, 510-510.9, 513-519.9, 571-572.8, 585-586, 710-710.9, and 714-714.9) (see eAppendix Table [eAppendix available at]); and vaccination data (vaccines given and dates) were derived from de-identified EHR data extractions. A longitudinal database was created with only those patients who were aged 18 to 64 years at baseline and who had a visit each year during the study period, creating the cohort of individuals for study.

Statistical Analyses

Descriptive analyses were performed for patient demographic characteristics (age, sex, race, health insurance, high-risk condition). Age was used as a continuous variable, and racial groupings were non-Hispanic white and nonwhite. Patients with more than 1 of the 3 high-risk conditions (diabetes, chronic lung disease, chronic heart disease) were included in each of their respective disease groups for analysis. PPSV and Tdap would typically be administered once during the project period; thus, PPSV and Tdap rates are presented as cumulative rates at the end of baseline (May 31, 2013) and end of the intervention (January 31, 2015). For influenza vaccination, the analytical periods were June 1, 2012, to May 31, 2013, for baseline, and June 1, 2014, to January 31, 2015, for the intervention year. Proportions were reported for categorical variables, and means and standard deviations were reported for continuous variables. The primary outcome measures were the cumulative PPSV and Tdap vaccination rates, influenza vaccination rates reported at the end of baseline and the end of the intervention, and PP differences. Student’s paired t tests were performed to test for 2-year differences in influenza vaccination rates and cumulative PPSV and Tdap vaccination rates. In addition, the weighted average vaccination rates were compared between high-risk conditions for each vaccine using Student’s t test.

Multilevel generalized estimating equation modeling, which accounts for the clustered nature of the data (ie, patients are clustered within practices), was conducted using vaccination status for each vaccine as the binary outcome variable. Those who received the PPSV or Tdap vaccine prior to the trial were excluded from the regression analyses. To determine which factors were related to PPSV, Tdap, and influenza vaccine uptake, the regression models also accounted for heterogeneity in demographic characteristics, including age, sex, race, and health insurance. Statistical significance of 2-sided tests was set at a type I error (alpha) equal to 0.05. All analytical procedures were performed using SAS version 9.4 (SAS Institute; Cary, North Carolina).


Among the 4737 patients aged 18 to 64 years who had a high-risk condition, the average age was 52.1 ± 10.2 years, with 54.2% female patients, 8.2% nonwhite patients, and 65.4% who were privately insured (data not shown). In this cohort, 42.2% of patients had diabetes, 35.5% had chronic lung disease, 13.9% had chronic heart disease, and 16.1% had another high-risk condition. Overall, 366 (7.7%) had 2 or more high-risk conditions.

Cumulative PPSV uptake at the end of intervention reached 55.7% for all high-risk patients. Specifically, 59% of those with chronic heart disease, 54% with chronic lung disease, 66% with diabetes, and 39% with another high-risk condition had received PPSV by the end of the intervention (Table 1). Overall cumulative pneumococcal vaccination rates significantly increased 12.2 PP from baseline; patients with diabetes had larger increases than those with chronic lung disease (P = .02), chronic heart disease (P = .032), or another high-risk condition (P = .009). Cumulative Tdap vaccination rates increased significantly for all high-risk patients by 11.4 PP from baseline, reaching nearly 50% at the end of the intervention. Vaccination rates for the various high-risk groups ranged from 46% to 51%. Only those with other high-risk conditions increased their rates significantly more than those with diabetes (12.7 PP vs 11.3 PP, respectively; P = .04). Annual influenza vaccination also increased significantly from baseline for those with diabetes, chronic lung disease, and other high-risk conditions, reaching 57% for all high-risk patients. There were no differences among high-risk groups for PP increases in influenza vaccination rates.

In regression analyses (Table 2), 2060 patients who had received PPSV before the study began (June 1, 2012) were excluded from the PPSV regression model; similarly, 1796 patients who had received the Tdap vaccine before the study began were excluded from the Tdap vaccine regression model. The odds of pneumococcal vaccination were significantly associated with older age (odds ratio [OR], 1.02; 95% CI, 1.01-1.02), white race (OR, 1.45; 95% CI, 1.02-2.06), and having diabetes (OR, 2.22; 95% CI, 1.80-2.73), chronic lung disease (OR, 1.50; 95% CI, 1.21-1.87), and chronic heart disease (OR, 1.32; 95% CI, 1.02-1.71). The odds of Tdap vaccination were significantly inversely associated with being female (OR, 0.83, 95% CI, 0.70-0.99; reference = males). The odds of influenza vaccination were associated with being female (OR, 1.24; 95% CI, 1.12-1.37), with being older (OR, 1.03; 95% CI, 1.03-1.04), with having diabetes (OR, 1.14; 95% CI, 1.01-1.28), and with having chronic lung disease (OR, 1.14; 95% CI, 1.01-1.30).


With a concerted effort, primary care practices were capable of modifying their offices’ systems to significantly improve vaccination rates from baseline levels among high-risk adults younger than 65 years. For pneumococcal vaccine, these results (56%) are in stark contrast to the 2014 national rate of 20%,4 and among those with diabetes (66%), the rate surpasses the national goal of 60%.5 Moreover, the improvement of 12.2 PP is notably higher than secular trends of less than 2 PP per year recently observed among adults aged 19 to 64 years with high-risk conditions.4,19,20 Female sex, older age, and white race were related to higher likelihood of receipt of PPSV, similar to recent national data that indicate significantly lower rates among nonwhites compared with whites6 and higher rates among older than younger individuals.4 In this study, those with diabetes, chronic lung disease, or chronic heart disease were more likely to receive PPSV than patients without each respective high-risk condition. The risk of pneumococcal disease is increased for all 3 of these comorbidities21; thus, it is important to know if an intervention shown to be effective among all adults is similarly effective among high-risk adults or if a special intervention is necessary. These data indicate that high-risk adults do not require a separate intervention, as their increases in PPSV uptake approached increases reported in a study of all adults.14

Tdap vaccine uptake also increased significantly from baseline (by 11.4 PP to 49.4%). These values exceeded the 2015 national rate (20.1%), recent secular trends of 3 PP per year increased uptake for all adults older than 19 years,4,19,20 and the increases among all adults (6.2 PP) shown in a previous study.13 Interestingly, in this study, men with high-risk conditions were more likely to receive the Tdap vaccine, whereas increased rates among women might be expected given the recommendation for pregnant women22 and others who care for infants to receive the Tdap vaccine. Influenza vaccination increased significantly from baseline (3.1-5.9 PP) for those with any high-risk condition. Those with diabetes and those with chronic lung disease were more likely to have received the influenza vaccine compared with those without these conditions, whereas those with chronic heart disease were not more likely to be vaccinated against influenza than those without. Influenza vaccination rates for all groups were still considerably below Healthy People 2020 goals of 70%,5 a troubling finding given their high risk of influenza complications.

Barriers to adult vaccination include patient, provider, and health system issues, such as lack of awareness of the need for vaccination, competing priorities for the physician, and incomplete documentation of vaccination history.23 The Task Force on Community Preventive Services recommends provider reminders and a combination of interventions to increase vaccination coverage among high-risk adults.24 The 4 Pillars Program offers strategies to address each of these types of barriers, including assessing and communicating the need for vaccination by all members of the clinical staff, implementing best practice alerts in the EHR or other reminders to providers, offering simultaneous vaccination with other indicated vaccines, and using standing order protocols. In an RCCT, the 4 Pillars Program demonstrated modest improvements in vaccination rates for all 3 vaccines among all adults.13-15 Other studies have used similar multifaceted approaches to increasing pneumococcal and influenza vaccination25,26 with moderate success.


The pneumococcal vaccine is recommended for cigarette smokers.21 We did not specifically include smokers without high-risk medical conditions and therefore do not know how their inclusion would have changed the vaccination estimates. The completeness and accuracy of ICD-9-CM coding was not verified, although EHRs were used. Other records (eg, pharmaceuticals as a proxy for diagnoses) were not evaluated to confirm or augment ICD-9-CM codes. Separate analyses of uncommon ICD-9-CM codes were not done due to funding and time limitations. The population is limited to the greater Pittsburgh region and may not be generalizable to other populations. This is a post hoc analysis derived from an RCCT. The primary purpose of the analysis was to compare the effect of the intervention on groups of adults with common high-risk conditions rather than demonstrate its effectiveness against no program; hence, before-and-after analyses were conducted.


An intervention including the 4 Pillars Program, staff education, and support for a practice-based IC was associated with significant increases in PPSV, Tdap, and influenza vaccination among high-risk adults aged 18 to 64 years over a 2-year study. These findings further support the use of evidence-based strategies as part of a comprehensive, practice-based effort to address low vaccination rates among adults with high-risk medical conditions. Providers should be aware that the systems that are being successfully used to improve vaccination of non—high-risk patients may be equally effective for vaccinating patients with high-risk conditions.Author Affiliations: Department of Family Medicine, University of Pittsburgh School of Medicine (MPN, KKM, SZ, JMR, RKZ, CJL), Pittsburgh, PA.

Source of Funding: This investigation was supported by a grant (U01 IP000662) from the CDC. The views expressed herein are those of those authors and not those of the CDC. The project described was also supported by the National Institutes of Health through Grant Numbers UL1 RR024153 and UL1TR000005.

Author Disclosures: Dr Nowalk, Ms Zhang, and Mr Raviotta have received grants from Pfizer Inc and Merck & Co. Drs Zimmerman and Lin and Ms Moehling have received grants from Pfizer, Merck, and Sanofi.

Authorship Information: Concept and design (MPN, JMR, RKZ); acquisition of data (MPN, KKM, SZ, JMR, RKZ); analysis and interpretation of data (MPN, SZ, RKZ, CJL); drafting of the manuscript (MPN, CJL); critical revision of the manuscript for important intellectual content (MPN, KKM, JMR, RKZ, CJL); statistical analysis (SZ, CJL); provision of patients or study materials (JMR); obtaining funding (RKZ); administrative, technical, or logistic support (KKM, JMR, RKZ); and supervision (MPN, RKZ).

Address Correspondence to: Mary Patricia Nowalk, PhD, RD, University of Pittsburgh School of Medicine, 4420 Bayard St, Ste 520, Pittsburgh, PA 15260. E-mail:

1. Grohskopf LA, Sokolow LZ, Olsen SJ, Bresee JS, Broder KR, Karron RA. Prevention and control of influenza with vaccines: recommendations of the Advisory Committee on Immunization Practices, United States, 2015-16 influenza season. MMWR Morb Mortal Wkly Rep. 2015;64(30):818-825.

2. Monto AS. Epidemiology of influenza. Vaccine. 2008;26(suppl 4):D45-D48.

3. Shea KM, Edelsberg J, Weycker D, Farkouh RA, Strutton DR, Pelton SI. Rates of pneumococcal disease in adults with chronic medical conditions. Open Forum Infect Dis. 2014;1(1):ofu024. doi: 10.1093/ofid/ofu024.

4. Williams WW, Lu PJ, O’Halloran A, et al; CDC. Surveillance of vaccination coverage among adult populations—United States, 2014. MMWR Surveill Summ. 2016;65(1):1-36. doi: 10.15585/mmwr.ss6501a1.

5. Immunization and infectious diseases. website. Published 2013. Accessed January 18, 2013.

6. Lu PJ, O’Halloran A, Williams WW, Lindley MC, Farrall S, Bridges CB. Racial and ethnic disparities in vaccination coverage among adult populations in the U.S. Vaccine. 2015;33(suppl 4):D83-D91.

doi: 10.1016/j.vaccine.2015.09.031.

7. Lu PJ, O’Halloran A, Williams WW. Impact of health insurance status on vaccination coverage among adult populations. Am J Prev Med. 2015;48(6):647-661. doi: 10.1016/j.amepre.2014.12.008.

8. Lu PJ, O’Halloran A, Ding H, Srivastav A, Williams WW. Uptake of influenza vaccination and missed opportunities among adults with high-risk conditions, United States, 2013. Am J Med. 2016;129(6):636.e1-636.e11. doi: 10.1016/j.amjmed.2015.10.031.

9. Duval L, George C, Hedrick N, Woodruff S, Kleinpeter MA. Network 13 partnership to improve the influenza, pneumococcal pneumonia, and hepatitis B vaccination rates among dialysis patients. Adv Perit Dial. 2011;27:106-111.

10. Traeger MS, Say KR, Hastings V, Yost DA. Achievement of Healthy People 2010 objective for adult pneumococcal vaccination in an American Indian community. Public Health Rep. 2010;125(3):448-456.

doi: 10.1177/003335491012500314.

11. Weaver FM, Smith B, LaVela S, et al. Interventions to increase influenza vaccination rates in veterans with spinal cord injuries and disorders. J Spinal Cord Med. 2007;30(1):10-19.

12. 4 Pillars Practice Transformation Program website. Updated 2017. Accessed October 6, 2017.

13. Nowalk MP, Lin CJ, Pavlik VN, et al. Using the 4 Pillars Practice Transformation Program to increase adult Tdap immunization in a randomized controlled cluster trial. Vaccine. 2016;34(41):5026-5033.

doi: 10.1016/j.vaccine.2016.07.053.

14. Zimmerman RK, Brown AE, Pavlik VN, et al. Using the 4 Pillars Practice Transformation Program to increase pneumococcal immunizations for older adults: a cluster-randomized trial. J Am Geriatr Soc. 2017;65(1):114-122. doi: 10.1111/jgs.14451.

15. Lin CJ, Nowalk MP, Pavlik VN, et al. Using the 4 Pillars Practice Transformation Program to increase adult influenza vaccination and reduce missed opportunities in a randomized cluster trial. BMC Infect Dis. 2016;16(1):623. doi: 10.1186/s12879-016-1940-1.

16. The Community Guide website. Published 2012. Accessed October 6, 2017.

17. Melinkovich P, Hammer A, Staudenmaier A, Berg M. Improving pediatric immunization rates in a safety-net delivery system. Jt Comm J Qual Patient Saf. 2007;33(4):205-210.

18. Oldenburg B, Parcel SG. Diffusion of innovations. In: Glanz K, Rimer BK, Lewis FM, eds. Health Behavior and Health Education: Theory, Research, and Practice. 3rd ed. San Francisco, CA: John Wiley and Sons, Inc; 2002:312-334.

19. Williams WW, Lu PJ, O’Halloran A, et al; CDC. Noninfluenza vaccination coverage among adults - United States, 2012. MMWR Morb Mortal Wkly Rep. 2014;63(5):95-102.

20. Williams WW, Lu PJ, O’Halloran A, et al. Vaccination coverage among adults, excluding influenza vaccination - United States, 2013. MMWR Morb Mortal Wkly Rep. 2015;64(4):95-102.

21. CDC. Use of 13-valent pneumococcal conjugate vaccine and 23-valent pneumococcal polysaccharide vaccine for adults with immunocompromising conditions: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Morb Mortal Wkly Rep. 2012;61(40):816-819.

22. Kretsinger K, Broder KR, Cortese MM, et al; CDC; Advisory Committee on Immunization Practices; Healthcare Infection Control Practices Advisory Committee. Preventing tetanus, diphtheria, and pertussis among adults: use of tetanus toxoid, reduced diphtheria toxoid and acellular pertussis vaccine recommendations of the Advisory Committee on Immunization Practices (ACIP) and recommendation of ACIP, supported by the Healthcare Infection Control Practices Advisory Committee (HICPAC), for use of Tdap among health-care personnel. MMWR Recomm Rep. 2006;55(RR-17):1-37.

23. Johnson DR, Nichol KL, Lipczynski K. Barriers to adult immunization. Am J Med. 2008;121(7 suppl 2):S28-S35. doi: 10.1016/j.amjmed.2008.05.005.

24. Ndiaye SM, Hopkins DP, Shefer AM, et al; Task Force on Community Preventive Services. Interventions to improve influenza, pneumococcal polysaccharide, and hepatitis B vaccination coverage among high-risk adults: a systematic review. Am J Prev Med. 2005;28(suppl 5):248-279. doi: 10.1016/j.amepre.2005.02.016.

25. Lau D, Hu J, Majumdar SR, Storie DA, Rees SE, Johnson JA. Interventions to improve influenza and pneumococcal vaccination rates among community-dwelling adults: a systematic review and meta-analysis. Ann Fam Med. 2012;10(6):538-546. doi: 10.1370/afm.1405.

26. Dexter LJ, Teare MD, Dexter M, Siriwardena AN, Read RC. Strategies to increase influenza vaccination rates: outcomes of a nationwide cross-sectional survey of UK general practice. BMJ Open. 2012;2(3):e000851. doi: 10.1136/bmjopen-2011-000851.