Currently Viewing:
The American Journal of Managed Care October 2009
Bending the Curve: Effective Steps to Address Long-Term Healthcare Spending Growth
Joseph Antos, PhD; John Bertko; Michael Chernew, PhD; David Cutler, PhD; Dana Goldman, PhD; Mark McClellan, MD, PhD; Elizabeth McGlynn, PhD; Mark Pauly, PhD; Leonard Schaeffer; and Stephen Shortell, PhD
Statin Adherence and Mortality in Patients Enrolled in a Secondary Prevention Program
Brandy D. McGinnis, PharmD; Kari L. Olson, PharmD; Thomas M. A. Delate, PhD; and Ryan S. Stolcpart, PharmD
Impact of Compliance With Proton Pump Inhibitors on NSAID Treatment
Mei Sheng Duh, MPH, ScD; Antoine Gosselin, MA; Roger Luo, PhD; Herve Lohoues, PhD; Barbara E. Lewis, PhD; and Joseph A. Crawley, MS
Delivering Vaccines: A Case Study of the Distribution System of Vaccines for Children
Jason T. Shafrin, PhD; and John M. Fontanesi, PhD
Currently Reading
Office Manager and Nurse Perspectives on Facilitators of Adult Immunization
Mary Patricia Nowalk, PhD, RD; Melissa Tabbarah, PhD, MPH; Jonathan A. Hart, MS; Dwight E. Fox, DMD; Mahlon Raymund, PhD; Stephen A. Wilson, MD, MPH; and Richard K. Zimmerman, MD, MPH; for the FM-PittNet Practice Based Research Network
Do Patients Continue to See Physicians Who Are Removed From a PPO Network?
Meredith B. Rosenthal, PhD; Zhonghe Li, MS; and Arnold Milstein, MD, MPH
Dental Care Coverage Transitions
Richard J. Manski, DDS, MBA, PhD; John F. Moeller, PhD; Haiyan Chen, MD, PhD; Patricia A. St Clair, ScB; Jody Schimmel, PhD; Larry S. Magder, MPH, PhD; and John V. Pepper, PhD
The Effect of Certificate-of-Need Laws on Hospital Beds and Healthcare Expenditures: An Empirical Analysis
Fred J. Hellinger, PhD
Healthcare Reform With a Safety Net: Lessons From San Francisco
Andrew B. Bindman, MD; Anders Chen, MD; Jean S. Fraser, JD; Hal F. Yee Jr, MD, PhD; and David Ofman, MD, MA
Effects of a Medicaid Prior Authorization Policy for Pregabalin
Jay M. Margolis, PharmD; Stephen S. Johnston, MA; Bong-Chul Chu, PhD; Eberechukwu Onukwugha, PhD; Kyle Hvidsten, MPH; Jose Alvir, DrPH; Joseph G. Rossi, PharmD; and C. Daniel Mullins, PhD
Preventing Myocardial Infarction and Stroke With a Simplified Bundle of Cardioprotective Medications
R. James Dudl, MD; Margaret C. Wang, PhD, MPH; Michelle Wong, MPH, MPP; and Jim Bellows, PhD

Office Manager and Nurse Perspectives on Facilitators of Adult Immunization

Mary Patricia Nowalk, PhD, RD; Melissa Tabbarah, PhD, MPH; Jonathan A. Hart, MS; Dwight E. Fox, DMD; Mahlon Raymund, PhD; Stephen A. Wilson, MD, MPH; and Richard K. Zimmerman, MD, MPH; for the FM-PittNet Practice Based Research Network

Factors significantly associated with adult vaccination rates in primary care practices were patients’ age, race, scheduled well-visit length, and nurses’ vaccination status.

Objective: To assess which characteristics of primary care practices serving low- to middle-income white and minority patients relate to pneumococcal polysaccharide vaccine (PPV) and influenza vaccination rates.


Methods: In an intentional sample of 18 primary care practices, PPV and influenza vaccination rates were determined for a sample of 2289 patients ≥65 years old using medical record review. Office managers and lead nurses were surveyed about their office systems for providing adult immunizations, beliefs about PPV and influenza vaccines, and their own vaccination status. Hierarchical linear modeling (HLM) analyses were used to account for the clustered nature of the data.


Results: Sampled patients were most frequently female (61%) and white (83%), and averaged 76 years of age. Weighted vaccination rates were 61.1% for PPV and 52.5% for influenza; rates varied by practice. Using HLM, with patient age and race entered as level 1 variables and office factors entered as level 2 variables, time allotted for an annual well visit was associated with a higher likelihood of influenza vaccination (odds ratio [OR] = 1.04; 95% confidence interval [CI] = 1.02, 1.07; P = .003). Nurse influenza vaccination status was associated with a higher likelihood of PPV vaccination (OR = 3.81; 95% CI = 1.49, 9.78; P = .009).


Conclusions: In addition to race and age, visit length and the nurses’ vaccination status were associated with adult vaccination rates. Quality improvement initiatives for adult vaccination might include strengthening social influence of providers and/or ensuring that adequate time is scheduled for preventive care.


(Am J Manag Care. 2009;15(10):755-760)

Pneumococcal polysaccharide vaccine and influenza vaccination rates varied widely across 18 primary care practices.


  • Influenza vaccination status of the lead nurse was associated with pneumococcal vaccination of patients.
  • Longer scheduled well-visit times were associated with a higher influenza vaccination rate.
  • A greater emphasis on adult well visits, with sufficient time allotted for preventive services such as immunizations, may help to increase vaccination rates.
Immunizations are an important quality measure for primary care, yet rates of adult immunizations are below ideal levels and disparities in rates by race have been widely observed.1-3 Differential uptake due to mistrust, lack of access, lack of awareness,4 or lack of perceived recommendation5 by healthcare providers may be addressed through interventions at the patient level (reminders) or provider level (recommendations).6,7 Differences among the primary care practices where vaccines are received also may account for racial disparities and low rates. For example, patients seen in inner-city practices have significantly lower overall vaccination rates compared with patients seen in Veterans Affairs practices, and racial disparities exist among the former, but not the latter.4,8 Research has shown that blacks and whites receive care from providers who differ both in their training and in the level and types of resources available to them.9 Furthermore, the number of immunization-promoting activities in a practice is related to adult pneumococcal polysaccharide vaccine (PPV) vaccination rate,10 and increasing office systems to promote immunizations increases overall practice rates and reduces racial disparities.11 In this study, we intentionally sampled practices with predominantly minority patients and practices with predominantly white patients, loosely matched by neighborhood income, and used hierarchical linear modeling (HLM) to account for clustering of patients within practices to explore additional office factors that may affect adult vaccination rates.


Detailed methodology including site selection, recruitment, survey development, patient selection, power calculations, and medical record review has been published.12 Methods specific to this analysis will be described herein.

Site Selection and Recruitment

In general, we selected diverse practices that served a large percentage of elderly patients and had white and/or minority providers. We attempted to match a practice serving primarily minority patients with a similar practice serving primarily white patients in socioeconomically comparable neighborhoods, based on US Census data. Of 23 practices selected, 18 agreed to participate. Five practices failed to respond to requests or refused to participate, for a refusal rate of 22% (5/23).

Survey Development

The questionnaires were designed to describe current medical practices and determine barriers to and facilitators of organizational change that could lead to quality improvement strategies to increase adult immunization. Constructs from the PRECEDE-PROCEED framework (predisposing, enabling, and environmental factors) were included in the office manager and nurse questionnaires. For instance, office managers were asked about time allotted for visits, continuing education opportunities for staff, and staff retention and satisfaction. Nurses were asked about policies to support adult immunization such as standing orders, vaccine screening responsibility, and so forth. Some of the factors of the Competing Values Framework13,14 were used to assess teamwork, innovation, bureaucracy, and efficiency that affect the ability of a practice to implement quality improvements.

The surveys were developed and revised through an iterative process by a multidisciplinary team that examined them for face and content validity.15 They were pilot-tested before use and revised accordingly. Office manager and nurse respondents were offered $50 payment in the form of a check or gift certificate. To reduce keystroke entry error, survey data were entered twice into an electronic database, results were compared electronically, and discrepancies were reconciled.

Patient Sampling

The first stage of a 2-stage stratified sampling created an intentional sample of diverse practices, stratified by race of the patients. In the second stage, random sampling of patient records within the practices was conducted, leading to a clustered, random sample. From electronic billing lists or medical records, patients were selected who (1) were born before January 1, 1940 (age ≥65 years in 2005); (2) were living; and (3) had an office visit in the last 12 months, indicating that they were active patients of the practice.

Medical Record Review

Because of Health Insurance Portability and Accountability Act regulations, manual medical record review was performed by a certified honest broker.16 In 2006, the honest broker used the randomized list to confirm eligibility, then collected data from 150 to 175 patient charts in large practices or all eligible charts in smaller practices (with <150 eligible patients).

Data Reduction

Because of the complexity of hierarchical analyses, 21 priority variables from the surveys (12 from the office manager survey and 9 from the lead nurse survey) were selected for HLM analyses. Priority variables (Table 1) were chosen based on a priori importance, a sufficient number of responses, or reasonable variable distribution. Some variables such as different systems to increase vaccination rates were combined.

Statistical Methods

The deidentified medical record data file was merged with the questionnaire data files for the office manager and nurse. Based on sampling fractions, weights were calculated so that the reviewed records reflected the patient panels within practices. SAS software (SAS Institute Inc, Research Triangle Park, NC) was used to calculate descriptive statistics. Summary vaccination rates were weighted and stratified; the Cochran-Mantel-Haenszel test was used to compare vaccination rates by race. Influenza vaccination status as a dichotomous variable was based on the combined status for an individual patient for the majority (>60%) of years (2001-2005).

HLM version 6 (Scientific Software International, Inc, Lincolnwood, IL) was used to determine the effect of office manager-level and nurse-level variables on vaccination status, while controlling for patient race and age. The reliability estimates for the weighted models without any independent variables were .95 for PPV and .93 for influenza, which showed high reliability. We used full maximum likelihood estimation with the Laplace approximation algorithm.

Following the strategy recommended by Raudenbush and Bryk,17 the multilevel analyses for a Bernoulli distribution were conducted in an incremental fashion, starting with an empty or null model, then adding group-mean centered level 1 variable age and uncentered level 1 variable race, and subsequently adding level 2 variables from the office manager and nurse surveys (grand-mean centered if continuous, uncentered if not). Among level 1 variables, patient race (P = .01) and age (P <.001) were found to be associated with PPV vaccination status and also with influenza vaccination status (race P <.001 and age P = .002). These variables were retained for further HLM analyses.

For level 2 variables with coefficients that were significant at the P <.15 level, correlations were calculated and 1 member of pairs that were significantly correlated was excluded from further analyses. Remaining level 2 variables were entered pairwise into multivariable analyses and the most significant pair selected.

The full mathematical model is shown in the eAppendix (available at


From the 18 practices, 2289 sampled patient records had sufficient and usable data. The patients were largely female (61.1%) and white (82.5%), averaged 76.0 ± 7.0 years of age, and lived in neighborhoods with a median per capita income of $18,831 ± $5745 (2000 census data). Overall, the weighted PPV vaccination rate was 61.1%; the weighted influenza vaccination rate was 52.5%. Average wait time for a return appointment was 6.2 ± 4.8 days; average time allotted for chronic care visits was 20.4 ± 6.7 minutes, and for annual well visits it was 29.4 ± 10.4 minutes; 67% of practices supported outside training/education for staff, but only 39% reported high staff satisfaction. Most practices frequently offered PPV (61%) and influenza vaccine (75%) to eligible adults. In 67% of practices, nurses reported that most patients accept the PPV when it is recommended.

Without accounting for patient race and age, the Figure plots the vaccination rates for practices (shown in columns), stratified by nurse influenza vaccination status (unvaccinated on left, vaccinated on right) and organized by increasing time allotted for annual well visits (using a line to show minutes). Higher PPV and influenza vaccination rates were observed in practices in which the nurse was vaccinated against influenza compared with practices in which the nurse was not vaccinated against influenza. The 2 practices with the lowest PPV and influenza vaccination rates were those in which the nurse did not receive influenza vaccine. 

Hierarchical Linear Modeling

In HLM, the overall variance, also called the residual error (u0), was statistically significant at P <.001 for PPV and for influenza, showing significant between-panel variance in immunization rates and supporting the use of HLM instead of traditional logistic regression. There was no apparent relationship with vaccination rate for many of the variables. However, when entered into the model singly, items associated with PPV at P <.15 included time allotted for an annual well exam, percentage of practices in which most patients accept the PPV when recommended, percentage of practices that frequently recommend influenza vaccine for all eligible adults, and percentage of practices in which nurse respondent received influenza vaccine in the previous season, in addition to patient age.

In HLM, uncorrelated level 2 variables associated with PPV vaccination at P <.15 were entered into multivariable models pairwise. For PPV, the best pair was time allotted for an annual well exam (P = .089) and percentage of practices in which the lead nurse received influenza vaccine in the previous season (P = .009). Patient age and race and 1 practice-level variable, time allotted for an annual well exam, were significantly related to influenza vaccination. Final HLM models with odds ratios and interpretations are presented in Table 2, with identical likelihood of receiving PPV and influenza vaccine associated with time allotted for well visits.


Copyright AJMC 2006-2019 Clinical Care Targeted Communications Group, LLC. All Rights Reserved.
Welcome the the new and improved, the premier managed market network. Tell us about yourself so that we can serve you better.
Sign Up