The American Journal of Managed Care October 2009
Office Manager and Nurse Perspectives on Facilitators of Adult Immunization
Factors significantly associated with adult vaccination rates in primary care practices were patients’ age, race, scheduled well-visit length, and nurses’ vaccination status.
Objective: To assess which characteristics of primary care practices serving low- to middle-income white and minority patients relate to pneumococcal polysaccharide vaccine (PPV) and influenza vaccination rates.
Methods: In an intentional sample of 18 primary care practices, PPV and influenza vaccination rates were determined for a sample of 2289 patients ≥65 years old using medical record review. Office managers and lead nurses were surveyed about their office systems for providing adult immunizations, beliefs about PPV and influenza vaccines, and their own vaccination status. Hierarchical linear modeling (HLM) analyses were used to account for the clustered nature of the data.
Results: Sampled patients were most frequently female (61%) and white (83%), and averaged 76 years of age. Weighted vaccination rates were 61.1% for PPV and 52.5% for influenza; rates varied by practice. Using HLM, with patient age and race entered as level 1 variables and office factors entered as level 2 variables, time allotted for an annual well visit was associated with a higher likelihood of influenza vaccination (odds ratio [OR] = 1.04; 95% confidence interval [CI] = 1.02, 1.07; P = .003). Nurse influenza vaccination status was associated with a higher likelihood of PPV vaccination (OR = 3.81; 95% CI = 1.49, 9.78; P = .009).
Conclusions: In addition to race and age, visit length and the nurses’ vaccination status were associated with adult vaccination rates. Quality improvement initiatives for adult vaccination might include strengthening social influence of providers and/or ensuring that adequate time is scheduled for preventive care.
(Am J Manag Care. 2009;15(10):755-760)
Pneumococcal polysaccharide vaccine and influenza vaccination rates varied widely across 18 primary care practices.
- Influenza vaccination status of the lead nurse was associated with pneumococcal vaccination of patients.
- Longer scheduled well-visit times were associated with a higher influenza vaccination rate.
- A greater emphasis on adult well visits, with sufficient time allotted for preventive services such as immunizations, may help to increase vaccination rates.
Detailed methodology including site selection, recruitment, survey development, patient selection, power calculations, and medical record review has been published.12 Methods specific to this analysis will be described herein.
Site Selection and Recruitment
In general, we selected diverse practices that served a large percentage of elderly patients and had white and/or minority providers. We attempted to match a practice serving primarily minority patients with a similar practice serving primarily white patients in socioeconomically comparable neighborhoods, based on US Census data. Of 23 practices selected, 18 agreed to participate. Five practices failed to respond to requests or refused to participate, for a refusal rate of 22% (5/23).
The questionnaires were designed to describe current medical practices and determine barriers to and facilitators of organizational change that could lead to quality improvement strategies to increase adult immunization. Constructs from the PRECEDE-PROCEED framework (predisposing, enabling, and environmental factors) were included in the office manager and nurse questionnaires. For instance, office managers were asked about time allotted for visits, continuing education opportunities for staff, and staff retention and satisfaction. Nurses were asked about policies to support adult immunization such as standing orders, vaccine screening responsibility, and so forth. Some of the factors of the Competing Values Framework13,14 were used to assess teamwork, innovation, bureaucracy, and efficiency that affect the ability of a practice to implement quality improvements.
The surveys were developed and revised through an iterative process by a multidisciplinary team that examined them for face and content validity.15 They were pilot-tested before use and revised accordingly. Office manager and nurse respondents were offered $50 payment in the form of a check or gift certificate. To reduce keystroke entry error, survey data were entered twice into an electronic database, results were compared electronically, and discrepancies were reconciled.
The first stage of a 2-stage stratified sampling created an intentional sample of diverse practices, stratified by race of the patients. In the second stage, random sampling of patient records within the practices was conducted, leading to a clustered, random sample. From electronic billing lists or medical records, patients were selected who (1) were born before January 1, 1940 (age ≥65 years in 2005); (2) were living; and (3) had an office visit in the last 12 months, indicating that they were active patients of the practice.
Medical Record Review
Because of Health Insurance Portability and Accountability Act regulations, manual medical record review was performed by a certified honest broker.16 In 2006, the honest broker used the randomized list to confirm eligibility, then collected data from 150 to 175 patient charts in large practices or all eligible charts in smaller practices (with <150 eligible patients).
Because of the complexity of hierarchical analyses, 21 priority variables from the surveys (12 from the office manager survey and 9 from the lead nurse survey) were selected for HLM analyses. Priority variables (Table 1) were chosen based on a priori importance, a sufficient number of responses, or reasonable variable distribution. Some variables such as different systems to increase vaccination rates were combined.
The deidentified medical record data file was merged with the questionnaire data files for the office manager and nurse. Based on sampling fractions, weights were calculated so that the reviewed records reflected the patient panels within practices. SAS software (SAS Institute Inc, Research Triangle Park, NC) was used to calculate descriptive statistics. Summary vaccination rates were weighted and stratified; the Cochran-Mantel-Haenszel test was used to compare vaccination rates by race. Influenza vaccination status as a dichotomous variable was based on the combined status for an individual patient for the majority (>60%) of years (2001-2005).
HLM version 6 (Scientific Software International, Inc, Lincolnwood, IL) was used to determine the effect of office manager-level and nurse-level variables on vaccination status, while controlling for patient race and age. The reliability estimates for the weighted models without any independent variables were .95 for PPV and .93 for influenza, which showed high reliability. We used full maximum likelihood estimation with the Laplace approximation algorithm.
Following the strategy recommended by Raudenbush and Bryk,17 the multilevel analyses for a Bernoulli distribution were conducted in an incremental fashion, starting with an empty or null model, then adding group-mean centered level 1 variable age and uncentered level 1 variable race, and subsequently adding level 2 variables from the office manager and nurse surveys (grand-mean centered if continuous, uncentered if not). Among level 1 variables, patient race (P = .01) and age (P <.001) were found to be associated with PPV vaccination status and also with influenza vaccination status (race P <.001 and age P = .002). These variables were retained for further HLM analyses.
For level 2 variables with coefficients that were significant at the P <.15 level, correlations were calculated and 1 member of pairs that were significantly correlated was excluded from further analyses. Remaining level 2 variables were entered pairwise into multivariable analyses and the most significant pair selected.
The full mathematical model is shown in the eAppendix (available at www.ajmc.com).
From the 18 practices, 2289 sampled patient records had sufficient and usable data. The patients were largely female (61.1%) and white (82.5%), averaged 76.0 ± 7.0 years of age, and lived in neighborhoods with a median per capita income of $18,831 ± $5745 (2000 census data). Overall, the weighted PPV vaccination rate was 61.1%; the weighted influenza vaccination rate was 52.5%. Average wait time for a return appointment was 6.2 ± 4.8 days; average time allotted for chronic care visits was 20.4 ± 6.7 minutes, and for annual well visits it was 29.4 ± 10.4 minutes; 67% of practices supported outside training/education for staff, but only 39% reported high staff satisfaction. Most practices frequently offered PPV (61%) and influenza vaccine (75%) to eligible adults. In 67% of practices, nurses reported that most patients accept the PPV when it is recommended.
Without accounting for patient race and age, the Figure plots the vaccination rates for practices (shown in columns), stratified by nurse influenza vaccination status (unvaccinated on left, vaccinated on right) and organized by increasing time allotted for annual well visits (using a line to show minutes). Higher PPV and influenza vaccination rates were observed in practices in which the nurse was vaccinated against influenza compared with practices in which the nurse was not vaccinated against influenza. The 2 practices with the lowest PPV and influenza vaccination rates were those in which the nurse did not receive influenza vaccine.
Hierarchical Linear Modeling
In HLM, the overall variance, also called the residual error (u0), was statistically significant at P <.001 for PPV and for influenza, showing significant between-panel variance in immunization rates and supporting the use of HLM instead of traditional logistic regression. There was no apparent relationship with vaccination rate for many of the variables. However, when entered into the model singly, items associated with PPV at P <.15 included time allotted for an annual well exam, percentage of practices in which most patients accept the PPV when recommended, percentage of practices that frequently recommend influenza vaccine for all eligible adults, and percentage of practices in which nurse respondent received influenza vaccine in the previous season, in addition to patient age.
In HLM, uncorrelated level 2 variables associated with PPV vaccination at P <.15 were entered into multivariable models pairwise. For PPV, the best pair was time allotted for an annual well exam (P = .089) and percentage of practices in which the lead nurse received influenza vaccine in the previous season (P = .009). Patient age and race and 1 practice-level variable, time allotted for an annual well exam, were significantly related to influenza vaccination. Final HLM models with odds ratios and interpretations are presented in Table 2, with identical likelihood of receiving PPV and influenza vaccine associated with time allotted for well visits.