Understanding Vaccination Rates and Attitudes Among Patients With Rheumatoid Arthritis

, , , , , ,
The American Journal of Managed Care, March 2016, Volume 22, Issue 3

Patients with rheumatoid arthritis self-report a moderate rate of any previous pneumococcal vaccination (54%) and a very low rate of herpes zoster vaccination (8%).

ABSTRACT

Objectives: Appropriate vaccinations are important for patients with rheumatoid arthritis (RA), who are often treated with highly immunosuppressive therapies that increase their risk of infection. However, rates of vaccination among patients with RA are below optimal levels.

Study Design: We conducted a patient survey to assess self-reported vaccination status and to compare that status with electronic health record (EHR) data.

We recruited randomly selected patients with RA in an academic practice in 2013. Eligible participants had a diagnosis of RA, at least 1 visit to a rheumatology clinic in each of the previous 2 years, were 18 years or older, and had English listed as their preferred language. The survey included the following domains: a) patient self-reported receipt of influenza, pneumococcal (PNVX), and herpes zoster (HZVX) vaccinations; b) attitudes about these vaccines, including reasons for unvaccinated status, if applicable; and c) provider recommendations about these vaccines.

Methods:

Results: Based on participants’ self-report, we found a high vaccination rate for influenza during the previous season (79.4%), a moderate rate of any previous vaccination for pneumococcus (53.9%), and a very low rate of any previous vaccination for herpes zoster (7.8%). If we assume that all self-reports are accurate and we include vaccinations recorded in the EHR that were not reported by patients, the vaccination rates were approximately 8% to 9% higher for PNVX and HZVX.

Conclusions: Vaccination rates are low among patients with RA based on self-report data. Further research is needed to investigate system-level barriers to vaccination and the impact of evidence-based, provider-level interventions on vaccination rates.

Am J Manag Care. 2016;22(3):161-167

Take-Away Points

Vaccination rates are low among patients with rheumatoid arthritis based on self-report data.

  • Lack of physician recommendation, as recalled by the patient, appears to be the most important factor for unvaccinated status. Only three-fourths of patients said their doctors had discussed their increased risk of infection, and only two-thirds said their doctors discussed the importance of vaccinations.
  • Patient lack of knowledge or negative attitudes toward vaccinations appear to be less important contributors to suboptimal vaccination rates.
  • Further research is needed to investigate system-level barriers to vaccination and the impact of evidence-based provider-level interventions on vaccination rates.

Patients with autoimmune rheumatic diseases have a risk of infection approximately double that of age- and gender-matched controls.1 Patients with rheumatoid arthritis (RA) are at an increased risk for infection due both to inherent dysregulation of the immune system and, for many, the added effect of chronic immunosuppressive therapy. For example, the adjusted hazard ratio for contracting herpes zoster in patients with RA is 1.9 compared with healthy controls.2,3

Because of their increased risk of infection, the Advisory Committee on Immunization Practices (ACIP) recommends that immunocompromised adults receive an annual influenza vaccination (INFVX), as well as the pneumococcal vaccination (PNVX) with the 13-strain pneumococcal conjugated vaccine (PCV-13) followed by the 23-strain pneumococcal polysaccharide vaccine (PPSV-23).4,5 The recommendations are more complex for herpes zoster vaccination (HZVX), which uses a live virus and has historically been considered contraindicated in patients who are severely immunosuppressed. Currently, ACIP recommends HZVX for all individuals 60 years or older.6 However, a recent study found that HZVX had even higher efficacy (ie, 70% risk reduction) among healthy adults aged 50 to 59 years7; HZVX (Zostavax) has FDA approval for use in adults 50 years or older.8 ACIP states that HZVX is safe for patients who are taking less than 20 mg/day of prednisone and/or low doses of methotrexate (≤0.4 mg/kg/week), azathioprine (≤3.0 mg/kg/day) or 6-mercaptopurine (≤1.5 mg/kg/day).6 If a physician plans to initiate a strong immunosuppressant, ACIP recommends the patient be given the HZVX at least 14 days prior to starting the medication.6 This recommendation has been challenged by findings from a recent analysis of Medicare patients with immune-mediated disease who were given HZVX. There was no increase in herpes zoster infections during the 42 days after HZVX, even among patients receiving biologic immunosuppression, whereas those vaccinated had a lower incidence of zoster over a median 2-year follow-up.9

Vaccination rates remain low among RA patients, despite their high risk of infection, strong evidence of vaccine safety and efficacy, and recommendations from national organizations. A recent large study found that only 25% of RA patients were adherent to current vaccine recommendations.10 Studies have shown adherence rates among RA patients ranging from 10% to 34% for INFVX,10-13 17% to 54% for PNVX,12,14,15 and 1% to 21% for HZVX.16,17 The reasons for these low vaccination rates are not entirely clear.18

At our institution, the Northwestern Memorial Medical Center in Chicago, vaccination rates for patients with RA measured using electronic health record (EHR) data have been similar to national data. However, EHR vaccination data may be incomplete because many patients receive vaccinations outside of their rheumatologist’s office and their primary care clinician may practice in a different health system. The completeness of EHR data on vaccinations is also limited, as many patients may get vaccinated in pharmacies and retail stores with no automated way to transfer documentation to their healthcare team.19 Therefore, at the start of a quality improvement research project to improve vaccination rates, we conducted a telephone survey to capture patients’ self-report of vaccination status and to better understand vaccination behavior and attitudes of patients with RA.

METHODS

Setting and Participants

This study was conducted at an academic rheumatology clinic from July through September 2013 and was approved by the Northwestern University Institutional Review Board. Structured query language was used to identify all eligible patients from EHR data. Patients were eligible if they had a diagnosis of RA (International Classification of Diseases, Ninth Revision, Clinical Modification codes 714.0-714.9) in the problem list, at least 1 visit to the study clinic in each of the previous 2 years, English listed as their preferred language, and were aged at least 18 years. A total of 1119 patients were identified as eligible based on EHR data. Query output included patient contact information for recruitment. A random number was generated for each patient on the list, and the list was sorted by this number to ensure that a random sample of patients would be recruited.

Our goal was to complete 100 interviews. Assuming a 50% participation rate based on previous work with a similar patient population, we initially selected the first 200 patients for recruitment. Manual chart reviews were done prior to recruitment to confirm that the patients had a diagnosis of RA. After initial chart reviews found that some patients did not have a confirmed diagnosis of RA, we selected an additional 50 patients for possible recruitment. We stopped chart reviews and recruitment of new subjects once we reached 100 completed interviews. Of the 245 manual charts we reviewed, 48 did not have an RA diagnosis, resulting in 197 patients whom we attempted to recruit.

Recruitment

A study interviewer called potential respondents up to 6 times and invited them to participate in a 10-minute structured telephone interview. We varied the time of day for the calls to maximize the chance of contact and to decrease selection bias. A message was left on identified voicemails on the second and fifth attempts asking patients to return the call if they were interested in participating in the study. Patients were offered a $10 gift card for completing the survey.

Survey Instrument

The survey included published items from the Behavioral Risk Factor Surveillance System survey20 and items developed for this project by the study team. The survey had 22 to 27 items (depending on skip patterns) and addressed the following content areas: a) self-reported receipt of INFVX, PNVX, and HZVX; b) attitudes about these vaccines, including reasons for being unvaccinated, if applicable; and c) provider recommendations about these vaccines. Additionally, if participants reported receipt of a vaccination, we asked for details on the type of setting/place they had received each vaccine. If a participant reported ever receiving an influenza vaccination, we asked if they had been vaccinated during the previous year’s flu season (2012-2013). As HZVX is contraindicated for some immunosuppressed patients, we included an item inquiring whether a provider had ever recommended against receipt of this vaccine. Participants responded to several items regarding attitudes toward vaccinations on a 4-point Likert scale. Open-ended questions were asked to elicit participants’ reasons for not being vaccinated. Interviewers coded responses to open-ended items about reasons for not being vaccinated into the following predefined categories if appropriate: a) no one ever recommended vaccine, b) did not think they needed vaccine, and c) do not like vaccinations/do not think safe. Responses that could not be coded into the above categories were reviewed by 2 authors (DB and DS) and an additional category—d) MD/pharmacist recommended against vaccination—was added. If more than 1 reason was mentioned, multiple responses were recorded. Demographic items were asked at the conclusion of the survey.

Chart Review

We reviewed EHRs of consented participants who completed the telephone interview to identify whether they were receiving an immunosuppressive drug for treatment of RA, the presence of comorbid conditions, and documented immunizations (administered in the clinic and/or historical vaccinations). We classified patients as receiving immunosuppressive medications if the current medication list included any biologic agents, corticosteroids, methotrexate, leflunomide, or azathioprine; hydroxychloroquine and sulfasalazine were not considered immunosuppressive agents. Comorbid conditions were identified from the participants’ problem list and included cancer, chronic pulmonary disease, coronary artery disease, chronic heart failure, peripheral vascular disease, severe chronic liver disease, diabetes with end organ damage, renal failure, and dementia.

Analysis

The survey response rate was calculated using guidelines from the American Association for Public Opinion Research.21 Survey responses were summarized using descriptive statistics. We calculated kappa statistics to analyze the agreement between self-reported vaccination and vaccination documentation in EHR data; for these analyses, if a respondent said he or she did not know whether they had been vaccinated, this was categorized as a “no” response.

RESULTS

Table 1

Of the 197 patients we attempted to recruit, 13 had no valid telephone number, 19 refused participation, 63 were not reached after 6 attempts, and 102 patients enrolled in the study and completed the interview (55.4% response rate). Most participants were female (85.3%) and the mean age was 57.8 years (). A total of 91.2% of participants were prescribed immunosuppressive therapy based on chart review; 85.2% of participants reported they were taking immunosuppressive therapy.

Vaccination Status

Table 2

Table 3

Most participants (90.2%) reported that they had received INFVX at least once; 79.4% reported receiving INFVX during the 2012-2013 season (). Of the 81 participants who self-reported INFVX in the last year, only 28 (34.6%) had INFVX recorded in the EHR. This low rate of INFVX documentation in the EHR is consistent with the variety of settings in which patients reported receiving INFVX (). Of the 21 patients who said they had not received INFVX in the previous year (or were unsure), only 1 (5%) had an INFVX documented in the EHR.

Approximately half of participants (53.9%) reported that they had received PNVX at least once. Only 32 of the 55 (58.2%) who reported getting PNVX had a PNVX documented in the EHR; conversely, of the 47 who said they had never received PNVX, 9 (19.1%) had a PNVX documented in the EHR. If either self-reported or EHR-documented PNVX were included, the rate of receiving 1 or more PNVX was 62.7%.

Only 8 patients (7.8%) reported receiving HZVX; of these, only 1 (12.5%) was documented in the EHR. Of the 94 who said they had not received HZVX, 8 (8.5%) had a documented HZVX in the EHR. Among patients who reported HZVX, 87.5% said they received it at a doctor’s office.

Patient Attitudes About Vaccination

When participants were asked, “How important do you think it is to get vaccinations to prevent infections?” 16.3% said it was somewhat important and 65.3% said it was very important to get vaccinations. However, 15.3% thought vaccines were not important at all. Of note, of the 18 participants who did not feel it was important to be vaccinated, all but 1 were taking immunosuppressive medications at the time of the survey, including 9 taking tumor necrosis factor inhibitors and 12 taking methotrexate. When participants were asked how much they worried about getting infections because of the medications they take for RA, 20% responded “somewhat” and 21% responded “a great deal.”

Table 4

Participants’ reasons for not being vaccinated varied by type of vaccine. The majority of participants who had not received PNVX or HZVX reported that it had never been recommended to them (). Patient dislike or distrust of vaccination was more common for INVFX than for PNVX or HZVX. Of the 10 patients who had never been vaccinated for influenza, 7 stated that this was because they did not like or trust the vaccine.

Patient Perceptions of Provider Communication Regarding Vaccines

Table 5

Three-fourths of respondents said that a physician had told them they had an increased risk of infection (); however, only 64% recalled being told the importance of vaccines by their providers. Communication about vaccinations also varied by vaccination type (Table 5). Nearly all (96.1%) participants reported that their provider had recommended INFVX, and only 2 patients reported that one of their providers had recommended against INFVX. Only 60.8% said they were told to get PNVX, and only 16.7% reported that HZVX had been recommended (Table 5). Thirteen participants (12.8%) reported they were told not to get HZVX; of these, only 1 patient was eligible for this vaccine (ie, not on biologic therapy).

DISCUSSION

Based on participants’ self-report, we found a high vaccination rate for influenza during the previous season (79.4%), a moderate rate of any previous vaccination for pneumococcus (53.9%), and a very low rate of any previous vaccination for herpes zoster (7.8%). If we assume that all self-reports are accurate and we include vaccinations recorded in the EHR that were not reported by patients, the vaccination rates were approximately 8% to 9% higher for PNVX and HZVX (Table 2).

A variety of factors likely contribute to suboptimal vaccination rates for patients with RA; lack of physician recommendation, as recalled by the patient, appears to be the most important. Only three-fourths of patients said their doctors had discussed their increased risk of infection, and only two-thirds said their doctors discussed the importance of vaccinations (Table 5). Although almost all participants reported they had been told to be vaccinated for INFVX, less than two-thirds had been advised to get PNVX and only 1 in 6 had been advised to have HZVX. These rates of recommendations correspond well to the self-reported vaccination rates; when patients who said they had not received a PNVX or HZVX were asked why, the most common response was that it was not recommended by their provider.

The reasons why physicians fail to recommend vaccinations for immunocompromised patients are not fully understood. Some failures may occur because patients with RA are often cared for by both a rheumatologist and a primary care physician. The rheumatologist may see preventive care as the responsibility of the primary care physician, but primary care physicians may not be knowledgeable about guidelines for vaccination of immunosuppressed patients or may feel this is the responsibility of the rheumatologist prescribing the immunosuppressants.

A 2009 German study found that only 65% of patients with RA were vaccinated against influenza despite 95% patient awareness of the vaccine’s availability. This was thought to be due to the fact that in Germany, the rheumatologist “delegates” vaccinations to the general practitioner.22 Similarly, a 2009 study in Ireland found that approximately half of rheumatologists did not advise influenza vaccination due to insufficient time during the visit, and they also felt vaccination was the responsibility of the general practitioner.23 However, it is not certain whether these European findings are generalizable to the United States. General practitioners in European countries tend to have a more primary role in patients’ care and serve as gatekeepers to specialty services.23 In contrast, in the United States, rheumatologists often share the responsibility of primary care for their patients’ overall health (eg, monitoring cardiovascular risk, blood glucose, malignancy screening), recognizing that many comorbid conditions have a higher prevalence with autoimmune disease. It may be appropriate for specialty societies to address shared responsibility for vaccination and to issue guidance statements to help avoid situations in which responsibility is not clear.

Another factor contributing to lack of recommendation for vaccination is the lack of adequate reminder systems. Patients with RA have complex healthcare needs, and preventive care may be a low priority for providers when they address acute management issues during busy clinic visits. Similarly, physicians have insufficient time to address preventive needs.24 Reminder systems, especially those in EHRs with linked order sets to facilitate prescribing, can help overcome these barriers. Point-of-care paper reminder forms for rheumatologists improved PNVX rates from 67.6% to 80% in patients receiving immunosuppressive medications.25 An EHR alert significantly increased use of both INFVX and PNVX, as well as documentation rates in rheumatology patients taking immunosuppressants.18 Efficacy was better if the process was nurse-driven, which speaks to the potential for team-based care to improve vaccinations.18 The value of such team-based intervention led Kaiser Permanente Southern California to adopt a “Complete Care” program beginning in 2005, which incorporated proactive team-based care, supplemental tactics, and health information technology in order to increase quality of care for patients with chronic illnesses.26

Patient lack of knowledge and negative attitudes toward vaccinations appear to be less important contributors to suboptimal vaccination rates. In our study, more than 80% of participants said that vaccinations were somewhat or very important. Among the 81 patients who reported not receiving PNVX or HZVX, only 11 said this was because of dislike or lack of trust of the vaccine. Nevertheless, in light of the high risk of infection for this patient population, additional efforts are needed to develop ways to explain the importance of vaccination to resistant patients.

A variety of factors likely contribute to the very low rate of HZVX observed here. First, current guidelines and recommendations for HZVX are difficult to interpret for many patients with RA and have not incorporated recent evidence. Current ACIP recommendations only recommend HZVX for patients 60 years or older, despite strong evidence of the need and efficacy in patients aged 50 to 59 years. The average age in our patient population was 57 years, so many patients may not have been considered candidates for HZVX by their rheumatologists or primary care physicians. ACIP advises against HZVX in patients taking biologic immunosuppressants or high-dose prednisone; however, patients on these medications could often be vaccinated earlier in the course of their disease, before starting a biologic, if age were not an issue. In our study, among 13 patients who reported receiving a recommendation against receipt of HZVX, 1 was actually eligible to receive it (ie, not taking biologic or other high-dose immunosuppressive therapy). Conversely, 8 patients were on biologics and still had HZVX recommended to them by a physician. This confusion seen in our practice may represent the overall uncertainty surrounding the HZVX recommendations.

Limitations

This study was conducted at a single academic practice, and the patients and care patterns may not be representative of the average patient with RA and rheumatology practice in the United States. Our study relied primarily on self-report, which is subject to recall bias, especially regarding the type of vaccine received, its timing, and physician recommendations for or against the inoculation. Patients may over- or underreport vaccinations at the time of query.

CONCLUSIONS

Patients with RA are at increased risk of infection due to inherent dysregulation of their immune systems and to immunosuppressive regimens. Vaccinations are, therefore, an essential part of their care. Multiple steps are necessary to improve vaccination rates, including clarification of guidelines and recommendations from national organizations, better education of patients about their risk of infection and need for vaccination, reminder systems, team-based care to identify patients needing vaccination, education of physicians and other clinicians, delineation of responsibilities for patients whose care is shared by a primary care physician and a rheumatologist, and outreach programs to facilitate timely influenza vaccination without requiring patients to come to a physician’s office.

On a broader scale, there is a risk in any healthcare system that inadequate communication may impair the ability to deliver optimal care. In any situation, such as in patients with chronic pulmonary disease, where maximizing vaccination rates is an important element of care, there are important lessons to be gleaned from this study about the role of identifying and delineating responsibilities in team-based care. The increasing use of EHRs, including patient portals for secure electronic communication, should facilitate implementation of multifaceted interventions to improve vaccination rates.

Author Affiliations: Division of Rheumatology (DSS, EMR, AM) and Division of General Internal Medicine and Geriatrics (TB, JYL, DTL, DWB), Northwestern University Feinberg School of Medicine, Chicago, IL.

Source of Funding: Pfizer award #8392087 and NIH Grant P60AR064464.

Author Disclosures: The authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.

Authorship Information: Concept and design (DSS, EMR, DTL, DWB); acquisition of data (DSS, EMR, TB, AM, DWB); analysis and interpretation of data (DSS, EMR, TB, JYL, DTL, DWB); drafting of the manuscript (DSS, TB, DWB); critical revision of the manuscript for important intellectual content (DSS, EMR, JYL, AM, DTL, DWB); statistical analysis (JYL, DWB); provision of patients or study materials (DSS); obtaining funding (EMR, DWB); administrative, technical, or logistic support (DSS, EMR, TB, AM, DWB); and supervision (DSS, EMR, DWB).

Address correspondence to: Eric M. Ruderman, MD, Division of Rheumatology, Northwestern University Feinberg School of Medicine, 240 E Huron M300, Chicago, IL 60611. E-mail: e-ruderman@northwestern.edu.

REFERENCES

1. Doran MF, Crowson CS, Pond GR, O’Fallon WM, Gabriel SE. Frequency of infection in patients with rheumatoid arthritis compared with controls: a population-based study. Arthritis Rheum. 2002;46(9):2287-2293.

2. Antonelli MA, Moreland LW, Brick JE. Herpes zoster in patients with rheumatoid arthritis treated with weekly, low-dose methotrexate. Am J Med. 1991;90(3):295-298.

3. Smitten AL, Choi HK, Hochberg MC, et al. The risk of herpes zoster in patients with rheumatoid arthritis in the United States and the United Kingdom. Arthritis Rheum. 2007;57(8):1431-1438.

4. Grohskopf LA, Olsen SJ, Sokolow LZ, et al; Centers for Disease Control and Prevention. Prevention and control of seasonal influenza with vaccines: recommendations of the Advisory Committee on Immunization Practices (ACIP)—United States, 2014-15 influenza season. MMWR Morb Mortal Wkly Rep. 2014;63(32):691-697.

5. Tomczyk S, Bennett NM, Stoecker C, et al; Centers for Disease Control and Prevention. Use of 13-valent pneumococcal conjugate vaccine and 23-valent pneumococcal polysaccharide vaccine among adults aged ≥65 years: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Morb Mortal Wkly Rep. 2014;63(37):822-825.

6. Harpaz R, Ortega-Sanchez IR, Seward JF; Advisory Committee on Immunization Practices; Centers for Disease Control and Prevention. Prevention of herpes zoster: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep. 2008;57(RR-5):1-30; quiz CE2-CE4.

7. Schmader KE, Levin MJ, Gnann JW Jr, et al. Efficacy, safety, and tolerability of herpes zoster vaccine in persons aged 50-59 years. Clin Infect Dis. 2012;54(7):922-928. doi:10.1093/cid/cir970.

8. Zostavax [package insert]. Whitehouse Station, NJ: Merck & Co, Inc; 2006.

9. Zhang J, Xie F, Delzell E, et al. Association between vaccination for herpes zoster and risk of herpes zoster infection among older patients with selected immune-mediated diseases. JAMA. 2012;308(1):43-49. doi:10.1001/jama.2012.7304.

10. Dougados M, Soubrier M, Antunez A, et al. Prevalence of comorbidities in rheumatoid arthritis and evaluation of their monitoring: results of an international, cross-sectional study (COMORA). Ann Rheum Dis. 2014;73(1):62-68. doi:10.1136/annrheumdis-2013-204223.

11. Blumentals WA, Arreglado A, Napalkov P, Toovey S. Rheumatoid arthritis and the incidence of influenza and influenza-related complications: a retrospective cohort study. BMC Musculoskelet Disord. 2012;13:158. doi:10.1186/1471-2474-13-158.

12. Haroon M, Adeeb F, Eltahir A, Harney S. The uptake of influenza and pneumococcal vaccination among immunocompromised patients attending rheumatology outpatient clinics. Joint Bone Spine. 2011;78(4):374-377. doi:10.1016/j.jbspin.2010.10.012.

13. Curtis JR, Arora T, Narongroeknawin P, et al. The delivery of evidence-based preventive care for older Americans with arthritis. Arthritis Res Ther. 2010;12(4):R144. doi:10.1186/ar3086.

14. Sowden E, Mitchell WS. An audit of influenza and pneumococcal vaccination in rheumatology outpatients. BMC Musculoskelet Disord. 2007;8:58.

15. Desai SP, Turchin A, Szent-Gyorgyi LE, et al. Routinely measuring and reporting pneumococcal vaccination among immunosuppressed rheumatology outpatients: the first step in improving quality. Rheumatology (Oxford). 2011;50(2):366-372. doi:10.1093/rheumatology/keq297.

16. Zhang J, Delzell E, Xie F, et al. The use, safety, and effectiveness of herpes zoster vaccination in individuals with inflammatory and autoimmune diseases: a longitudinal observational study. Arthritis Res Ther. 2011;13(5):R174. doi:10.1186/ar3497.

17. Hechter RC, Tartof SY, Jacobsen SJ, Smith N, Tseng HF. Trends and disparity in zoster vaccine uptake in a managed care population. Vaccine. 2013;31(41):4564-4568. doi:10.1016/j.vaccine.2013.07.053.

18. Ledwich LJ, Harrington TM, Ayoub WT, Sartorius JA, Newman ED. Improved influenza and pneumococcal vaccination in rheumatology patients taking immunosuppressants using an electronic health record best practice alert. Arthritis Rheum. 2009;61(11):1505-1510. doi:10.1002/art.24873.

19. Sy LS, Liu IL, Solano Z, et al. Accuracy of influenza vaccination status in a computer-based immunization tracking system of a managed care organization. Vaccine. 2010;28(32):5254-5259. doi:10.1016/j.vaccine.2010.05.061.

20. Behavioral Risk Factor Surveillance System Survey Questionnaire. CDC website. http://www.cdc.gov/brfss/questionnaires/pdf-ques/2012_brfss.pdf. Published January 31, 2012. Accessed November 12, 2014.

21. The American Association for Public Opinion Research. Standard definitions: final dispositions of case codes ad outcome rates for surveys [revised 2011]. ESOMAR website. https://www.esomar.org/uploads/public/knowledge-and-standards/codes-and-guidelines/ESOMAR_Standard-Definitions-Final-Dispositions-of-Case-Codes-and-Outcome-Rates-for-Surveys.pdf. Accessed November 12, 2014.

22. Feuchtenberger M, Kleinert S, Schwab S, et al. Vaccination survey in patients with rheumatoid arthritis: a cross-sectional study. Rheumatol Int. 2012;32(6):1533-1539. doi:10.1007/s00296-011-1808-z.

23. McCarthy EM, Azeez MA, Fitzpatrick FM, Donnelly S. Knowledge, attitudes, and clinical practice of rheumatologists in vaccination of the at-risk rheumatology patient population. J Clin Rheumatol. 2012;18(5):237-241. doi:10.1097/RHU.0b013e3182611547.

24. Yarnall KS, Pollak KI, Østbye T, Krause KM, Michener JL. Primary care: is there enough time for prevention? Am J Public Health. 2003;93(4):635-641.

25. Desai SP, Lu B, Szent-Gyorgyi LE, et al. Increasing pneumococcal vaccination for immunosuppressed patients: a cluster quality improvement trial. Arthritis Rheum. 2013;65(1):39-47. doi:10.1002/art.37716.

26. Kanter MH, Lindsay G, Bellows J, Chase A. Complete care at Kaiser Permanente: transforming chronic and preventive care. Jt Comm J Qual Patient Saf. 2013;39(11):484-494.