Cervical cancer screening underuse and overuse occur commonly in clinical practice and identifiable patient and physician factors can be targeted for quality improvement.
Despite recommendations for triennial cervical cancer screening for low-risk women 30 years and older, annual screening remains common. We studied how often women receiving care from an academically affiliated medical group were screened, and patient and provider factors associated with overuse and underuse. We also explored the impact of changing measurement intervals on computed screening frequency.
The study included women 30 years and older continuously enrolled over a 3-year period and excluded women with history of abnormal screening and conditions of high risk for cervical cancer.
Administrative and laboratory data were merged to link Papanicolaou (pap) test results with patient and ordering provider characteristics. We used logistic regression to analyze multivariate models for overuse and underuse, and modified measurement intervals to test sensitivity to early and late pap smears.
The 8018 women had a mean age of 48years and 95% had an ambulatory physician visit during the observation period. Thirty-four percent of women received guideline-based screening, 45% had overuse, and 21% had underuse. Factorsindependently associated with overuse included younger age, more medical visits, contraceptive management visits, and gynecology provider specialty. Underuse was associated with older age, fewer medical visits, and increased comorbidity.Overuse was 47% if unsatisfactory paps were not considered and was reduced to 35% if the observation interval was reduced from 36 to 30 months.
Overuse and underuse of cervical cancer screening are common and clinician and patient factors are identifiable to target quality improvement interventions. Modifying the measurement interval may improve the measure.
Am J Manag Care. 2013;19(6):482-489
For a decade, US medical professional organizations1,2 and the US Preventive Services Task Force (USPSTF)3 have suggested that low-risk women (history of multiple normal Papanicolaou[pap] tests, age over 30 years) receive cervical cancer screening every 3 years as part of routine preventive services. Prior to these guidelines, observational and case control studies supported similar clinical outcomes between 1- and 3-year intervals.4-11 However, surveys showed that most (60-70%) gynecologists and primary care providers continuedto perform annual screening, and many were unaware of the new guidelines.12,13 Recently, the USPSTF solidified its recommendations for the 3-year interval14-17 and they and the American College of Obstetricians and Gynecologists suggest a 5-year interval with negative HPV testing.18,19
A 2010 study using the National Ambulatory Medical Care Survey projected that triennial screening would reduce testing by 6.3 million pap tests per year and reduce costs by $403.8 million.17 An earlier study projected that an additional 69,665 pap smears and 3861 colposcopies would need to be performed in women 30 to 44 years of age to avert 1 case of cervical cancer by screening every year instead of every 3 years. For women 45 to 59 years old, 209,324 pap tests and 11,502 colposcopies would need to be performed.4 Using National Health Interview Survey data, projected compliance with triennial screening would decrease the annual number of pap smears from 75 million to 34 million.20
Since 2009, a pay for performance measure has been applied to managed care plans in California to encourage triennial rather than more frequent screening, but there has been little exploration of cervical cancer screening rates in populations affected by this measure. Furthermore, preventing overuse might encourage underuse, so both should be simultaneously evaluated. To encourage targeted use of screening, understanding physician and patient factors associated with overuse and underuse is needed. We evaluated usage of cervical cancer screening in 1 medical group’s patients with the goal of identifying factors amenable to intervention. In addition, we varied the time period of the 3-year measure and accounted for clinically insufficient pap tests to evaluate the proportion of patients that were close to receiving appropriate screening to test the clinical applicability of the measure, which is important in order to promulgate interventions with clinicians.
We evaluated cervical cancer screening provided to female patients in an academic medical center—affiliated group (commercial health maintenance organization[HMO] and Point of Service enrollees). We linked laboratory data for pap smear pathology with patient encounter data and then linked this with patient general claims data and administrative records for physicians in order to link testing patterns to patient and physician characteristics. After categorizing cervical cancer screening patterns, multivariate models were constructed to identify factors independently associated with screening overuse and underuse.
Data Sources and Participants
Eligible female patients were women 30 years and older continuously enrolled with the practice from January 1, 2007, to December 31, 2009. The study population was refined using the following exclusion criteria: (1) ICD-9 codes for cervical or endometrial cancer or DES exposure, any grade of cervical dysplasia (CIN) or abnormal cervical cytology (ASCUS, ASC-H, LSIL, HSIL, AGC) or HPV infection, and high-risk conditions for cervical cancer (HIV infection, leukemia, neutropenia, history of organ transplantation) and (2) CPT codes for procedures related to abnormal cervical cytology (colposcopy, LEEP, or cryotherapy). These criteria were applied during the study period and the preceding 3 years.
Pathology results were available for every pap smear performed on a patient, which also identified the ordering provider. The text of the cytology result was analyzed to identify and eliminate unsatisfactory pap smears. Characteristics of ordering providers were collected from an online physician database maintained by the health system. The UCLA Institutional Review Board approved the study.
Main Dependent Variable
Each patient in the study population was assigned a cervical cancer screening category, based on the total number of satisfactory pap smears performed during the 36-month observation period. Assignment of category accounted for age and whether a woman had a hysterectomy. Pap smears deemed inadequate for histologic evaluation were excluded from analysis. The 3 cervical cancer screening categories were: (1) Underuse—0 screening episodes for a woman with a uterus (measure not applicable for age greater than 67 years), (2) Guideline-consistent use—exactly 1 screening episode over the 3-year observation period for a woman with a uterus (0 or 1 acceptable for women over 67 years) or 0 screening episodes for a woman without a uterus, and (3) Overuse—2 or more screening episodes for a women with a uterus or 1 or more screening episodes for a women without a uterus.
Patient-level variables: Using billing data, we collected patient age (at study entry), race/ethnicity (Asian/Pacific Islander, Hispanic, non-Hispanic black, non-Hispanic white, and non-Hispanic other), and preferred language (English, Spanish, or other). Age was subdivided into 3 categories (30-50 years, 51-70 years, 71 years and older). In cases where ethnicity information was missing (5.9%), non-Hispanic was assigned, as this was the modal condition (82%). Using billing and encounter data, we also collected total outpatient visits over the observation period (categorized as 1-10 and greater than 10), presence of comorbidities (diabetes, coronary artery disease, hypertension, cerebrovascular disease, and depression), average total Medicare Risk Adjustment Factor (RAF) score (which reflects patient complexity and illness severity), any visits for contraceptive management over the observation period, and for women over 40 years, number of mammograms received during the 3-year interval.
Provider-level variables: Utilizing the laboratory data link to physician, we derived a variable describing specialty mix of ordering providers for all pap smears performed on each patient (primary care only, gynecology only, primary care and gynecology, neither primary care nor gynecology). We collected information on the gender of provider, years since medical school graduation, and clinical specialty. We also included a variable indicating whether a provider attended a medical group—sponsored CME meeting about cervical cancer screening guidelines.
We described patient characteristics and computed for each patient her cervical cancer screening category. We compared patient characteristics across the 3 screening categories using Pearson’s χ2 and simple logistic regression, as appropriate. We also examined distribution of screening category by pap smear provider specialty mix. All analyses were performed using
SAS version 9.2 (SAS Institute, Cary, North Carolina).
We separately evaluated predictors of overuse compared with guideline use and underuse compared with guideline use, using hierarchical logistic regression. The underuse model contained only patient characteristics because no pap provider existed. These models included the following patient characteristics (described above): age, race/ethnicity, language (English and non-English), greater than 10 outpatient visits over the study period (versus 10 or less), RAF score, comorbid conditions, and whether the patient had a visit for contraception. The overuse model included each of these variables plus provider gender, specialty, attendance at a cervical cancer screening CME lecture, and greater than 8 years in practice. For the overuse model, we carried out a sub-analysis for women 40 years and older that added mammogram count. This analysis aimed to understand whether adherence to one guideline was associated with adherence to another or whether screening was performed in a regular, non-targeted fashion.
We performed an analysis to understand how sensitive the triennial measure is to pap smears performed at the extremes of or just outside of the measurement period. An additional 6 months of data were collected from January 1, 2010, to June 30, 2010. Alternate observation periods of 30 months (January 2007 to June 2009) and 42 months (January 2007 to June 2010) were used to re-compute the cervical cancer screening category for each patient. In order to evaluate the effect of a pap smear being performed late and just outside the 3-year interval, we compared underuse rates in the 42- and 36-month study intervals. In order to evaluate the effect of a pap smear being performed early and just inside the 3-year interval, we compared overuse rates in the 30- and 36-month study intervals. In order to evaluate the secular trend, we compared overuse and underuse in the original 36-month window (January 1, 2007, to December 31, 2009) with the 36-month window of July 1, 2007, to June 30, 2010. The multivariate analysis was repeated to examine the effect of changing observation period on the multivariate results.
There were 10,111 women continuously enrolled with the medical group from January 1, 2007, to December 31, 2009. After exclusions were applied, 8018 women remained in the sample. Laboratory data from the study period showed that 10,998 pap smears were performed on this group of 8018 women. A total of 450 unsatisfactory test results were removed from the analysis. The final laboratory sample had 10,548 unique pap smear results. These tests were performed by 166 providers (see ).
Fifty-four percent of the 8018 women were 50 years or younger (mean 48 years, standard deviation [SD] 10.5, range 30-91 years). Over half were white non-Hispanic ethnicity and 16.5% were Asian/Pacific Islander. Nearly all women were English-speaking. Ninety-five percent had at least 1 outpatient clinic visit, with an average of 16 visits over the 3-year study period (SD 15, range 1-186 visits). Most visits were to primary care providers.
The most common comorbidity was hypertension (28.2% of all women), followed by diabetes (9.0%) and depression (6.1%). Nine percent of women had at least 1 clinic visit coded for contraceptive management. Eighty-five percent of women 40 years and older had at least 1 mammogram during the study period.
Of the 8018 women, 6030 (75%) had at least 1 satisfactory pap smear during the study period. Using the criteria described above, most women were classified into the overuse category of cervical cancer screening (45.3%), with 21.2% categorized as underuse and 33.5% as receiving guideline-based screening.
If unsatisfactory pap smears were not excluded, 47.0% of women would have been classified as having overuse. In the cohort of women enrolled in an HMO plan (n = 5187), the rate of guideline-based cervical cancer screening was similar (32.1%), while apparent underuse was lower (18.1%) and apparent overuse was higher (49.8%).
Of the 166 providers who performed the pap smears, half (49%) were female. Providers had been in practice a mean of 21.8 years (SD 11.7, range 5-55 years). Most of the providers (43.4%) specialized in internal medicine, followed by gynecology (29.5%), family medicine (25.3%), and other (1.8%).Ten percent of providers attended a medical-group CME session on cervical cancer screening.
Factors Associated With Overuse and Underuse. In bivariate analyses, there were statistically significant differences between screening category groups for the variables of patient age; race/ethnicity; number of outpatient visits over the observation period; number of mammograms (in women 40 years and over); presence of hypertension, or diabetes; and whether a patient was seen for contraceptive management (P <.001). The differences between categories was less robust for coronary artery disease (P = .002) or depression comorbidity (P = .008). Preferred language and presence of cerebrovascular disease were not different between groups.
Most pap smears (65.5%) were performed by primary care physicians (internal medicine or family medicine). A total of 59% of women who received their testing from only primary care providers were in the overuse category, whereas 63% of women who received testing from only gynecology providers were in the overuse category (by definition all women who received testing by oth primary care and gynecology were considered overuse). Among women 40 years or older with zero mammograms, 63% were in the underuse and 11% in the overuse category. Among women with 1 or more mammograms, there was 17% underuse and 46% overuse.
The hierarchical logistic regression model showed that patient characteristics significantly associated with overuse were increased number of outpatient visits during the study period (adjusted odds ratio [OR] 1.84, 95% confidence interval [CI] 1.62-2.09) and seeing a physician for contraceptive management (OR 1.80, 95% CI 1.46-2.21). Provider specialty in gynecology was associated with overuse (OR 1.81, 95%CI 1.22-2.69). Factors significantly associated with less overuse were older patient age (51-70 years compared with 30-50 years) and having diabetes (Table 2). Analytic sample size was reduced to 5826 patients and 151 providers due to missing data on covariates. The sub-analysis of women 40 years and older (N = 4220 patients, 142 providers) showed that each additional mammogram received was positively associated with overuse (OR 2.13, 95% CI 1.63-2.78). Other significant covariates in this sub-sample were the same as for the full sample.
The multivariate model of underuse revealed that higher RAF score (OR 2.17, 95% CI 1.52-3.10) was associated with greater nderuse (N = 3946 patients). Factors associated with less underuse were younger age (OR 0.80, 95% CI 0.69-0.93), increased outpatient visits (0.58, 95% CI 0.50-0.68), seeing a physician for contraceptive management (OR 0.39, 95% CI 0.26-0.57), and Hispanic and Asian race/ethnicity (see ).
Changing the Observation Period. Moving the original 36-month observation period (model 1 in Table 4) forward 6 months (model 2) to test for secular trend showed a decrease in overuse from 45.3% to 41.9%, an absolute decrease of 3.4%. The sensitivity analyses aimed at understanding whether small changes in timing affected underuse and overuse categorizations showed minimal effect on the former, but a large effect on the latter. Extending the acceptable duration of time in which to receive a pap smear from 36 to 42 months (model 3) reduced underuse by only 1.8%. However, lower rates of overuse were identified when the acceptable window in which to receive a pap was decreased to 30 months (models 4 and 5). Compared with the original 36-month time frame (January 2007-December 2009), the shortened study period reduced overuse rates by 8.1%, and an absolute reduction of 12.9% was seen if a later 30-month window (January 2008- June 2010) was examined. We repeated the multivariate models of overuse and underuse after changing the observation periods, resulting in no changes to the statistical significance of the associations of predictors with overuse/underuse.
It takes time for medical care patterns to change in response to changes in guidelines, even when the guideline change means performing an uncomfortable medical procedure less often. This may be particularly true when insurance plans still reimburse for more frequent screening. The data presented here show that 5 to 8 years after a shift in guidelines, about 40% of women were still screened more often than recommended and about one-fifth of women were under-screened. The multivariate analysis demonstrates patient characteristics that can guide interventions to target women for appropriate cervical cancer screening. Younger women, those receiving contraception, and those who see gynecologists can be targeted for education about overuse. Older women and those with greater level of illness need to be targeted for interventions aimed at underuse of pap smears. Interventions appear to be particularly needed for gynecologists, at least in the group studied, and it appears that coordination is needed when a patient sees both a primary care physician and a gynecologist.
In the last several years, multiple studies have explored cervical cancer screening utilization from the patient or provider perspective, but the analysis presented here may be unique in linking patient and provider factors to explore both overuse and underuse. We found a decreased rate of overuse compared with the 50% to 70% found in other studies,21-24 which may be explained by study design and/or secular trend. We accounted for inadequate pap smears, which yields a lower—more clinically accurate—characterization. Similar to our findings, other studies found lower overuse among older women and women in poorer health21 and when provider specialty was family or internal medicine.23 The association between cervical cancer and breast cancer screening found here confirms similar findings in a US and Canadian study.25
Measures are used for a variety of reasons, but a key purpose is to feed back information to providers to improve care. One obstacle to feedback is that measures are often imperfect and that clinicians do not believe the results of measures or that they apply to them.26 The analysis performed here shows that accounting for unsatisfactory pap smears and narrowing the 3-year screening interval by 6 months reduces observed overuse from 47% to 37% (with improvement to 32% during the later 30-month interval). These data suggest that if an intervention were targeted at all patients with overuse, it would reach 10% to 15% of women who may not merit intervention. Mistargeted interventions reduce the effectiveness of efforts to improve care, emphasizing the importance of constructing accurate measures that reflect the clinical realities of practice.
Our conclusions are limited to associations between patient and provider characteristics and screening utilization, and cannot prove causality. A small proportion of the sample was enrolled in a Point of Service plan and we cannot account for cervical cancer screening received by women outside the studied practice. Additionally, these data are from a single medical group and may not be generalizable to other populations. Furthermore, the accuracy of clinical information (comorbidities, use of non-pap screening procedures) is limited in administrative data. Finally, we were conservative in our analysis by labeling either 0 or 1 pap smears in women aged over 67 years guideline-based, although current guidelines have an upper age limit of 65 years to stop screening entirely.
Variation in clinical practice has led to interest in defining appropriate use of common clinical procedures.27,28 However, there remains tension between patient-centered and evidence-based medicine.29-31 Guidelines aimed at changing clinical behavior must account for clinical and structural variability in care, and when feasible, both underuse and overuse should be addressed. We studied cervical cancer screening here; however, the general principle applies to many diagnostic and treatment modalities.
We demonstrate that analyses using available data can be performed at the medical group level in order to identify areas for improvement and to target interventions. This analysis also suggests improvements in measurement for cervical cancer screening that can make the measure more clinically meaningful. Underuse should be evaluated simultaneously with overuse of cervical cancer screening.Author Affiliations: From Department of Family Medicine, David Geffen School of Medicine at UCLA (CMA, MAR), Los Angeles, CA; Department of General Internal Medicine and Health Services Research, David Geffen School of Medicine at UCLA (NSW, NS, JP, SS), Los Angeles, CA.
Funding Source: This work was supported by National Research Service Award Training Grant T32 PE19001.
Author Disclosures: The authors (CMA, MAR, SS, JP, NS, NSW) report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (CMA, NSW); acquisition of data (CMA, SS); analysis and interpretation of data (CMA, MAR, SS, JP, NS, NSW); drafting of the manuscript (CMA, NSW); critical revision of the manuscript for important intellectual content (CMA, MAR, SS, JP, NS,NSW); statistical analysis (CMA, NS); provision of study materials or patients (SS); obtaining funding (NSW); administrative, technical, or logistic support (SS, NSW); and supervision (MAR, NSW).
Address correspondence to: Cristina M. Almeida, MD, MPH, 605 W Santa Ana Blvd, Bldg 28, Ste 639, Santa Ana, CA 92701. E-mail: cristina .email@example.com. ACOG Committee on Practice Bulletins. ACOG Practice Bulletin: clinical management guidelines for obstetrician-gynecologists. Number 45, August 2003. Cervical cytology screening. Obstet Gynecol. 2003;102(2):417-427.
2. Saslow D, Runowicz CD, Solomon D, et al. American Cancer Society guideline for the early detection of cervical neoplasia and cancer. CA Cancer J Clin. 2002;52(6):342-362.
3. US Preventive Services Task Force. Screening for cervical cancer: recommendations and rationale. AHRQ Publication No. 03-515A. Rockville, MD: Agency for Healthcare Research and Quality; 2003.
4. Sawaya GF, McConnell KJ, Kulasingam SL, et al. Risk of cervical cancer associated with extending the interval between cervical-cancer screenings. N Engl J Med. 2003;349(16):1501-1509.
5. Sasieni P, Adams J, Cuzick J. Benefit of cervical screening at different ages: evidence from the UK audit of screening histories. Br J Cancer. 2003;89(1):88-93.
6. IARC Working Group on evaluation of cervical cancer screening programs. Screening for squamous cervical cancer: duration of low risk after negative results of cervical cytology and its implication for screening policies. Br Med J (Clin Res Ed). 1986;293(6548):659-664.
7. Eddy DM. The frequency of cervical cancer screening: comparison of a mathematical model with empirical data. Cancer. 1987;60(5): 1117-1122.
8. Sherman ME, Lorinez AT, Scott DR, et al. Baseline cytology, human papillomavirus testing, and risk for cervical neoplasia: a 10-year cohort analysis. J Natl Cancer Inst. 2003;95(1):46-52.
9. Van Oortmarssen GJ, Habbema JDF, van Ballegooijen M. Predicting mortality from cervical cancer after negative smear test results. BMJ. 1992;305(6851):449-451.
10. Screening for Cervical Cancer: Systematic Evidence Review Number 25. January 2003. US Preventive Services Task Force. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/clinic/uspstf/uspscerv.htm. Accessed July 24, 2009.
11. Sawaya GF, Kerlikowske K, Lee NC, Gildengorin G, Washington AE. Frequency of cervical smear abnormalities within 3 years of normal cytology. Obstet Gynecol. 2000;96(2):219-223.
12. Cooper CP, Saraiya M, McLean TA, et al. Report from the CDC. Pap test intervals used by physicians serving low-income women through the National Breast and Cervical Cancer Early Detection Program. J Womens Health (Larchmt). 2005;4(8):670-678.
13. Saint M, Gildengorin G, Sawaya GF. Current cervical neoplasia screening practices of obstetrician/gynecologists in the US. Am J Obstet Gynecol. 2005;192(2):414-421.
14. Anon. ACOG committee opinion No. 431: routine pelvic examination and cervical cytology screening. Obstet Gynecol. 2009;113(5):1190-1193.
15. Moyer VA on behalf of the US Preventive Services Task Force. Screening for cervical cancer: US Preventive Services Task Force recommendation statement. Ann Intern Med. 2012;156(12):880-891. W312.
16. Saslow D, Solomon D, Lawson HW, et al. American Cancer Society, American Society for Colposcopy and Cervical Pathology, and American Society for Clinical Pathology screening guidelines for the prevention and early detection of cervical cancer. Am J Clin Pathol. 2012;137(4):516-542.
17. Saraiya M, McCaig LF, Ekwueme DU. Ambulatory care visits for Pap tests, abnormal Pap test results, and cervical cancer procedures in the United States. Am J Manag Care. 2010;16(6):e137-e144.
18. US Preventive Services Task Force. Screening for Cervical Cancer, Topic Page. http://www.uspreventiveservicestaskforce.org /uspstf/uspscerv.htm. Published April 2012. Accessed August 11, 2012.
19. American Congress of Obstetricians and Gynecologists. New Cervical Cancer Screening Recommendations from the U.S. reventive ServicesTask Force and the American Cancer Society/American Society for Colposcopy and Cervical Pathology/American Society for Clinical Pathology. www.acog.org/About_ACOG/Announcements/New_Cervical_Cancer_Screening_Recommendations. Accessed August 11, 2012.
20. Solomon D, Breen N, McNeel T. Cervical cancer screening rates in the United States and the potential impact of implementation of screening guidelines. CA Cancer J Clin. 2007;57(2):105-111.
21. Meissner HI, Tiro JA, Haggstrom D, Lu-Yao G, Breen N. Does patient health and hysterectomy status influence cervical cancer screeningin older women? J Gen Intern Med. 2008;23(11):1822-1828.
22. Meissner HI, Tiro JA, Yabroff KR, Haggstrom DA, Coughlin SS. Too much of a good thing? physician practices and patient illingness for less frequent pap test screening intervals. Med Care. 2010;48(3): 249-259.
23. Yabroff KR, Saraiya M, Meissner HI, et al. Specialty differences in primary care physician reports of papanicolaou test creening practices:a national survey, 2006 to 2007. Ann Intern Med. 2009;151(9): 602-611.
24. Saraiya M, Berkowitz Z, Yabroff KR, Wideroff L, Kobrin S, Benard V. Cervical cancer screening with both human apillomavirus and Papanicolaou testing vs Papanicolaou testing alone: what screening intervals are physicians recommending? Arch Intern Med. 2010;170(11):977-985.
25. Blackwell DL, Martinez ME, Gentleman JF. Women’s compliance with public health guidelines for mammograms and pap tests inCanada and the United States: an analysis of data from the Joint Canada/United States Survey of Health. Womens Health Issues. 2008; 18(2):85-99.
26. Cabana MD, Rand CS, Powe NR, et al. Why don’t physicians follow clinical practice guidelines? a framework for improvement. JAMA. 1999;282(15):1458-1465.
27. Qaseem A, Alguire P, Dallas P, et al. Appropriate use of screeningand diagnostic tests to foster high-value, cost-conscious care. AnnIntern Med. 2012;156(2):147-149.
28. Anon. The “top 5” lists in primary care: meeting the responsibility of professionalism. Arch Intern Med. 2011;171(15):1385-1390.
29. Armstrong D. Clinical autonomy, individual and collective: the problem of changing doctors’ behaviour. Soc Sci Med. 2002;55(10):1771-1777.
30. Kravitz RL, Bell RA, Azari R, Kelly-Reif S, Krupat E, Thom DH. Direct observation of requests for clinical services in office practice: what do patients want and do they get it? Arch Intern Med. 2003;163(14): 1673-1681.
31. Haggerty J, Tudiver F, Brown JB, Herbert C, Ciampi A, Guibert R. Patients’ anxiety and expectations: how they influence family physicians’ decisions to order cancer screening tests. Can Fam Physician. 2005;51:1658-1659.