Impact of a Program Encouraging the Use of Generic Antipsychotics

, ,
The American Journal of Managed Care, August 2012, Volume 18, Issue 8

Academic detailing coupled with a provider survey did not decrease the rate of new prescriptions for costly, on-patent second-generation antipsychotics in a VA hospital.

Objective:

Recent research suggests that secondgeneration antipsychotics (SGAs) may be used more often than clinically warranted. An interven-tion consisting of academic detailing and a prescriber survey was employed to encourage the reduction of newly prescribed on-patent SGAs.

Design:

Quasi-experimental quality improvement trial.

Methods:

Academic detailing consisted of educational lectures and a pocket guide on the latest effectiveness, safety, and cost data for SGAs and first-generation antipsychotics. Detailing was coupled with a required 20-item survey of provider decision making completed prior to prescriptions for on-patent SGAs at a Veterans Health Administration medical center between October 2007 and May 2009. The survey identified the medication, treated diagnosis, comorbid psychiatric and medical diagnoses, reasons for the medication, prior medications, and provider professional status. The outcome was the number of new SGA prescriptions per month.

Results:

The sample included 2176 surveys. The Spearman correlation between the number of prescriptions and the intervention month (range = 1-18) was 0.25 (P = .31), indicating no reduction. The most common medication prescribed was quetiapine (55.8%). The distributions of diagnoses were fairly even among schizophrenia, bipolar disorder, other affective disorders, and posttraumatic stress disorder (17.0, 28.2, 25.8, and 20.4%, respectively). The 3 most common reasons for prescribing an SGA were to improve efficacy (49.8%), reduce side effects (29.1%), and increase sleep or sedation (34.5%).

Conclusions:

Academic detailing coupled with a provider survey did not decrease the rate of new prescriptions for on-patent SGAs. Reasons for prescribing SGAs were not consistent with recent research findings regarding efficacy and side effects.

(Am J Manag Care. 2012;18(8):e307-e314)Second-generation antipsychotics (SGAs) may be used more often than clinically necessary. A nonrestrictive intervention of academic detailing coupled with a provider survey did not decrease the rate of new prescriptions for SGAs. Investigation of provider decision making found:

  • A high rate of off-label SGA use in posttraumatic stress disorder where there is little evidence of efficacy, as well as for sleep problems where there are many less costly and better tolerated options.

  • SGAs were commonly prescribed in patients with comorbid metabolic and cardiac disease where their use may exacerbate these conditions.

Second-generation antipsychotics (SGAs) have become the most prescribed psychopharmacologic treatment for schizophrenia.1 However, a growing body of evidence from several large, government- funded trials, such as VA Cooperative Study 451, the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE), and the Cost Utility of The Latest Antipsychotics in Severe Schizophrenia (CUtLASS), have failed to find an advantage for SGAs, other than clozapine, over first-generation antipsychotics (FGAs) on measures of effectiveness, side effects, or cost-effectiveness.2-5 SGAs had been thought to represent an advantage due to their decreased risk of neurologic side effects6,7 but these advantages have not been confirmed in recent comparative large-scale trials which more closely approximate real-world practice.8,9 In addition, several SGAs are now known to be associated with significant weight gain, impairment of glucose metabolism, and lipid abnormalities.10,11

SGA use has also increased beyond US Food and Drug Administration (FDA)-approved applications, which include, among others, schizophrenia, acute and maintenance treatment of bipolar disorder, and as an adjunct to other depression treatments. Common off-label uses includethe treatment of posttraumatic stress disorder (PTSD), anxiety disorders, and insomnia.12-14 In 2010, SGAs accounted for over $18 billion in sales15 with 75% of US expenditures paid through Medicaid.16 These high costs stem from the fact that most SGAs are still “on patent” and cost up to $10 a day in the United States, 10 to 100 times the cost of FGAs and off-patent SGAs.17 Much of the overwhelming prescriber preference for SGAs is thought to be linked to early impressions of efficacy created through industry-sponsored trials and marketing.18-20

The expense associated with SGAs has led payers to consider diverse strategies for modifying their practice, ranging from more limited measures such as formulary restrictions and prior authorization to less limited measures such as educational outreach.21 Educational strategies, termed academic detailing, link information dissemination activities with 1-on-1 practice reviews and provide alternative information regarding evidencebased prescribing practices to that presented by pharmaceutical manufacturers.22 These interventions, which are sometimes combined with other management strategies,23 provide more balanced evidencebased information to physicians, pharmacists, and patients in order to promote more cost-effective prescribing. Several meta-analyses of academic detailing have

shown moderate effects.24

This study presents data on the impact of an intervention combining both academic detailing and completion of a required prescriber survey on SGA prescribing at a single Veterans Health Administration (VHA) hospital. The administrative assumptions were that academic detailing in combination with a survey prior to completing the prescription would stimulate a more thorough reflection on prescribing decisions and would create a mild disincentive for prescribing SGAs. In addition, survey results would provide insight into the reasoning behind provider decisions regarding SGA prescriptions.

METHODSIntervention

The study began as a quality improvement project which evolved into a quasi-experimental study to test the effect of a novel intervention on the rate of SGA prescriptions over a 20-month period, from October 2007 until May 2009. The intervention consisted of 2 components: an academic detailing effort and an electronic survey completed at the time of every new prescription for an on-patent SGA.

Academic detailing consisted of 4 formal detailing sessions with the entire mental health service delivery section of the medical center, psychiatry residents, nurse practitioners, and the division of the outpatient clinic responsible for treating patients with schizophrenia, respectively. Each session included a 45-minute didactic presentation followed by a discussion. The sessions highlighted background on the high level of expenditures on SGAs nationally and in the VHA, as well as a number of specific trials including the VHA Cooperative study, CUtLASS, CATIE, and others.2-5 The public policy issues regarding the cost-effectiveness of SGAs were also discussed.25 Finally, various strategies for cost containment were reviewed in addition to the objectives, hypotheses, and procedures of the current cost-containment study. Sessions were given by professors of psychiatry from the Yale University School of Medicine who had joint appointments at the VHA.

The required survey was completed at the time any on-patent SGA on formulary (olanzapine, long-acting injectable [LAI] risperidone, aripiprazole, ziprasidone, or quetiapine) was ordered as a new, nonrefill prescription for an outpatient who had not previously been receiving the SGA prescribed. This study was approved by the institutional review boards of the Yale University School of Medicine and the VA Connecticut Healthcare System.

Setting and Participants

The intervention was implemented throughout the VA Connecticut Healthcare System, which provides out-patient and inpatient treatment to approximately 10,000 veterans with mental illness annually,26 and targeted at prescribers of SGAs who are limited at this institution as a utilization management strategy to psychiatry residents, fellows, attendings, advance practice registered nurses, and physician assistants. Primary care providers and other specialists did not have privileges for SGA prescribing but could place prescriptions for SGAs after pharmacy review.

Survey

The survey was electronically delivered as part of the medication ordering system at the time of any new on-patent SGA prescription (risperidone was the only generic SGA at the time of the intervention). Survey completion was required before an SGA prescription could be electronically sent to the pharmacy. Thus, the survey completion rate was presumed to be 100%.

The survey consisted of 20 questions which documented the proposed medication, the primary psychiatric diagnosis under treatment, important comorbid psychiatric and medical diagnoses, the clinician’s reasons for using the selected medication, prior medications attempted, and the professional background of the provider. A list of forced choice selections and write-in answers was given for each question.

Analysis

Exclusion Criteria. Surveys in which information on the SGA prescribed was missing were excluded. Some surveys documented oral risperidone use even though it was off patent at the time and these were excluded.

Outcome. The outcome for this study was the number of new SGA prescriptions measured monthly as the number of surveys completed between November 1, 2007, and April 30, 2009. Results from the first and last month of the survey period were truncated, as the project started

and finished mid month.

Statistical Analysis. Time trends in the prescription of atypical antipsychotics were evaluated by calculating the Spearman correlation between the study month (range 1-18) and total number of prescriptions per month. Analysis of differences in the number of SGA prescriptions over time for selected subgroups derived from survey questions was calculated using χ2. Data management and statistics were performed using SAS, version 9.2 (SAS Institute, Cary, North Carolina).

RESULTSSample Characteristics

The original data set contained 2648 observations of which 30 were excluded for missing data on the medication prescribed, while 442 were excluded for documenting oral risperidone prescriptions. The final sample consisted of 2176 surveys.

Table 1

The average age of individuals receiving an SGA prescription was 54.5 years (standard deviation [SD] = 14.9) while the mean body mass index (BMI) was 29.2. (SD = 6.0) (). The most common medication prescribed was quetiapine (55.8% of prescriptions) while olanzapine and aripiprazole were less common (18.8% and 17.9%, respectively) and ziprasidone and LAI risperidone were least common (5.9% and 1.6%, respectively). Of the new prescriptions, 54.8% represented a new prescription of an SGA in the absence of prior antipsychotic therapy, 25.0% represented a change in antipsychotic to an SGA, and for 20.2% the prescription represented an addition to an FGA.

The distribution of diagnoses for which a prescription was made was fairly even among schizophrenia, bipolar disorder, other affective disorders, and PTSD (17.0%, 28.2%, 25.8%, and 20.4%, respectively). The most common reasons given for prescribing a particular SGA were improved efficacy (48.9%), improved sleep or sedation (34.5%), minimizing side effects as a group (29.1%), and patient preference (27.9%). Prescriptions were made relatively evenly among psychiatric provider types with 28.0% coming from advance practice nurses or physician assistants, 28.3% from psychiatric residents or fellows, and 30.2% from attending psychiatrists.

Intervention Outcome

Figure

The number of new prescriptions did not decline or change significantly over the course of the study. The number of prescriptions averaged over 3 month periods are presented in the . On average, there were 110 new prescriptions over the first 3 months of the study while there was an average of 124 over the last 3 months (a 12.7% increase). The Spearman correlation coefficient between the number of new prescriptions per month and the month of study was 0.254 (P = .31), failing to indicate any decline or other significant relationship between the number of new prescriptions and month of study.

Subgroup Analysis of Prescriptions Over Time

Table 2

describes the results of a subgroup analysis of the change in the number of new SGA prescriptions over the course of the study among selected subgroups. Using a Bonferoni correction for 34 independent variables (P value for statistical significance of <.0014), only hyperlipidemia displayed a significant difference by month and graphical inspection did not show a consistent linear trend over time.

DISCUSSION

The prescription of antipsychotics is a complex clinical decision potentially influenced by the clinical presentation of each patient, provider beliefs and experiences of relative effectiveness, tolerability, cost, expressed patient preferences, and provider exposure to marketing. Administrators and payers must balance a desire to contain costs, maximize effectiveness, and minimize risks while respecting patient preferences and supporting provider autonomy in the selection of treatments. We report on an intervention intended to encourage a decrease in the number of new starts of high-risk and expensive on-patent SGAs at a VHA medical center while respecting patient choice and maintaining provider autonomy. Together with an academic detailing effort, a provider decision- making survey at the time of prescription was employed to “nudge”27 providers into decreasing the number of new onpatent SGA prescriptions. Instead of a decrease, we found a 12.7% increase in such prescriptions and no statistically significant association between the month of the study and the frequency of new on-patent SGA prescriptions. Available data show a 2.4% to 3.2% increase in mental health patients treated by the facility during the study period, which is not large enough to explain these findings.26,28

Of cost containment strategies available to payers and administrators, academic detailing is among the least restrictive, seeking to engage the provider in voluntary behavior change. There have been several systematic reviews of such interventions which show them to be effective and consistent in creating changes in physician practices compared with no intervention, audits with feedback, and continuing medical education.24,29 In addition, there is some evidence that educational packages combined with other interventions have a greater impact than academic detailing alone.24 One recent study by Benjamin et al (2011) found an 8.2% increase in the use of generic antipsychotics after an academic detailing campaign coupled with the provision of generic samples.30

The current study did not find similar results, but it differs substantially from Benjamin et al (2011) and other academic detailing initiatives in several respects.31-33 First, our intervention relied heavily on the completion of a provider survey prior to each SGA prescription as a disincentive to prescribing. To our knowledge, this is the first study which has empirically examined this type of intervention. Because it is much less limiting than formulary restriction or prior authorization, the intervention may not have been a powerful or intrusive enough disincentive to alter provider behavior. In addition, only 28.3% of the providers in the current study were residents and fellows who are earlier in their careers, prescribers who could be considered more receptive to behavior change. In contrast, all the participants in the initiative described by Benjamin et al were trainees.

Soumerai and Avorn (1990) have laid out 8 principles of educational outreach,22 not all of which were employed in this intervention. For instance, they call for investigating the motivation of providers prior to developing the scheme and providing reinforcement or follow-up as part of the intervention. These factors may be critical to the success of academic detailing exercises. A recent meta-analysis24 found a wide variation in the structure of academic detailing efforts and the authors postulate that this accounts for the variation in effectiveness. In addition, most academic detailing efforts are aimed at provider behaviors that may be judged by prescribers as more clearly outside the bounds of safe practice, such as the prescription of highly anticholinergic medications to the elderly.31 Our intervention was targeted at an area of practice where there is still disagreement among experts, and where in many cases the drugs had been actively marketed for over a decade. It may be more difficult to change provider behavior in this context.

In spite of the failure to effect behavior change, notable information was obtained on the decision-making process of providers regarding SGAs. One prominent finding is that quetiapine was the most common SGA prescribed. The increase in quetiapine use among other SGAs has been documented in a 2008 study of national VHA data.1 Reasons for the high rate of quetiapine use remain unclear given the drug’s metabolic liability34 and cost. However, its sedative and hypnotic properties35 are likely the most important contributors, in addition to recent reports of its abuse potential36 and use as a treatment for alcohol use disorders.37

Additionally, we found a high rate of SGA use in patients with affective disorders other than bipolar disorder and PTSD. At the time of this study, no SGA had received FDA approval for adjunctive use in nonresponsive depression, and there are no general indications for SGA use in PTSD. The off-label use of SGAs is very common, accounting for greater than 60% of SGA prescriptions in several studies.14,38,39 A recent VHA study revealed that 40% of off-label SGA use was associated with PTSD and approximately 30% of those with PTSD received an SGA prescription, very similar to the current study.14 These rates are especially notable in view of recent research showing that adjunctive risperidone use in SSRI-resistant PTSD showed no greater efficacy in decreasing PTSD symptoms40 but increased adverse effects such as weight gain, fatigue, and somnolence. However, we must note that this evidence was not available at the time of the survey and there was some evidence41 and a feeling among many prescribers in the VA Connecticut Healthcare System that atypical antipsychotics were helpful in PTSD. More research is needed into the reasons for off-label SGA use given the risks associated with these medications.

This study also found a high rate of metabolic and cardiac disorders in patients given SGAs. Although these diseases are common in individuals with psychiatric disorders42 and in those who seek care in the VHA system,43 SGAs have been associated with weight gain, impairment of glucose metabolism, and lipid abnormalities.10 Current guideline recommendations call for the routine monitoring of weight and blood pressure, as well as screening of serum glucose and lipids in patients treated with SGAs.44 The large proportion of cardio-metabolic diagnoses found in this study in addition to evidence of limited adherence to guidelines for the routine monitoring for these diseases45 suggests an apparent failure of recent research on these risks to influence practice. There is a need for more research into ways such guideline recommendations can better influence practice.

There are also interesting patterns to be noted in the reasons chosen for the prescription of particular SGAs. The most common was “efficacy,” which, while consistent with previous efficacy research,8 has been put into serious doubt by effectiveness research in more real-world practice settings.2-5 The second most common reason was “sleep/sedation,” which is likely related to quetiapine use and is puzzling given the host of other less costly and less metabolically active medications to improve sleep. The third most common reason was “patient choice,” which may indicate that providers are implementing a shared decision-making process or which may reflect the influence of direct-to-consumer advertising. More investigation is needed into the specific rationale for the use of SGAs in these clinical circumstances.

There are several limitations to this study that deserve discussion. This intervention was aimed solely at psychiatric providers in a single VHA hospital who work in a vertically integrated organization with onsite pharmaceutical services where the costs of medications for patients are rarely an issue. These factors limit the generalizability of results, but given the integrated nature of this health system compared with private providers, one would expect a higher probability of success for an academic detailing intervention. In addition, the VHA electronic medical record and ordering system allowed implementation of the survey to be relatively easy. This intervention would be difficult in other health systems or private practice. Moreover, this was not a controlled trial where groups were randomly assigned to different interventions. We have no information of the rate of first-generation antipsychotics over the course of the study, although data on the total number of psychiatric patients at the facility suggests little change in the potential target population. In addition, a limitation of using VHA pharmacy prescription files is that they do not include prescriptions filled in non- VHA pharmacies. No data are available on the frequency of this practice, but our personal experience and discussions with VHA staff suggest that this practice is rare because it entails substantially increased costs to patients. Finally, the use of the survey to decrease on-patent SGA use may have biased survey results in an unknown manner. Given these circumstances, one would expect more conservative provider responses. Therefore, it is notable that we still found a stable and relatively high rate of pharmacologic practices that do not appear to be consistent with current evidence.

There are multiple strategies for influencing provider prescribing behavior. We describe a combination strategy of academic detailing and a point of care survey which preserves patient and provider autonomy. This cautious intervention did not influence the prescription rate of on-patent SGAs. In addition, somewhat disconcerting insight was gained into the frequent use of SGAs for questionable off-label practices. Further investigation is needed into the rationale for SGA use in disorders such as PTSD where there is little evidence of efficacy, in patients with comorbid metabolic and cardiac disease where the use of these medications may exacerbate existing

medical conditions, and in sleep disorders where there are a host of other less costly and better-tolerated options. In addition, the failure of this academic detailing intervention to produce behavior change underscores the need to determine which specific characteristics of these interventions are capable of producing practice change.

Acknowledgments

The authors would also like to thank Elina Stefanovics, PhD, VA Connecticut Healthcare System, for her help in data management and analysis.

Author Affiliations: From Department of Psychiatry (EDAH), Yale School of Medicine, New Haven, CT; Connecticut Mental Health Center (MS), New Haven, CT; Yale University School of Medicine, New Haven, CT; VA New England Mental Illness (RAR), Research, Education and Clinical Center, West Haven, CT; Epidemiology and Public Health (RAR), Child Study Center Yale Medical School and VA Connecticut Health Care System, West Haven, CT.

Funding Source: This analysis was supported by the New England Mental Illness Research and Education Center. The funding source had no role in the design, analysis, or interpretation of data or in the preparation of the report or decision to publish.

Author Disclosures: Dr Rosenheck reports receiving research support from Janssen Pharmaceutica Products and Wyeth Pharmaceuticals and has received consulting fees from Bristol-Myers Squibb, Eli Lilly and Co, Roche Pharmaceuticals, and Janssen Pharmaceutica Products. He also reports giving expert testimony for the state of Texas versus Janssen. The other authors (EDAH, MS) report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.

Authorship Information: Concept and design (MS, RR); acquisition of data (MS, RR); analysis and interpretation of data (EDAH, RR); drafting of the manuscript (EDAH, RR); critical revision of the manuscript for important intellectual content (EDAH, MS, RR); statistical analysis (EDAH, RR); obtaining funding (RR); and administrative, technical, or logistic support (EDAH, MS).

Address correspondence to: Eric D. A. Hermes, MD, Department of Psychiatry, Yale School of Medicine, 300 George St, Ste 901, New Haven, CT 06511. E-mail: eric.hermes@yale.edu.1. Sernyak MJ, Rosenheck RA. Antipsychotic use in the treatment of outpatients with schizophrenia in the VA from fiscal years 1999 to 2006. Psychiatr Serv. 2008;59(5):567-569.

2. Geddes J, Freemantle N, Harrison P, Bebbington P. Atypical antipsychotics in the treatment of schizophrenia: systematic overview and meta-regression analysis. BMJ. 2000;321(7273):1371-1376.

3. Rosenheck R, Perlick D, Bingham S, et al. Effectiveness and cost of olanzapine and haloperidol in the treatment of schizophrenia. JAMA. 2003;290(20):2693-2702.

4. Jones PB, Barnes TR, Davies L, et al. Randomized controlled trial of the effect on Quality of Life of second- vs first-generation antipsychotic drugs in schizophrenia: Cost Utility of the Latest Antipsychotic Drugs in Schizophrenia Study (CUtLASS 1). Arch Gen Psychiatry. 2006;63(10):1079-1087.

5. Lieberman JA, Stroup TS, McEvoy JP, et al. Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) Investigators. Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. N Engl J Med. 2005;353(12):1209-1223.

6. Davis JM, Chen N, Glick ID. A meta-analysis of the efficacy of second-generation antipsychotics. Arch Gen Psychiatry. 2003;60(6): 553-564.

7. Leucht S, Wahlbeck K, Hamann J, Kissling W. New generation antipsychotics versus low-potency conventional antipsychotics: a systematic review and meta-analysis. Lancet. 2003;361(9369):1581-1589.

8. Leucht S, Corves C, Arbter D, Engel RR, Li C, Davis JM. Second-generation versus first-generation antipsychotic drugs for schizophrenia: a meta-analysis. Lancet. 2009;373(9657):31-41.

9. Miller DD, Caroff SN, Davis SM, et al. Extrapyramidal side-effects of antipsychotics in a randomized trial. Br J Psychiatry. 2008;193(4): 279-288.

10. Daumit GL, Goff DC, Meyer JM, et al. Antipsychotic effects on estimated 10-year coronary heart disease risk in the CATIE schizophrenia study. Schizophr Res. 2008;105(1-3):175-187.

11. Allison DB, Mentore JL, Heo M, et al. Antipsychotic-induced weight gain: a comprehensive research synthesis. Am J Psychiatry. 1999;156 (11):1686-1696.

12. Domino ME, Swartz MS. Who are the new users of antipsychotic medications? Psychiatr Serv. 2008;59(5):507-514.

13. Comer JS, Mojtabai R, Olfson M. National trends in the antipsychotic treatment of psychiatric outpatients with anxiety disorders. Am J Psychiatry. 2011;168(10):1057-1065.

14. Leslie DL, Mohamed S, Rosenheck RA. Off-label use of antipsychotic medications in the Department of Veterans Affairs health care system. Psychiatr Serv. 2009;60(9):1175-1181.

15. BCC Research. Antipsychotic drugs: technologies and global markets. Report PHM063A. BCC Research Market Forecasting. http://www .bccresearch.com/report/antipsychotic-drugs-markets-phm063a.html.Published June 2010. Accessed January 15, 2011.

16. Duggan M. Do new prescription drugs pay for themselves: the case of second-generation antipsychotics. J Health Econ. 2005;24(1):1-31.

17. Red Book. Montvale, NJ: Thomson Reuters; 2010.

18. Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research. JAMA. 2003;289(4):454-465.

19. Montgomery JH, Byerly M, Carmody T, et al. An analysis of the effect of funding source in randomized clinical trials of second generation antipsychotics for the treatment of schizophrenia. Control Clin Trials. 2004;25(6):598-612.

20. Arbuckle MR, Gameroff MJ, Marcus SC, West JC, Wilk J, Olfson M. Psychiatric opinion and antipsychotic selection in the management of schizophrenia. Psychiatr Serv. 2008;59(5):561-565.

21. Hoadley J. Cost containment strategies for prescription drugs: assessing the evidence in the literature. Washington, DC:The Kaiser Family Foundation; March 2005.

22. Soumerai SB, Avorn J. Principles of educational outreach (‘academic detailing’) to improve clinical decision making. JAMA. 1990;263(4):549-556.

23. Grimshaw JM, Thomas RE, MacLennan G, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8(6):iii-iv, 1-72.

24. O’Brien MA, Oxman AD, Davis DA, Haynes RB, Freemantle N, Harvey EL. Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000;(2): CD000409.

25. Rosenheck RA, Leslie DL, Busch S, Rofman ES, Sernyak M. Rethinking antipsychotic formulary policy. Schizophr Bull. 2008;34(2):375-380.

26. Greenberg G, Rosenheck R. Department of Veterans Affairs National Mental Health Program Performance Monitoring System: fiscal year 2007 report. West Haven, CT: Northeast Program Evaluation Center; 2008.

27. Thaler RH, Sunstein CR. Nudge: Improving Decisions About Health, Wealth, and Happiness. New Haven: CT: Yale University Press; 2008.

28. Greenberg G, Rosenheck R. Department of Veterans Affairs National Mental Health Program Performance Monitoring System: fiscal year 2010 report. West Haven, CT: Northeast Program Evaluation Center; 2010.

29. Davis DA, Thomson MA, Oxman AD, et al. Changing physician performance: a systematic review of the effect of continuing medical education strategies. JAMA. 1995;274(9):700-705.

30. Benjamin D, Swartz M, Forman L. The impact of evidence-based education on prescribing in a psychiatry residency. J Psychiatr Pract. 2011;17(2):110-117.

31. van Eijk MEC, Avorn J, Porsius AJ, de Boer A. Reducing prescribing of highly anticholinergic antidepressants for elderly people: randomized trial of group versus individual academic detailing. BMJ. 2001; 322(7287):654-657.

32. Ray WA, Taylor JA, Meador KG, et al. Reducing antipsychotic drug use in nursing homes: a controlled trial of provider education. Arch Int Med. 1993;153(6):713-721.

33. Avorn J, Soumerai SB, Everitt DE, et al. A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. N Eng J Med. 1992;327:168-173.

34. Rummel-Kluge C, Komossa K, Schwarz S, et al. Head-to-head comparisons of metabolic side effects of second generation antipsychotics in the treatment of schizophrenia: a systematic review and meta-analysis. Schizophr Res. 2010;123(2-3):225-233.

35. Kane JM, Sharif ZA. Atypical antipsychotics: sedation versus efficacy. J Clin Psychiatry. 2008;69(suppl 1):18-31.

36. Pinta ER, Taylor RE. Quetiapine addiction? Am J Psychiatry. 2007; 164(1):174-175.

37. Monnelly EP, Ciraulo DA, Knapp C, LoCastro J, Sepulveda I. Quetiapine for treatment of alcohol dependence. J Clin Psychopharmacol. 2004;24(5):532-535.

38. Chen H, Reeves JH, Fincham JE, Kennedy WK, Dorfman JH, Martin BC. Off-label use of antidepressant, anticonvulsant, and antipsychotic medications among Georgia medicaid enrollees in 2001. J Clin Psychiatry. 2006;67(6):972-982.

39. Weiss E, Hummer M, Koller D, Ulmer H, Fleischhacker WW. Offlabel use of antipsychotic drugs. J Clin Psychopharmacol. 2000;20(6): 695-698.

40. Krystal JH, Rosenheck RA, Cramer JA, et al. Adjunctive risperidone treatment for antidepressant-resistant symptoms of chronic military service-related PTSD: a randomized trial. JAMA. 2011;306(5):493-502.

41. Hamner MB, Deitsch SE, Brodrick PS, Ulmer HG, Lorberbaum JP. Quetiapine treatment in patients with posttraumatic stress disorder: an open trial of adjunctive therapy. J Clin Psychopharmacol. 2003; 23(1):15-20.

42. Miller BJ, Paschall III CB, Svendsen DP. Mortality and medical comorbidity among patients with serious mental illness. Psychiatr Serv. 2006;57(10):1482-1487.

43. Yu W, Ravelo A, Wagner TH, et al. Prevalence and costs of chronic conditions in the VA health care system. Med Care Res Rev. 2003;60(3 suppl):146S-167S.

44. North American Association for the Study of Obesity. Consensus development conference on antipsychotic drugs and obesity and diabetes. Obes Res. 2004;12(2):362-368.

45. Jerrell, JM, McIntyre RS, Black, GB. Economic costs of failure to monitor adverse effects of second-generation antipsychotics: an underestimated factor. Psychiatr Serv. 2012;63(3):202-204.