Identifying Subgroups of Complex Patients With Cluster Analysis

August 9, 2011
Sophia R. Newcomer, MPH
Sophia R. Newcomer, MPH

,
John F. Steiner, MD, MPH
John F. Steiner, MD, MPH

,
Elizabeth A. Bayliss, MD, MSPH
Elizabeth A. Bayliss, MD, MSPH

Volume 17, Issue 8

Cluster analysis can aid in identifying subgroups of patients with similar patterns of comorbid conditions for targeted care management.

Objective:

To illustrate the use of cluster analysis for identifying sub-populations of complex patients who may benefit from targeted care management strategies.

Study Design:

Retrospective cohort analysis.

Methods:

We identified a cohort of adult members of an integrated health maintenance organization who had 2 or more of 17 common chronic medical conditions and were categorized in the top 20% of total cost of care for 2 consecutive years (n = 15,480). We used agglomerative hierarchical clustering methods to identify clinically relevant subgroups based on groupings of coexisting conditions. Ward’s minimum variance algorithm provided the most parsimonious solution.

Results:

Ward’s algorithm identified 10 clinically relevant clusters grouped around single or multiple “anchoring conditions.” The clusters revealed distinct groups of patients including: coexisting chronic pain and mental illness, obesity and mental illness, frail elderly, cancer, specific surgical procedures, cardiac disease, chronic lung disease, gastrointestinal bleeding, diabetes, and renal disease. These conditions co-occurred with multiple other chronic conditions. Mental health diagnoses were prevalent (range 28% to 100%) in all clusters.

Conclusions:

Data mining procedures such as cluster analysis can be used to identify discrete groups of patients with specific combinations of comorbid conditions. These clusters suggest the need for a range of care management strategies. Although several of our clusters lend themselves to existing care and disease management protocols, care management for other subgroups is less well-defined. Cluster analysis methods can be leveraged to develop targeted care management interventions designed to improve health outcomes.

(Am J Manag Care. 2011;17(8):e324-e332)

This study illustrates the use of cluster analysis to identify sub-populations of complex patients for potential targeted care management within an integrated health maintenance organization.

  • Among a cohort of adults with multimorbidity and high healthcare utilization, we identified 10 clinically relevant clusters of complex patients.

  • While care management protocols may already exist in many healthcare settings for some common clusters, other clusters identified present opportunities for new or enhanced care management.

  • Data mining methods such as cluster analysis can be applied in other settings where electronic diagnosis data are readily available.

By 2020, over 81 million persons in the United States will have 2 or more chronic conditions.1 Multimorbidity results in adverse health outcomes and higher healthcare costs, and challenges current models of care delivery.2,3 Care management has the potential to improve health outcomes for persons with multimorbidities. However, most disease and care management strategies have been developed to improve specific health outcomes for populations defined by single diseases or specific circumstances (such as hospital discharge).4-11 There is a need for strategies that can identify sub-populations with multiple, interacting diseases, in order to provide them with appropriate and relevant care management support.

Investigations to identify these populations of complex patients have traditionally relied upon multivariable regression analyses to identify patient-level characteristics (such as demographics and diseases) that predict the outcome of interest (such as hospitalization).12-14 As compared with investigations that use multivariable regression analyses to identify individual disease predictors of specific outcomes, data mining techniques provide an opportunity to empirically identify groups of patients with similar patterns of multimorbidities. One such technique, cluster analysis, refers to classification methods that are used for discovering groups or “clusters” of “highly similar entities” within data sets.15 Cluster analyses are common in psychology, sociology, and marketing research, and the methods have been used to a limited extent in health services research.16-18 While cluster analyses previously have been used to discover patterns of multimorbidities,19-21 in this study we demonstrate the application of such methods for identifying clusters of patients with high utilization that may suggest opportunities for enhanced care management in a managed care setting.

We used cluster analysis to explore a large, 2-year cohort of health maintenance organization members with 2 or more chronic conditions. We hypothesized that within a large, complex patient population, cluster analysis would reveal groups of patients with distinct patterns of comorbid conditions. Although some of these subgroups would be characterized by well-known patterns of co-occurring medical conditions with established care management strategies, other subgroups would reveal combi-nations of comorbidities that might benefit from new, proactive, and targeted care management.

METHODS

Setting

Kaiser Permanente Colorado (KPCO) is an integrated, not-for-profit health maintenance organization. During the years studied (2006 and 2007), KPCO had approximately 430,000 members. This study was approved by KPCO’s Institutional Review Board.

Study Population

The study population consisted of KPCO members 21 years or older on January 1, 2006, categorized in the top 20% of total cost of care in both 2006 and 2007, each with 2 or more of 17 common chronic medical conditions. Annual cost estimates combined general ledger costs with direct and indirect utilization-related costs to provide cost-of-care estimates for KPCO members.22 We excluded members with a long-term care facility stay, chronic kidney dialysis, or an inpatient visit of greater than 30 days during the 2 years based on the premise that their unique and significant care management needs are likely to already be well defined. Six extremely high cost outliers were also removed from the cohort.

We compiled a list of 17 chronic medical conditions based on prevalence in the general population, prevalence in our specific cohort, and a literature search of conditions likely to predict hospitalization or adverse health outcomes in complex patients.13,23-34 The selected conditions were diabetes, chronic obstructive pulmonary disease (COPD), chronic kidney disease, stroke, obesity, dementia, fall, hip fracture, chronic pain, skin ulcer, orthopedic surgery, back surgery, abdominal surgery, gastrointestinal bleeding, cancer (excluding non-melanoma skin cancer), cardiac disease (which included coronary artery disease and congestive heart failure), and mental health conditions—primarily depression, but also including generalized anxiety and bipolar disorders. Determinations of whether cohort members had a given condition were based on inpatient and outpatient International Classification of Diseases, Ninth Revision (ICD-9) diagnosis and procedure codes in 2006 and 2007. In addition, we used KPCO’s cancer registry to determine cancer diagnoses in 2005, 2006, and 2007. We considered a cohort member to have obesity if they had an ICD-9 diagnosis code for obesity or a median body mass index (BMI) greater than or equal to 30 in 2006 and 2007. BMI data were available for 98.6% of cohort members; if a cohort member did not have a BMI value or an obesity diagnosis in 2006 or 2007 then we did not consider them to be obese.

Statistical Analysis

SAS version 9.2 (SAS Institute, Cary, North Carolina) was used for all analyses. We described demographic attributes, healthcare utilization, comorbidity score (using the Quan adaptation of the Elixhauser comorbidity index),35 and prevalence of clinical conditions within the cohort using frequencies and medians with 25th and 75th percentiles.

Agglomerative Hierarchical Clustering. We used agglomerative hierarchical clustering to identify clinically relevant groups of cohort members with similar multimorbid conditions. With this method of cluster analysis, each cohort member starts as its own cluster. The 2 most similar clusters are merged and this new cluster replaces the 2 former clusters. The process continues until there is only 1 cluster containing all observations.15,36,37 After the clustering algorithm is run, the user must select the appropriate cutoff point for the number of clusters desired based on clinical importance or other pre-specified criteria.

Algorithms. Various algorithms are available for cluster analysis. For this study, we used Ward’s minimum variance method as the primary algorithm. With this algorithm, every possible cluster combination is considered at each step of agglomerative hierarchical clustering, and the combination thatresults in the smallest addition to the error sum of squares is selected.15,37 Ward’s method is a widely used algorithm which minimizes the variance within clusters, and is also known to produce clusters of similar sizes.15,17,18,38-43 We compared results from Ward’s method to results using the flexible beta algorithm, where the user sets different levels of beta, and beta values less than zero optimize the dissimilarity between clusters.19,20,44

Analytic Process. In the analytic data set, the presence or absence of each of the 17 conditions was represented with a 1 or 0 for each cohort member. We first randomly split the full analytic data set into 2 equally sized data sets. We then converted each split data set into a dissimilarity matrix using Jaccard’s coefficient. This is an appropriate distance measure for clinical conditions, as it considers the number of conditions that 2 people have in common and ignores conditions that neither person has.19

We ran our primary algorithm, Ward’s minimum variance method, on both split data sets. The pseudo F, pseudo T, and r2 statistics were examined for different numbers of clusters to identify possible clustering solutions.37 These statistics pointed to several desirable numbers of clusters, and membership in these clusters was described by examining the prevalence of each condition in the cluster. Cluster membership was compared between the 2 split data sets to assess the consistency of the clustering process. Since cluster membership was similar between the 2 split data sets, thus reinforcing the stability of the algorithm in this population, Ward’s algorithm was run on the entire data set. We subjectively determined that a 10-cluster solution produced the most clinically relevant clusters. For comparison, we then produced 10 cluster solutions using the flexible beta method, with beta set at -0.25 and -0.5, and compared these results with Ward’s method. This confirmed that Ward’s algorithm resulting in 10 clusters appeared to be the most parsimonious solution and provided the most clinically relevant groups. We then described the 10 clusters by the number of cohort members in the cluster, median age of cluster members, and percentage of cluster members with the most prevalent conditions in that cluster. We also described relative cost of care ratios for each cluster.

RESULTS

Table 1

provides descriptive demographic and disease characteristics of the study cohort (n = 15,480). The median age of cohort members was 65 years, and 59.1% of cohort members were women. Cohort members had a median of 5 chronic medical conditions (including, but not limited to, the 17 conditions included in the cluster analysis).

Appendix

In this study we tried 3 clustering algorithms—Ward’s, flexible beta with beta set to -0.25, and flexible beta with beta set to -0.5. Full results from the 3 methods are in the . All 3 methods identified some of the same distinct clusters, including clusters of patients with chronic pain and mental health conditions and gastrointestinal bleeding and mental health conditions. However, we preferred Ward’s method because the flexible beta methods tended to produce many small homogeneous clusters and several large heterogeneous clusters, while Ward’s method produced more similarly sized and more homogeneous clusters. Eight of the 10 clusters produced by Ward’s method had what we referred to as “anchoring” conditions, or chronic conditions shared by almost all (>98%) of cluster members. We considered such anchoring conditions potentially useful given the ultimate goal of proactively identifying characteristics of persons who may benefit from targeted care management. With the flexible beta results, only 5 and 7 of the clusters from the method with beta set at —0.25 and –0.5, respectively, had anchoring conditions.

Table 2

provides a description of cluster membership using Ward’s algorithm. Of the 10 clusters, several described groups of patients with well-known and highly prevalent comorbidities such as diabetes and obesity, cardiac disease and obesity, renal disease and diabetes, and the multiple diseases and conditions common in the frail elderly. Other clusters were defined by combinations of comorbidities that are less frequently described including abdominal and orthopedic surgeries with obesity. Two clusters included individuals who were substantially younger than the others: mental health conditions and chronic pain, and mental health conditions and obesity. Two single conditions were highly prevalent across all groups: mental health conditions (primarily depression) and obesity. These conditions were present in all clusters with prevalence rates that ranged from 28% to 100% (mental health conditions) and from 38% to 100% (obesity). Prevalence of all 17 conditions in each cluster is available in the Appendix, as are relative cost ratios.

DISCUSSION

In this investigation, we demonstrated the use of cluster analysis to identify distinct subgroups of patients with specific combinations of co-occurring conditions in a managed care population. Exploratory by nature, cluster analysis provided a unique method for investigating the co-occurrence of multiple conditions. When working with large data sets, simple tabulations of the number of chronic conditions can be difficult to interpret. In our population in which cohort members had at least 2 of 17 conditions of interest, there are theoretically over 100,000 different possible combinations of coexisting conditions. In actuality, our cohort only had 1507 different combinations of the 17 conditions of interest. Even this number of naturally occurring clusters is much too large to allow identification of targeted care management opportunities.

Compared with people with only 1 chronic condition, persons with multiple chronic conditions experience worse health outcomes, including, but not limited to, lower quality of life, poorer functional status, and excess morbidity and mortality.3,45-49 Chronic conditions do not occur in isolation, yet many existing care management strategies are directed toward single conditions. Cluster analysis provided a data-driven approach to identifying 10 clinically relevant groups of patients with patterns of comorbidities that could be targeted with new, enhanced care management strategies.

In our analysis, the largest cluster was characterized by older age coupled with conditions associated with frailty, such as stroke and dementia, along with chronic conditions including diabetes, obesity, and cardiac disease. Along with this group, our analysis produced several other clusters of wellknown, high-cost co-occurring conditions for which chronic disease management programs are widespread, such as cancer with obesity and/or mental health conditions (primarily depression) and cardiac disease co-occurring with obesity and diabetes. Identification of these expected groups in our analysis provided additional assurance of the validity of our data mining method.

Our analysis produced several clusters that suggest potential care management opportunities in our managed care setting, especially in relatively younger adults. Two clusters from this cohort of individuals had median ages of 50 years (cluster 4) and 55 years (cluster 1). All 1676 members of cluster 4 had both mental health conditions and obesity, but none of the other 15 conditions of interest. This highly homogeneous cluster represented 10.8% of the entire study cohort. Individuals in cluster 1 were characterized by chronic pain co-occurring with mental health conditions and/or obesity. Chronic pain is associated with depression and anxiety, and has been linked to increased utilization of health resources.50,51 Coordinated care strategies to relieve depression and improve chronic pain outcomes have been evaluated to a limited extent.52,53 Cohort members in cluster 1 also had the third highest median total cost of care of all clusters, after the clusters of cancer and surgical patients. Identification of these 2 clusters supports the notion that multimorbidity and patient complexity are not limited to the elderly.54 It is likely that the relatively younger adults in these 2 groups would benefit from care management that emphasizes integrated depression care.55,56 Finally, we noted a high prevalence of mental health conditions and obesity across all clusters, suggesting that these 2 conditions should be addressed in most, if not all, comprehensive care management programs.

Our study has several limitations. Cluster analysis is an exploratory classification method that is supported by a relatively small body of statistical evidence, and different clustering algorithms produce different results.15 Knowing this inherent problem, we tried several algorithms. We chose the ultimate clustering solution based on subjective review and clinical relevance of cluster membership. In addition, agglomerative hierarchical clustering forces everyone into a cluster. There are likely small groups of patients within some of our clusters who have unique combinations of comorbid conditions that differ from the majority of people in that cluster. To assess the consistency of the clustering process within our patient population, we compared results from a randomly split data set of cohort members in 2006 and 2007. To further assess the stability of these clusters over time, analyses should be conducted on cohorts from different years. As with any investigation, the characteristics of our clusters are limited to our data and setting. Replicating these analyses in other settings and other patient populations may potentially reveal different clusters. However, these differences would and should inform management strategies specific to populations in those settings.

An additional limitation is that we identified the 17 conditions of interest based on electronic diagnosis and procedure data in 2006 and 2007, with the exception of cancer, for which we also included 2005 data and used a cancer registry, and obesity, for which we used BMI data. We anticipate that for most chronic conditions, such as COPD or diabetes, the member would have had at least 1 diagnosis in these years; however, the sensitivity and specificity of diagnostic data are imperfect, leading to potential misclassification of conditions. Lastly, it is likely that individuals in our cohort carried multiple other diagnoses not specifically assessed. Based on the Quan adaptation of the Elixhauser comorbidity index, cohort members had a median of 5 chronic conditions.35 We selected the 17 conditions examined in this study based on prevalence in the general population and in our specific cohort, and on prior knowledge of or association with increased healthcare utilization; however, it is likely that including other conditions in the analysis would result in different clusters or subgroups.

In this investigation, we demonstrated how cluster analysis can be used to identify homogeneous groups of complex patients from a large heterogeneous population. Such data mining methods can be applied in other settings where electronic diagnosis data are readily available. Alternatively, it is possible to use the conceptual results from this investigation to increase awareness of the need for a diverse array of care management services for individuals with high levels of healthcare utilization. However, further understanding of the care management needs of clusters of patients with similar comorbidities is warranted before designing specific tailored interventions. For example, the specific needs of persons with mental health conditions and obesity should be explored in detail in order to develop relevant care management strategies for that group.

Cluster analysis methods can be leveraged for targeted care management interventions designed to improve health outcomes and potentially lower healthcare costs. This cluster analysis of a large cohort of individuals with multiple morbidities suggests that complex patients with high healthcare utilization represent a highly diverse group of individuals. While some subgroups may respond well to existing approaches to care management (such as those designed for populations with diabetes, cardiac disease, and frailty), others will likely require new and/or individualized care management strategies to achieve favorable health outcomes.

Author Affiliations: From Institute for Health Research (SRN, JFS EAB), Kaiser Permanente Colorado, Denver; Department of Family Medicine (EAB), University of Colorado, Aurora.

Funding Source: Supported by the Agency for Healthcare Research and Quality: K08 HS015476.

Author Disclosures: Preliminary findings of this study were presented in poster format at the American Public Health Association Annual Meeting 2010; November 8, 2010; Denver, CO. The authors (SRN, JFS, EAB) report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.

Authorship Information: Concept and design (SRN, JFS, EAB); acquisition of data (SRN); analysis and interpretation of data (SRN, JFS, EAB); drafting of the manuscript (SRN, JFS, EAB); critical revision of the manuscript for important intellectual content (SRN, JFS, EAB); statistical analysis (SRN); obtaining funding (EAB); and supervision (EAB).

Address correspondence to: Sophia Raff Newcomer, MPH, Institute for Health Research, Kaiser Permanente Colorado, 10065 E Harvard Ave, Ste 300, Denver, CO 80231. E-mail: Sophia.r.newcomer@kp.org.

1. Anderson GF. Physician, public, and policymaker perspectives on chronic conditions. Arch Intern Med. 2003;163:437-442.

2. Wolff JL, Starfield B, Anderson G. Prevalence, expenditures, and complications of multiple chronic conditions in the elderly. Arch Intern Med. 2002;162(20):2269.

3. Parekh AK, Barton MB. The challenge of multiple comorbidity for the US health care system. JAMA. 2010;303(13):1303.

4. Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA. 2002;288(14):1775-1779.

5. Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness: the chronic care model, Part 2. JAMA. 2002;288(15):1909-1914.

6. Rundall TG, Shortell SM, Wang MC, et al. As good as it gets? chronic care management in nine leading US physician organizations. BMJ. 2002;325(7370):958-961.

7. Tsai AC, Morton SC, Mangione CM, Keeler EB. A meta-analysis of interventions to improve care for chronic illnesses. Am J Manag Care. 2005;11(8):478-488.

8. GESICA Investigators. Randomised trial of telephone intervention in chronic heart failure: DIAL trial. BMJ. 2005;331(7514):425.

9. Griffiths C, Foster G, Barnes N, et al. Specialist nurse intervention to reduce unscheduled asthma care in a deprived multiethnic area: the east London randomised controlled trial for high risk asthma (ELECTRA). BMJ. 2004;328(7432):144.

10. Sochalski J, Jaarsma T, Krumholz HM, et al. What works in chronic care management: the case of heart failure. Health Aff (Millwood). 2009;28(1):179-189.

11. Katz BP, Holmes AM, Stump TE, et al. The Indiana Chronic Disease Management Program’s impact on Medicaid claims: a longitudinal, statewide evaluation. Med Care. 2009;47(2):154-160.

12. Boult C, Dowd B, McCaffrey D, Boult L, Hernandez R, Krulewitch H. Screening elders for risk of hospital admission. J Am Geriatr Soc. 1993;41(8):811.

13. Dorr DA, Jones SS, Burns L, et al. Use of health related, quality of life metrics to predict mortality and hospitalizations in community dwelling seniors. J Am Geriatr S. 2006;54(4):667-673.

14. Inouye SK, Zhang Y, Jones RN, et al. Risk factors for hospitalization among community-dwelling primary care older patients: development and validation of a predictive model. Med Care. 2008;46(7):726.

15. Aldenderfer MS, Blashfield RK. Cluster Analysis: Quantitative Applications in the Social Sciences. Beverly Hills, CA: Sage Publications; 1984.

16. Punj G, Stewart DW. Cluster analysis in marketing research: review and suggestions for application. J Marketing Res. 1983;20(2):134-148.

17. Braet C, Beyers W. Subtyping children and adolescents who are overweight: different symptomatology and treatment outcomes. J Consult Clin Psychol. 2009;77(5):814-824.

18. Gerlinger C, Wessel J, Kallischnigg G, Endrikat J. Pattern recognition in menstrual bleeding diaries by statistical cluster analysis. BMC Womens Health. 2009;9(1):21.

19. Cornell JE, Pugh JA, Williams JW Jr, et al. Multimorbidity clusters: clustering binary data from a large administrative medical database. Appl Multivariate Res. 2009;12(3):163.

20. Goldstein G, Luther JF, Jacoby AM, Haas GL, Gordon AJ. A taxonomy of medical comorbidity for veterans who are homeless. J Health Care Poor Underserved. 2008;19(3):991-1005.

21. Marengoni A, Rizzuto D, Wang HX, Winblad B, Fratiglioni L. Patterns of chronic multimorbidity in the elderly population. J Am Geriatr Soc. 2009;57(2):225-230.

22. Estabrooks PA, Shetterly S. The prevalence and health care use of overweight children in an integrated health care system. Arch Pediatr Adolesc Med. 2007;161(3):222.

23. Mudge AM, Kasper K, Clair A, et al. Recurrent readmissions in medical patients: a prospective study. J Hosp Med. 2011;6(2):61-67.

24. de Boer AGEM, Wijker W, de Haes HCJM. Predictors of health care utilization in the chronically ill: a review of the literature. Health Policy. 1997;42(2):101-115.

25. Forrest CB, Lemke KW, Bodycombe DP, Weiner JP. Medication, diagnostic, and cost information as predictors of high-risk patients in need of care management. Am J Manag Care. 2009;15(1):41.

26. Cohen-Mansfield J, Pawlson G, Lipson S, Volpato S. The measurement of health: a comparison of indices of disease severity. J Clin Epidemiol. 2001;54(11):1094-1102.

27. Lee SJ, Lindquist K, Segal MR, Covinsky KE. Development and validation of a prognostic index for 4-year mortality in older adults. JAMA. 2006;295(7):801.

28. Lyon D, Lancaster GA, Taylor S, Dowrick C, Chellaswamy H. Predicting the likelihood of emergency admission to hospital of older people: development and validation of the Emergency Admission Risk Likelihood Index (EARLI). Fam Pract. 2007;24(2):158.

29. Fortinsky RH, Madigan EA, Sheehan TJ, Tullai-McGuinness S, Fenster JR. Risk factors for hospitalization among Medicare home care patients. West J Nurs Res. 2006;28(8):902.

30. Donnan PT, Dorward DWT, Mutch B, Morris AD. Development and validation of a model for predicting emergency admissions over the next year (PEONY): a UK historical cohort study. Arch Intern Med. 2008;168(13):1416-1422.

31. Desai MM, Bogardus ST Jr, Williams CS, Vitagliano G, Inouye SK. Development and validation of a risk adjustment index for older patients: the high risk diagnoses for the elderly scale. J Am Geriatr Soc. 2002;50(3):474-481.

32. Piccirillo JF, Tierney RM, Costas I, Grove L, Spitznagel EL. Prognostic importance of comorbidity in a hospital-based cancer registry. JAMA. 2004;291(20):2441.

33. Satish S, Winograd CH, Chavez C, Bloch DA. Geriatric targeting criteria as predictors of survival and health care utilization. J Am Geriatr Soc. 1996;44(8):914-921.

34. Fried LF, Shlipak MG, Crump C, et al. Renal insufficiency as a predictor of cardiovascular outcomes and mortality in elderly individuals. J Am Coll Cardiol. 2003;41(8):1364-1372.

35. Quan H, Sundararajan V, Halfon P, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43(11):1130.

36. Johnson DE. Applied Multivariate Methods for Data Analysts. Pacific Grove, CA: Duxbury Press; 1998.

37. SAS Institute Inc. SAS/STAT 9.1 User’s Guide. Cary, NC: SAS Institute Inc; 2004.

38. Smit ES, Hoving C, De Vries H. Does a typical contemplator exist? three clusters of smokers in contemplation. Health Educ Res. 2010; 25(1):61.

39. Walker LO. Low-income women’s reproductive weight patterns: empirically based clusters of prepregnant, gestational and postpartum weights. Womens Health Issues. 2011;19:398-405.

40. Sanchez-Orturo MM, Edinger JD. A penny for your thoughts: patterns of sleep-related beliefs, insomnia symptoms and treatment outcome. Behav Res Ther. 2010;48(2):125.

41. Rhee H, Holditch-Davis D, Miles MS. Patterns of physical symptoms and relationships with psychosocial factors in adolescents. Psychosom Med. 2005;67(6):1006.

42. Peretti-Watel P, Garelik D, Baron G, Spire B, Ravaud P, Duval X. Smoking motivations and quitting motivations among HIV-infected smokers. Antivir Ther. 2009;14:781-787.

43. Ott CH, Lueger RJ, Kelber ST, Prigerson HG. Spousal bereavement in older adults: common, resilient, and chronic grief with defining characteristics. J Nerv Ment Dis. 2007;195(4):332.

44. Lance GN, Williams WT. A general theory of classificatory sorting strategies: 1. Hierarchical systems. The Computer Journal. 1967;9(4):373.

45. Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B. Depression, chronic diseases, and decrements in health: results from the World Health Surveys. Lancet. 2007;370(9590):851-858.

46. Egede LE. Major depression in individuals with chronic medical disorders: prevalence, correlates and association with health resource utilization, lost productivity and functional disability. Gen Hosp Psychiatry. 2007;29(5):409-416.

47. Felker B, Katon W, Hedrick SC, et al. The association between depressive symptoms and health status in patients with chronic pulmonary disease. Gen Hosp Psychiatry. 2001;23(2):56-61.

48. Katon WJ, Lin EHB, Williams LH, et al. Comorbid depression is associated with an increased risk of dementia diagnosis in patients with diabetes: a prospective cohort study. J Gen Intern Med. 2010;25(5): 423-429.

49. Gadalla TM. Association of obesity with mood and anxiety disorders in the adult general population. Chronic Dis Can. 2009;30(1):29-36.

50. Roy-Byrne PP, Davidson KW, Kessler RC, et al. Anxiety disorders and comorbid medical illness. Gen Hosp Psychiatry. 2008;30(3): 208-225.

51. Arnow BA, Blasey CM, Lee J, et al. Relationships among depression, chronic pain, chronic disabling pain, and medical costs. Psychiatr Serv. 2009;60(3):344.

52. Pols RG, Battersby MW. Coordinated care in the management of patients with unexplained physical symptoms: depression is a key issue. Med J Aust. 2008;188(12):133.

53. Dobscha SK, Corson K, Leibowitz RQ, Sullivan MD, Gerrity MS. Rationale, design, and baseline findings from a randomized trial of collaborative care for chronic musculoskeletal pain in primary care. Pain Med. 2008;9(8):1050-1064.

54. Fortin M, Bravo G, Hudon C, Vanasse A, Lapointe L. Prevalence of multimorbidity among adults seen in family practice. Ann Fam Med. 2005;3(3):223-228.

55. Simon G. Collaborative care for mood disorders. Curr Opin Psychiatry. 2009;22(1):37.

56. Kroenke K, Theobald D, Wu J, et al. Effect of telecare management on pain and depression in patients with cancer: a randomized trial. JAMA. 2010;304(2):163.