Results suggest that this scalable model of Hospital at Home is safe, feasible, highly satisfactory, and may be associated with substantial reductions in hospital readmissions.
Objectives: To evaluate the safety, feasibility, and efficacy of a substitutive Hospital at Home (HaH) model where physician care was provided via 2-way biometrically enhanced tele-video for a 34-day care episode.
Study Design: Prospective, nonrandomized, quasi-experiment.
Methods: Using medical record and patient survey data, we compared patients cared for in HaH (n = 50) versus the traditional acute care hospital (n = 52).
Results: Patients in HaH had substantial contact with the HaH physician, as well as in-person visits with nurse practitioners and other care providers. HaH patients were more satisfied with their care in multiple domains and met illness-specific quality standards at similar rates to hospital comparison patients. Functional outcomes were notable for a trend toward improvements in activities of daily living among HaH patients. Compared with hospital patients at 90 days after discharge, HaH patients were less likely to experience a hospital readmission (adjusted odds ratio, 0.39; 95% CI, 0.21-0.72).
Conclusions: This pilot study suggests that a scalable substitutive model of HaH using biometrically enhanced 2-way tele-video, virtual physician visits, and caring for patients over a 34-day episode is safe, feasible, highly satisfactory, and may be associated with substantial reductions in hospital readmissions.
Am J Manag Care. 2015;21(10):675-684
Hospital care is not only expensive, but can be unsafe for patients with iatrogenic complications, with adverse events being common.1-5 Previous literature has found that the Hospital at Home (HaH) model provides hospital-level care in the home as a substitute for acute hospital admission (substitutive HaH), and when compared with usual hospital care, is associated with better outcomes in multiple domains.6-13 Further, a meta-analysis of randomized, controlled trials of substitutive HaH use demonstrates a 38% reduction in mortality compared with usual hospital care.14
Scaling and implementing HaH on a widespread basis is a challenge.15 HaH was implemented widely in Victoria State, Australia, where it provides a volume of services equivalent to a 500-bed hospital.16 In the United States, the Johns Hopkins Hospital at Home has been implemented in several Veterans Affairs hospitals and an integrated delivery system17-19; however, widespread implementation has been limited by payment, attitudinal, and scalability issues. Widely adopted, HaH could make a significant contribution toward achieving the Triple Aim for healthcare: better patient outcomes, a better system of service delivery, and lower costs.
Models of substitutive HaH that provide substantial physician care do so in the form of in-home physician visits. Methods to deliver the physician component of HaH care in a scalable manner could improve the ability to widely implement HaH. High-quality, 2-way, real-time, biometrically enhanced tele-video capabilities now allow for in-home evaluation of patients via a virtual physician. The goal of this paper is to evaluate the safety, feasibility, and efficacy of a scalable, substitutive HaH model that followed patients for 34 days and used virtual physician visits, and remote biometric monitoring.
The target sample was English-speaking, community-dwelling adults 18 years and older, living in a specific geographic catchment area, who required acute hospital admission for 1 of the target conditions and who met clinical and social stability criteria, which were based on previously validated Hospital at Home medical eligibility criteria.20 The target conditions were exacerbation of chronic obstructive pulmonary disease (COPD) or congestive heart failure (CHF), deep vein thrombosis (DVT), asthma, or community-acquired pneumonia. The most common reasons for medical ineligibility were severe hypoxemia, active cardiac ischemia, uncontrolled arrhythmia, end-stage cancer, or other conditions that required intubation or extreme interventions. The most common social stability ineligibility criteria were impaired cognitive and ambulatory status and inadequate support care at home.
The study was conducted at Advocate Christ Medical Center, a 695-bed community-based tertiary hospital in Oak Lawn, Illinois. It is part of the Advocate Health Care system, which is Illinois’ largest healthcare provider and includes 12 acute care hospitals and over 250 sites of care.
The study was a prospective, quasi-experiment. Treatment group patients were recruited between February and October of 2010. Patients meeting HaH admission criteria were identified in the emergency department (ED) or observation unit Monday through Friday. An independent physician, who was blind to group assignment, assessed all patients to validate that they would have required acute hospital admission in the absence of HaH.
Comparison patients were recruited between July 2010 and January 2011. These patients met HaH eligibility requirements, but were admitted to the hospital at times when HaH was not accepting patients (ie, outside of HaH hours or beyond the HaH recruitment period). In order to assure that the groups were as equivalent as possible, an independent physician also assessed all comparison cases to ensure they would have met HaH eligibility, as described by Leff et al,20 had the program been open for recruitment during their contact with the hospital.
Intervention: The Hospital at Home, Central Station, and Home Monitoring Station
The current HaH model of care was based on the previously described Johns Hopkins Hospital at Home model,7,21 but introduced 2 innovations. First, it employed a “central station” and home monitoring station that allowed physicians to make virtual, rather than in-person, home visits to patients. This also allowed for remote and continuous monitoring of patients by the care team. Physical in-home visits were made by nurse practitioners and physician assistants. The Central Station was a fully capable call center with 2-way tele-video and voice capability; it also had security, privacy, and patient data redundancy with multiple system backups. The Home Monitoring Station allowed the Central Station to connect fully to patients’ homes through a standard telephone land line and for continual monitoring of vital signs, 2-way tele-video conferencing for patient/provider/caregiver interactions, and facilitated responses to situations of clinical concern. Biometric measures were obtained using wireless devices (ie, pulse oximetry, blood pressure, pulse, and weight scales), and when activated, they automatically sent information through a hub to a website (which was linked to the Central Station). Patients received Personal Emergency Response System wristlets that allowed for immediate connection to emergency care. If a scheduled vital sign was not obtained, the system alerted the Central Station prompting a care coordinator call. If there was no response, 911 was called.
The second innovation was for HaH to assume responsibility for a 34-day episode of care, which consisted of an acute and a transition phase. In the acute phase, hospital-level care commensurate with illness acuity was provided. The “greeter,” a licensed practical nurse, visited the patient at home immediately after their return from the hospital. Greeters made final assessments of the adequacy of patients’ home safety and support, installed and introduced patients and caregivers to the home-based technology, reinforced their training, and activated the Home Monitoring Station. Patients received needed diagnostic studies and therapeutics in the home, including intravenous fluids and medications, oxygen therapy, nebulized bronchodilators and respiratory therapies, and basic radiography and ultrasound. Illness-specific protocols and checklists provided caremaps, which integrated care from multiple providers (ie, hospital, central station, primary care, and home) and allowed for patient-centered, individualized care. Caremaps provided a clinical infrastructure modeled from the airline industry, with checklists, redundancies around potential failure points, and feedback loops. Virtual physician visits were provided using the central station 2-way tele-video system. Physical home visits were made on the day following admission and on day 3 of the admission, in addition to whenever clinically indicated. Licensed practical nurse care coordinators, in coordination with the HaH physician, followed up on all details of care delivery and care coordination. The timing of discharge from acute phase was analogous to discharge from the traditional acute hospital, and then care shifted into the transition phase.
In the transition phase of HaH, patients had daily contacts alternating between the HaH physician via tele-video monitoring and the care coordinator via telephone until their first visit with their primary care physician (PCP). Nurse practitioners or physician assistants were available to make home visits at the request of HaH physicians, if clinically indicated. When patients saw their PCP, the HaH physician transferred case authority back to patients’ PCPs. However, after the visit with the PCP and through day 34 of the admission, at least once a week—and as frequently as every other day, depending on the support required—care coordinators would call patients using scripted protocols to track clinical issues. Positive or concerning findings were communicated to PCPs; such findings would be acted upon by the HaH physician if the PCP could not be reached. For patients who refused follow-up care with their PCP, the approach was modified and they were monitored daily by the Central Station staff until the end of the transition phase. At the conclusion of the transition phase, the patient was fully discharged from HaH care and a final report summarizing the transition phase of care was sent to their PCP.
Medical Record Reviews and Baseline Interview
Medical records were abstracted using a standardized instrument that captured baseline sociodemographic and medical characteristics, as well as treatments received and the patient’s hospital course, including complications of care. Study subjects completed a baseline interview that included sociodemographic characteristics, living arrangements, and functional status.
All adult patients presenting to the ED of Advocate Christ Medical Center during the hours of 8 am to 6 pm Monday through Friday were screened for participation in the study if they had a chief complaint that was suggestive of one of the target diagnoses. The decision that a patient required hospital admission for a target condition was made by nonstudy ED personnel. Patients determined to require admission were then assessed for eligibility for HaH by a study-associated practitioner; for eligible patients, HaH Central Station physicians performed final assessments of patients’ eligibility for HaH care. After confirming study eligibility, the Central Station physician spoke by phone with the patient’s PCP to confirm that but for the existence of the HaH the patient would otherwise have been admitted to the acute care hospital and to obtain their assent to admit the patient to HaH. Patients were transferred home after informed written consent was obtained (usually by family members).
Process-of-care outcome measures included time spent in the ED prior to going home or to a hospital bed, the number and duration of contacts with HaH providers for each program phase, the number of visits by other provider types during the acute phase, and whether illness-specific standards of care were met.
Clinical outcome measures included length of stay (LOS) in the acute phase of care, the percent of patients who received various medical services, initial disposition upon discharge from acute care, and mortality. Patients’ functional status was measured by using a summary score of Katz’ activities of daily living ([ADL] range 0 to 6),22 and Lawton-Brody’s instrumental activities of daily living ([IADL] range 0 to 8).23 Data regarding patient’s functional status were collected from the patient at the time of enrollment and via phone interviews at 7, 30, and 90 days. Patient satisfaction with care was measured by using a modified version of the Client Satisfaction Questionnaire (CSQ-8)24,25 augmented with 7 questions targeting the unique aspects of HaH at 7 days after enrollment using a 1 to 5 Likert scale (1 = strongly disagree, 5 = strongly agree). A summary score was derived as a mean score for all questions on the instrument.
Health service utilization at 30 and 90 days after discharge from the acute phase of HaH or after discharge from the acute hospital was assessed using a modified version of the Services Assessment for Children and Adolescents26,27 and Advocate Health System administrative data.
Descriptive statistics presented as sums, means, standard deviations, or percentages were used for demographic and health status measures. An unpaired t test was used to compare patient’s satisfaction with care, and a 2-way repeated measures ANOVA was used to assess patients’ functional status (ADLs and IADLs) at baseline, 7 days, 30 days, and 90 days. Baseline characteristics and illness quality measures were analyzed using Student’s t test for continuous data and χ2 or Fisher’s Exact test for the categorical data. The odds of experiencing readmission to the hospital at 30 and 90 days by study group were modeled using logistic regression analysis adjusted for age, gender, and comorbidity index. All analyses were conducted using SPSS version 19.0 (SPSS Inc, Chicago, Illinois).
Approval and Safety Monitoring
The Advocate Health Care Institutional Review Board approved the study. Written informed consent was obtained from all study subjects. A Data Safety Monitoring Board met twice during the study to review patient experiences, data, and safety.
In the HaH group, 3402 patients with qualifying presenting complaints were screened. Of these, 2678 were immediately excluded because they came from a nursing home, lived outside the HaH geographic catchment area, or were admitted at times when HaH did not accept admissions. Another 651 patients (86%) were ineligible for HaH for either medical or social indications. Additionally, 53 (51%) refused HaH care. This resulted in a final HaH group comprised of 50 patients (49%) that provided research consent and were treated in HaH. In the hospital comparison group, similar proportions of patients were ineligible for HaH (79%) and refused data collection (53%), leaving 52 patients in the hospital comparison group. The (available at www.ajmc.com) depicts patient flow and data availability by study group.
describes the baseline characteristics of participants. Overall, patients were Caucasian, with low acuity levels, a moderate burden of comorbid illness, and a modest level of functional impairment. There were no significant differences in sociodemographic characteristics between groups. Exacerbation of COPD and episodes of community-acquired pneumonia were the most common admission diagnoses. Groups were comparable on ADLs but the HaH group reported more impairment on IADLs. The ED observation unit provided 58% of admissions to HaH, while 85% of comparison patients were admitted to the hospital directly from the ED (P <.001). Time spent in the ED prior to admission was similar for the 2 groups and had a mean of 405 minutes.
provides details on the types, quantity, and duration of HaH provider contact sessions with patients during the acute and transition phases of an HaH admission. Patients received substantial provider input during their experience in HaH, and only 5 patients—2 in the acute phase and 3 in the transition phase—required physical/occupational therapy. There was a statistically nonsignificant trend toward a shorter mean LOS during the acute phase of HaH and traditional hospital care (3.64 vs 4.31 days, respectively; P = .088). Due to the availability and frequent contact of the Central Station staff and physicians, 911 was called only 7 times: 2 in the acute phase and 5 in the transition phase. Illness-specific standards of care reported by the hospital and system for acute hospital admission were met with similar frequency in both groups and are described in .
compares patient satisfaction experienced by patients in each of the study groups. Participants in the HaH group had better satisfaction in multiple domains, as well as a higher overall satisfaction score (4.40 vs 4.01; P = .001). In particular, there was statistically significant better satisfaction with staff, convenience for caregivers, and comfort, convenience, and safety for patients.
compares the functional, clinical, and health service utilization outcomes. There were no statistically significant differences in functional outcomes with regard to ADL or IADL status between study groups, but there was a statistically nonsignificant trend toward better ADL outcomes at 90 days in HaH (P = .064). Rates of clinical complications were equivalent between groups. HaH patients were less likely to receive specialty consultations or difficult procedures than patients treated in the hospital. Two patients were transferred from HaH to complete their acute admission in the hospital and did well clinically. HaH patients were less likely to be discharged from acute care to a skilled nursing facility or inpatient rehabilitation facility (0% vs 12%; P = .027)
Health service utilization following acute care discharge was notable for lower use of a skilled nursing facility or inpatient rehabilitation among HaH patients at 30 days (2 % vs 13 %; P = .026) and 90 days (4% vs 19%; P = .013). The odds of readmission occurring among HaH-treated patients compared with hospital patients adjusted for age, gender, and Charlson comorbidity index at 30 and 90 days, respectively, was 0.45 (95% CI, 0.19-1.08) and 0.39 (95% CI, 0.21-0.72).
The goal of this paper is to evaluate the safety, feasibility, and efficacy of a scalable, substitutive HaH model that followed patients for 34 days and used virtual physician visits and remote biometric monitoring. To our knowledge, based on our comprehensive global literature search, this is the first study of its kind. Results of this pilot suggest that this model is feasible, safe, and efficacious for patients with COPD, CHF, DVT, asthma, and community-acquired pneumonia who are deemed to be stable clinically (defined in the eAppendix Table). HaH patients experienced comparable clinical outcomes to those admitted to the hospital. Satisfaction with HaH was better in multiple domains compared with acute hospital care, and specific features (ie, less caregiver burden, HaH equipment, greeter) were rated at high levels. Condition-specific quality metrics were achieved at high rates. Notably, the risk of hospital readmission for HaH-treated patients at 90 days was significantly lower than those in the usual care group.
The innovations introduced in this HaH model have important implications for dissemination and implementation of the model. To date, dissemination of HaH in the United States has been limited by attitudinal, payment, and scalability issues. Attitudinal issues usually focus on the assumption that hospital care is safe and that providing acute care in the home setting is inherently inferior, despite data from multiple randomized controlled trials suggesting the opposite.14 Payment issues have also been a barrier. In the United States, there is no payment for HaH care in fee-for-service models, which makes adoption difficult. The ability of HaH to provide virtual physician visits and continual remote monitoring improves the ability to achieve scale. A virtual physician visit is not limited by geography or time spent traveling from home to home; subsequently, these physicians can care for a significantly greater number of patients than an in-person HaH physician. The virtual nature of this model also refutes the idea that HaH patients are not “monitored” or “observed.” Both patients and clinicians reported being satisfied with this modality of interaction.
Another innovation in this pilot was managing all HaH admissions for a 34-day episode of care. This is important given the associated reduction in hospital readmissions at 90 days. We hypothesize that a number of factors contributed to this outcome, including providing care over an extended timeframe, having time to address patients’ multiple conditions, building trust and paying attention to issues of care transition with the knowledge that comes from having cared for a patient at home, and ensuring timely follow-up with the patient’s physician. This study is unique within the HaH models in its use of the virtual physician and the extended episode of care. Unlike other HaH studies, it showed a reduction in hospital readmission rate. An Italian-based HaH model for patients with COPD demonstrated a reduction in readmission of approximately 50% at 6 months.13 Compared with previous HaH studies, however, we did not find reductions in the rates of clinical complications.
There are several important limitations to this study. First, this quasi-experimental study inherits the limitations of nonequivalent groups design. Although we took several steps to produce groups that were comparable, because we did not use random assignment, differences in outcomes may be attributable to selection bias. For example, more patients in the comparison group were recruited in the observation unit (85%) than in the HaH group (58%), which could indicate a clinical difference in the groups or a result of the HaH recruitment process. Second, the intervention and comparison groups were not accumulated in precisely the same timeframes, and this may have introduced an additional element of bias. Third, assessment of post acute health service utilization was limited to patient survey and Advocate Health System administrative data. We did not use a full claims data approach, and it is possible that our data did not fully capture complete postacute health service utilization. Fourth, the generalizability of the study’s results is limited by the fact that only 5 acute diagnoses were included, and that the majority of patients were clinically stable, did not require physical/occupational therapy visits, and were selected from a single medical center. Future research is needed for assessing the safety, feasibility, and efficacy of the HAH model in patients with other diagnosis, higher levels of severity, and that require physical/occupational therapy.
Lastly, we did not report on the costs of providing HaH care compared with usual care. Previous studies28 of the Hopkins HaH demonstrated lower total costs of care; however, the focus of this report was on the safety, feasibility, and efficacy of this novel HaH model. Included in this study were patients covered by a variety of payers, including commercial fee-for-service, Medicare fee-for-service, and both Medicare and non-Medicare managed care. The variety of payers and small sample size limited our ability to develop reasonable costing estimates. Nevertheless, as a pilot study of this innovative program that required launching and implementation, we felt a need to keep it small. We feel that in the scalable model, we would expand the clinical indications as well as the geographic catchment area and would achieve a greater number of patients served by the program.
In conclusion, we found that an HaH model using virtual physician visits, implementing remote biometric monitoring, and taking care of clinically stable patients with COPD, CHF, DVT, asthma, and community-acquired pneumonia over an episode of acute and postacute care was feasible, safe, and efficacious. Patients in this study received successful care at home, avoided unnecessary hospital-related costs, and achieved lowered readmission rates. This model may be the most scalable HaH model described to date; however, it is in need of further field testing.
Author Affiliations: Advocate Health Care (WTS, SS, KC), Downers Grove, IL; Intersection LLC (AR, DC), Westport, CT.
Source of Funding: This pilot study was internally and solely supported by Advocate Health Care, Downers Grove, IL.
Author Disclosures: Portions of this study were presented at the Clinical and Translational Research and Education Meeting, April 2011, and at the Annual Advocate Research Forum, May 2011. Hospital at Home (HaH) is a United States registered servicemark. Drs Summerfelt and Sulo and Ms Catanzano are employees of Advocate Health Care, which has 20% equity in the newly formed company to disseminate the HaH Model. Dr Chess, chairman of the Clinical Advisory Committee, was paid to develop and implement a scalable HaH model, and has less than 1% interest in Clinically Home, which is an inactive company. The remaining authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (WTS, AR, DC, KC); acquisition of data (WTS, SS, AR, KC); analysis and interpretation of data (WTS, SS, AR, DC); drafting of the manuscript (WTS, SS, AR, DC); critical revision of the manuscript for important intellectual content (WTS, SS); statistical analysis (WTS, SS); provision of patients or study materials (DC, AR, KC); obtaining funding (WTS, DC, KC); administrative, technical, or logistic support (SS, AR, KC); supervision (WTS, SS, AR, DC, KC); and patient care (KC).
Address correspondence to: Wm. Thomas Summerfelt, PhD, Vice President, Department of Research, Advocate Health Care, 3075 Highland Pkwy, Ste 600, Downers Grove, IL 60515. E-mail: email@example.com.
1. Covinsky KE, Palmer RM, Fortinsky RH, et al. Loss of independence in activities of daily living in older adults hospitalized with medical illnesses: increased vulnerability with age. J Am Geriatr Soc. 2003;51(4):451-458.
2. Covinsky KE, Pierluissi E, Johnston CB. Hospitalization-associated disability: “she was probably able to ambulate, but I’m not sure.” JAMA. 2011;306(16):1782-1793.
3. Zhan C, Miller MR. Excess length of stay, charges, and mortality attributable to medical injuries during hospitalization. JAMA. 2003;290(14):1868-1874.
4. Caplan GA, Coconis J, Board N, Sayers A, Woods J. Does home treatment affect delirium? a randomised controlled trial of rehabilitation of elderly and care at home or usual treatment (The REACH-OUT trial). Age Ageing. 2006;35(1):53-60.
5. McAvay GJ, Van Ness PH, Bogardus ST Jr, et al. Older adults discharged from the hospital with delirium: 1-year outcomes. J Am Geriatr Soc. 2006;54(8):1245-1250.
6. Harris R, Ashton T, Broad J, Connolly G, Richmond D. The effectiveness, acceptability and costs of a hospital-at-home service compared with acute hospital care: a randomized controlled trial. J Health Serv Res Policy. 2005;10(3):158-166.
7. Leff B, Burton L, Mader SL, et al. Comparison of functional outcomes associated with hospital at home care and traditional acute hospital care. J Am Geriatr Soc. 2009;57(2):273-278.
8. Caplan GA, Ward JA, Brennan NJ, Coconis J, Board N, Brown A. Hospital in the home: a randomised controlled trial. Med J Aust. 1999;170(4):156-160.
9. Leff B, Burton L, Mader SL, et al. Hospital at home: feasibility and outcomes of a program to provide hospital-level care at home for acutely ill older patients. Ann Intern Med. 2005;143(11):798-808.
10. Leff B, Burton L, Mader SL, et al. Satisfaction with hospital at home care. J Am Geriatr Soc. 2006;54(9):1355-1363.
11. Leff B, Burton L, Mader SL, et al. Comparison of stress experienced by family members of patients treated in hospital at home with that of those receiving traditional acute hospital care. J Am Geriatr Soc. 2008;56(1):117-123.
12. Ricauda NA, Bo M, Molaschi M, et al. Home hospitalization service for acute uncomplicated first ischemic stroke in elderly patients: a randomized trial. J Am Geriatr Soc. 2004;52(2):278-283.
13. Aimonino Ricauda N, Tibaldi V, Leff B, et al. Substitutive “hospital at home” versus inpatient care for elderly patients with exacerbations of chronic obstructive pulmonary disease: a prospective randomized, controlled trial. J Am Geriatr Soc. 2008;56(3):493-500.
14. Shepperd S, Doll H, Angus RM, et al. Avoiding hospital admission through provision of hospital care at home: a systematic review and meta-analysis of individual patient data. CMAJ. 2009;180(2):175-182.
15. Leff B. Defining and disseminating the hospital-at-home model. CMAJ. 2009;180(2):156-157.
16. Montalto M. The 500-bed hospital that isn’t there: the Victorian Department of Health review of the Hospital in the Home program. Med J Aust. 2010;193(10):598-601.
17. Mader SL, Medcraft MC, Joseph C, et al. Program at home: a Veterans Affairs Healthcare Program to deliver hospital care in the home. J Am Geriatr Soc. 2008;56(12):2317-2322.
18. Landers SH. Why health care is going home. N Engl J Med. 2010;363(18):1690-1691.
19. Foubister V. Hospital at Home program in New Mexico improves care quality and patient satisfaction while reducing costs. Commonwealth Fund website. http://www.commonwealthfund.org/Newsletters/Quality-Matters/2011/August-September-2011/Case-Study.aspx. Published 2011. Accessed November 20, 2011.
20. Leff B, Burton L, Bynum JW, et al. Prospective evaluation of clinical criteria to select older persons with acute medical illness for care in a hypothetical home hospital. J Am Geriatr Soc. 1997;45(9):1066-1073.
21. Leff B, Burton L, Guido S, Greenough WB, Steinwachs D, Burton JR. Home hospital program: a pilot study. J Am Geriatr Soc. 1999;47(6):697-702.
22. Katz S, Ford AB, Moskowitz RW, Jackson BA, Jaffe MW. Studies of illness in the aged. the index of ADL: a standardized measure of biological and psychosocial function. JAMA. 1963;185:914-919.
23. Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9(3):179-186.
24. Attkisson CC, Greenfield TK. The Client Satisfaction Questionnaire-8 and the Service Satisfaction Questionnaire-30. In: Maruish ME (ed). The Use of Psychological Testing for Treatment Planning and Outcome Assessment. Hillsdale, NJ: L. Erlbaum Associates; 1994:402-420.
25. Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979;2(3):197-207.
26. Stiffman AR, Horwitz SM, Hoagwood K, et al. The Service Assessment for Children and Adolescents (SACA): adult and child reports. J Am Acad Child Adolesc Psychiatry. 2000;39(8):1032-1039.
27. Horwitz SM, Hoagwood K, Stiffman AR, et al. Reliability of the services assessment for children and adolescents. Psychiatr Serv. 2001;52(8):1088-1094.
28. Frick KD, Burton LC, Clark R, et al. Substitutive Hospital at Home for older persons: effects on costs. Am J Manag Care. 2009;15(1):49-56.