Esteban A. Barreto, MA

 The increasing and widespread availability of personal technology offers patients and clinicians the opportunity to utilize real-time virtual communication to enhance access to health services. Understanding the perceived value of different modes of care may help to shape the future use of technology.

 Cross-sectional surveys of patients and clinicians participating in telehealth virtual video visits (VVVs) in an academic health system.

 We administered surveys to 426 unique established patients and 74 attending physicians in our hospital to measure perceptions of the comparative experience of VVVs and office visits; 254 patients and 61 physicians completed the surveys.

 When comparing VVVs and office visits, 62.6% of patients and 59.0% of clinicians reported no difference in “the overall quality of the visit.” VVVs were vastly preferred to office visits by patients for convenience and travel time. A majority (52.5%) of clinicians reported higher efficiency of a VVV appointment.

For established patients, VVVs may provide effective follow-up and enhanced convenience when compared with traditional office visits.

Telemedicine visits have been used to provide healthcare access to more remote populations. In a busy health system, telehealth visits were incorporated for established patients to allow patient—clinician interaction in a new, more convenient mode. In the first full year of patient visits in this new mode, we found that:

Patients rated these visits highly and the majority would recommend them to family and friends.

Using standard measures of patient experience, most patients and clinicians perceived no loss of communication in virtual video visits compared with office visits, although clinicians were somewhat more likely to see loss of personal connection as a problem.

Patients perceived considerable added convenience, saved travel time, and expressed willingness to pay co-payments for this visit option.

Virtual visits are an important and useful option in clinical care.

Telemedicine visits have been used in the United States to enhance access to healthcare, most notably for people who live in remote and underserved areas.

 The increasing availability of personal technology (89% have internet access, 77% are online daily

) offers patients and clinicians the opportunity to utilize real-time virtual communication to enhance access for patients when transportation challenges, schedules, or physical disability make office visits difficult in any geography.

 Although face-to-face interactions may be preferred in some circumstances by patients or clinicians, the convenience of accessing healthcare consultations from the home or office may save lost time at home or work, travel time, and missed and rescheduled appointments.

 Understanding the perceived relative value of different modes of healthcare services may help to shape the use of virtual or remote healthcare technologies.

Effective population health management is a balancing act that requires consideration of patient needs and preferences for more flexible and timely access to consultation, accountability to payers by managing high costs, and understanding how to leverage new technologies.

 System learning that demonstrates the value of different types of “visits” for the system and the patient is essential.

We initiated the Massachusetts General Hospital (MGH) TeleHealth program in 2012, offering a range of telemedicine services in 15 clinical departments. This paper describes experiences with virtual video visits (VVVs): 2-way audiovisual synchronous videoconferencing between the MGH clinician and patient. The research reported here focuses on the patient and clinician experience of a VVV in a full year of operation to understand its value and comparative experience with VVVs and office visits.

Clinicians in 5 specialties (psychiatry, neurology, cardiology, oncology, and primary care) were trained in how to provide a VVV throughout the first year and on a rolling basis. Oncology and primary care VVVs were not implemented until late in the data collection period. Clinicians offered VVVs as an option to established patients based on their professional assessment of the suitability of the mode of visit for the individual patient’s situation (eg, patient could communicate effectively in this mode, physical examination was not critical at the visit). Clinicians were compensated by MGH for conducting these VVVs because they were not covered by payers in Massachusetts. In advance of the VVV, participating patients received education, instruction, and phone-based technology support and testing for installation of the visit software. Patients were not charged insurance co-payments for the visit.

The data reported here come from surveys of patients and clinicians in the MGH TeleHealth program. This study was reviewed and approved by the Partners Health Care Office of Human Research. The surveys we employed were developed by the MGH Center for TeleHealth leadership and Mongan Institute Health Policy Center research team, including experts in survey and health services research, telemedicine, clinical medicine, and health management. We included selected patient experience measures developed by the Consumer Assessment of Healthcare Providers and Systems (CAHPS)

 and augmented with items developed for this mode of visit. Surveys were pretested with patients and refined. Key domains included technology and communication quality, visit quality and experience, patient time and costs, and willingness to pay for a VVV.

Of 426 eligible patients, 254 (60%) completed surveys using a secure web tool. Eligible patients had at least 1 VVV during the accrual period and at least 1 office visit in the 6-month period prior. Initial recruitment was by email request within 1 week of the VVV. Patients whose email addresses were not functional were contacted by postal mail or telephone. Persistent nonresponders to the survey were offered a $10 incentive after 4 weeks of attempts without reaching the patient. Patients younger than 18 years were not directly contacted; rather, surveys were sent to their parents.

Of 74 eligible clinicians (physicians, nurse practitioners, psychologists) who provided at least 1 VVV to program patients during the study period, 61 (82%) completed surveys online, with recruitment by email. An Amazon.com gift certificate valued at $50 was offered to each physician as an honorarium for participation.

The results reported here are descriptive; subgroup comparisons within patient and clinician populations use χ

 test comparisons as indicated, and analyses comparing patient and clinician responses utilize 2-sample 

 tests of the difference in proportions. All analyses were conducted using SPSS version 23 (IBM Corp; Armonk, New York).

Patient characteristics are shown in the 

). VVV patients were diverse in age and gender and were predominantly white and non-Hispanic, consistent with patient demographics in our system. Patients receiving behavioral health care are overrepresented due to the rapid uptake of VVV by those clinicians and patients. No significant differences were measured in characteristics of respondents and nonrespondents. Clinician respondents were psychologists and psychiatrists (34%), neurologists (38%), cardiologists (10%), oncologists (2%), and primary care clinicians (16%).

Patient experience with a VVV was measured in multiple items. Responses are shown in the 

 by specialty, comparing neurology and cardiology patient responses with those of the psychiatry patients (referent). We used 4 measures from the CAHPS Clinician Group visit to assess patient experience with efficiency and communication during VVVs. Overall, 80% or more respondents answered “yes, definitely” to these items; 82.3% responded “yes, definitely” to whether they would recommend VVV to their family and friends. On a scale of 0 to 10, where 0 is the worst possible visit and 10 is the best visit, 68.5% rated the visit a 9 or 10.

We asked patients to consider whether the care provided during their recent VVV could have been provided in another way and still met their needs, asking “Do you think the health issues you discussed with clinicians today could just as easily have been addressed by [insert visit mode]?” Nearly 90% of patients agreed that their issues could also have been addressed in an office visit (definitely, 70.8%; somewhat, 17.8%) and nearly 60% by telephone calls (definitely, 23.2%; somewhat, 36.7%). The results for secure email (definitely, 7.2%; somewhat, 23.5%) and text messaging (definitely, 3.6%; somewhat, 12.7%) suggest that they are less often appropriate substitutes (data not shown).

Patient and Clinician Comparisons of Office Visits and VVVs

 shows patient and clinician responses to a series of comparative questions about office visits and VVVs that were asked of both groups. Expanded data are shown in 

—one with patient data, one with clinician data&mdash;and include several items that were directed only to one group or the other.

Most patients (62.6%) and clinicians (59.0%) reported “no difference” between virtual and office visits on “the overall quality of the visit.” When rating “the personal connection felt during the visit,” 32.7% of patients and 45.9% of clinicians reported that the “office visit is better,” but more than half of the respondents (patients, 59.1%; clinicians, 50.8%) said that there was “no difference.”

 shows data on patient willingness to pay for VVV out of pocket. Patients were not initially charged co-payments. However, the majority of patients expressed a willingness to pay a co-payment of up to $50. Among those willing to bear the full cost of the VVV, more than one-third had no current co-payment and all had private (vs public) insurance. We conducted bivariate analyses of the willingness to make co-payments for VVV by both self-reported travel time and cost of attending office visits. Among those who traveled more than 90 minutes to an office visit, 51.5% indicated they would pay a co-payment of more than $50 for a VVV compared with 30.4% of those who traveled less than 30 minutes. Among patients who spent $25 or more on travel to attend an office visit, 73.2% would pay a co-payment of $26 to $50 for a VVV and 97.6% would pay a co-payment of $10 to $25 (travel data not shown).

Increased interest in new strategies for managing population health and episodic specialty care, coupled with the widespread availability of communications technologies, have encouraged the exploration of the appropriate roles of different modes of clinical encounters or visits.

 Our data—gathered from patients and clinicians during and following an initial full year of experience with the MGH Center for TeleHealth’s VVV implementation&mdash;show a high degree of patient and clinician satisfaction, as measured by both ratings of overall visit quality and willingness to recommend the visits.

VVVs are perceived by the majority of patients as the same as or better than office visits in convenience and cost, at the same level of quality and personal connection. Patients appear to value the face-to-face interactive nature of VVVs; they perceive office or telephone encounters as the main alternatives to this new type of visit, rather than email or structured questionnaires, likely because they maintain a real-time personal connection. Even though VVVs represent a great convenience, our data reinforce that they are unlikely to be a useful substitute for an in-office visit in some clinical situations—for example, those with more complexity and need for physical examination or observation. More research is needed to study the association of the care delivery modality (in-person vs telehealth) with total cost and clinical outcomes and to understand settings in which telehealth affects healthcare value.

 The regulatory, administrative, and legal environment related to the conduct of telehealth visits is in constant flux; delivery of care to established patients across state lines adds further complexity. The Chronic Care Act of 2017, enacted in 2018, takes some small steps toward relaxing reimbursement and regulatory restrictions in selected diseases and insurance markets; hopefully, this trend will continue.

Patient participants were selected for these visits by their clinicians based on their suitability, as determined during prior office visits as established patients. This was not a controlled study. These data were gathered in the first full year of VVV implementation in our system and are primarily from VVVs for a specialty, so they very likely do not fully reflect the challenges or opportunities of using VVVs in primary care settings. Surveys are subject to sources of error and bias; we attempted to minimize these with high-quality methods and response rate enhancement methods. Lastly, Massachusetts is not among the 31 states that now routinely require third-party reimbursement for telehealth visits; our health system chose to support reimbursement to clinicians. It is unknown if the level of reimbursement created positive or negative incentives. Further study is needed, including improved models to compensate clinicians, to measure and define the appropriate mix of virtual and office visits, and to understand the role of other modes of care.

With the inexorable adoption of digital offerings to meet many of the needs of today’s consumers, it is likely that telehealth will increasingly be adopted over the next several years. Our data suggest that initial experiences for patients and clinicians were positive and that, for most encounters, these VVVs are just as clinically effective and less expensive for both patient and provider compared with in-person visits. The fears of distracted, overwhelmed providers and a loss of human connection between patient and provider have been raised repeatedly with the rising use of computers in the doctor’s office. Interestingly, this issue was not a central concern to participants in our VVV program, perhaps due to the use of VVVs with established patients. These visits are not just replacements for in-office visits; they hold the possibility of new avenues for care delivery, more frequent but shorter encounters, and opportunity for earlier intervention. Further studies are needed to test different provider compensation models to measure and define the appropriate mix of virtual, office, and other modes of care and to establish appropriateness criteria for the use of telehealth encounters. These issues are all important in the further use of this technology as part of effective and efficient patient-centered care and population management.

 Telehealth should further the aims of improving the quality of healthcare and addressing the Institute of Medicine domains of quality, with special attention to overcoming existing barriers in access to care, including the burden of time and financial costs that patients and families bear in attending traditional office visits.

Mongan Institute Health Policy Center (KD, EAB, CM), MGH Center for TeleHealth (JJE, LHS), Department of Neurology (JJE, LHS), and Department of Psychiatry (JW), Massachusetts General Hospital, Boston, MA; Flare Capital Partners (SS), Boston, MA; Applied Physics Laboratory, Johns Hopkins University (ABC), Laurel, MD; Department of Neurology, Johns Hopkins Hospital and Health System (ABC), Baltimore, MD.

 Massachusetts General Hospital Institutional Funds.

 Dr Cohen is employed with and provided expert testimony for Johns Hopkins University Applied Physics Laboratory, which develops health technology, including telemedicine-related technology. Dr Wozniak’s spouse has received royalties from UpToDate; consultation fees from Advance Medical, FlexPharma, Merck, Otsuka, and Gerson Lehman Group; and research support from RLS Foundation. Dr Schwamm has received a Patient-Centered Outcomes Research Institute grant on tele—palliative care and is the director of the MGH Center for TeleHealth. The remaining authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.

 Concept and design (KD, SS, CM, JJE, ABC, JW, LHS); acquisition of data (KD, EAB, SS, CM, JJE, ABC, JW, LHS); analysis and interpretation of data (KD, EAB, SS, CM, JJE, ABC, JW, LHS); drafting of the manuscript (KD, EAB, CM, LHS); critical revision of the manuscript for important intellectual content (KD, SS, CM, JJE, ABC, JW, LHS); statistical analysis (KD, EAB, CM, JJE, ABC, JW, LHS); provision of patients or study materials (KD, SS, CM, JJE, ABC, JW, LHS); obtaining funding (KD, SS, CM, JJE, ABC, JW, LHS); administrative, technical, or logistic support (KD, SS, CM, JJE, ABC, JW, LHS); and supervision (KD, SS, CM, JJE, ABC, JW, LHS).

 Karen Donelan, ScD, EdM, Mongan Institute Health Policy Center, Massachusetts General Hospital, 100 Cambridge St, Ste 1600, Boston, MA 02114. Email: kdonelan@mgh.harvard.edu.

1. Güler NF, Übeyli ED. Theory and applications of telemedicine. 

2. Mehrotra A, Jena AB, Busch AB, Souza J, Uscher-Pines L, Landon BE. Utilization of telemedicine among rural Medicare beneficiaries. 

. 2016;315(18):2015-2016. doi: 10.1001/jama.2016.2186.

3. Perrin A, Jiang J. About a quarter of U.S. adults say they are ‘almost constantly’ online. Pew Research Center website. pewresearch.org/fact-tank/2018/03/14/about-a-quarter-of-americans-report-going-online-almost-constantly. Published March 14, 2018. Accessed July 12, 2018.

4. Perrin A, Duggan M. Americans’ internet access: 2000-2015. Pew Research Center website. pewinternet.org/2015/06/26/americans-internet-access-2000-2015. Published June 26, 2015. Accessed December 21, 2018.

5. Agha Z, Schapira RM, Laud PW, McNutt G, Roter DL. Patient satisfaction with physician-patient communication during telemedicine. 

. 2009;15(9):830-839. doi: 10.1089/tmj.2009.0030.

6. Perle JG, Langsam LC, Randel A, et al. Attitudes toward psychological telehealth: current and future clinical psychologists’ opinions of internet-based interventions. 

. 2013;69(1):100-113. doi: 10.1002/jclp.21912.

7. Polinski JM, Barker T, Gagliano N, Sussman A, Brennan TA, Shrank WH. Patients’ satisfaction with and preference for telehealth visits. 

. 2015;31(3):269-275. doi: 10.1007/s11606-015-3489-x.

8. Viers BR, Pruthi S, Rivera ME, et al. Are patients willing to engage in telemedicine for their care: a survey of preuse perceptions and acceptance of remote video visits in a urological patient population. 

. 2015;85(6):1233-1240. doi: 10.1016/j.urology.2014.12.064.

9. LeRouge CM, Garfield MJ, Hevner AR. Patient perspectives of telemedicine quality. 

Articles

Telemedicine visits may be used with established patients for follow-up care without a loss of patient satisfaction with communication with providers and with enhanced convenience and reduced travel time; a majority may be willing to pay standard co-pays or more for this convenience. Clinicians see value in this new mode of care to enhance connections with patients.

Esteban A. Barreto, MA

Articles

Patient and Clinician Experiences With Telehealth for Patient Follow-up Care