This study aimed to develop and evaluate the psychometric properties of a scale measuring patient value co-creation behavior based on the DART (Dialogue, Access, Risk assessment, Transparency) model.
Objectives: Value co-creation focuses on customer participation and co-creates value with suppliers. Patients’ support and cooperation can improve the quality of medical care. Value creation is closely related to participants’ behavior. The DART (Dialogue, Access, Risk assessment, Transparency) model is widely used in commercial research because it defines and classifies value co-creation behavior clearly and systematically. However, there is little research using the DART model in the field of health care. This study aimed to develop and evaluate the psychometric properties of a scale measuring patient value co-creation behavior based on the DART model.
Study Design: The Delphi technique was used to determine the scale content with a panel of 17 experts. A cross-sectional survey was administered to 356 outpatients and inpatients of a hospital in Guangzhou, China.
Methods: Internal consistency reliability and composite reliability (CR) were used to estimate the scale’s reliability. Validity was assessed using convergent and discriminant validity.
Results: Three rounds of expert consultation were completed before a final consensus was reached regarding scale content. The patient value co-creation behavior scale was composed of 23 items and 4 dimensions. The overall Cronbach’s α was 0.934, and the CRs of the 4 DART dimensions were 0.843, 0.872, 0.911, and 0.884, respectively, showing satisfactory reliability. The average variance extracted ranged from 0.473 to 0.659, and the χ2 difference between constrained and free models was significant, indicating convergent and discriminant validity.
Conclusions: The scale exhibited acceptable reliability and validity and could serve as an evaluation tool for patient value co-creation behavior.
Am J Manag Care. 2020;26(9):e282-e288. https://doi.org/10.37765/ajmc.2020.88493
This study aimed to develop and evaluate the psychometric properties of a scale measuring patient value co-creation behavior based on the DART (Dialogue, Access, Risk assessment, Transparency) model.
Value co-creation emphasizes customer participation and interaction with the supplier, with the aim of reaching an outcome that benefits both sides.1,2 McColl-Kennedy et al3 defined patients’ value co-creation as the benefit that patients and medical service providers create through interaction and resources integration; they integrate operational resources (eg, knowledge and skills) and objective resources (eg, equipment, drugs, and financial resources) together to achieve common benefits. With the development of science and technology, patients have greater medical awareness through the internet. The information asymmetry between doctors and patients is shrinking. Patients can discuss and even question disease treatment plans with doctors instead of accepting them passively.1 Hau et al4 pointed out that whereas physicians are experts about diseases, patients are experts about their particular conditions and play an important role in improving treatment effects. Relevant studies showed that patients’ participation in value co-creation can inspire doctors to actively provide patients with high-quality medical services,5,6 let patients comply with treatment plans, and increase the benefits of treatment.7
Value co-creation is closely related to participants’ behavior. Thus, many instruments focus on this aspect. However, little quantitative evidence has been obtained other than that from case studies and qualitative approaches.8 Many studies adopt a multidimensional approach to capture participants’ value co-creation behavior and consider it to consist of various distinctive components,9-12 whereas other studies use only a few items to measure it.4,13
Prahalad and Ramaswamy1 proposed the DART model (Dialogue, Access, Risk assessment, and Transparency) to apply the concept of value co-creation in the business services field. It is a valuable attempt to indicate the range of companies’ capabilities necessary to work with customers effectively, and it remains the most popular framework to guide implementation of customer value co-creation.8
The DART model specifies 4 main building blocks: Dialogue refers to the process of communication and sharing of knowledge between customers and providers; Access refers to customers obtaining experience and information via information tools without having the ownership of products; Risk assessment refers to the risks that enterprises and customers are likely to face during value co-creation; and Transparency means that consumers can get a substantial amount of information through technology tools; thus, prices, costs, and profits shall not be kept opaque by the enterprises that make profit. Because the DART model defines value co-creation behavior concisely, many scholars have compiled relevant scales to measure value co-creation activities based on it.8,14-16 However, most of them have been verified in the commercial field.
In general, systematic measurement scales for value co-creation have not been developed yet in the field of health care. Although the DART model has been used in the commercial field, it has not been introduced into the field of health care extensively. During the treatment process, while doctors are bound to provide medical services, the active participation of patients in the disease treatment process can greatly improve the effectiveness of the treatment (eg, high self-motivation to search for medical information before treatment, active interaction with doctors on treatment options). Therefore, we introduce the DART model in our study, develop a patient value co-creation behavior scale (PVCBS) based on the DART model, and evaluate its psychometric properties in order to propose its use as a research and scientific evaluation tool about patient value co-creation behavior.
The preliminary concept of patient value co-creation behavior was defined by referencing related literature1,3 and discussion within the research group. Based on the preliminary connotation and considering the characteristics of the medical field, a review of the relevant instruments5,9,15,17,18 was performed to identify suitable items that could be included in the scale. After revising the items, a pool of 43 items was developed based on the DART model.
We used the Delphi technique to develop the concept of patient value co-creation behavior and the scale content. The Delphi technique is a process by which consensus for a specific purpose is arrived at through facilitation by an expert panel.19
We sent emails to approximately 140 experts who had conducted related research, published related papers, or had related working experience, in which we asked their willingness to be a consultant. If the expert agreed to participate, the questionnaire was sent by email with the instructions to evaluate the preliminary concept of patient value co-creation behavior based on the DART model and assess the items’ suitability for the scale. The experts had to rank their agreement or disagreement with each item using a 5-point Likert scale (less important to very important). If experts disagreed with the item, they indicated whether it should be modified or deleted. Experts could also suggest any modifications and make comments. Their responses were returned via email, and the data were collated, coded, and analyzed using SPSS software version 20.0 (SPSS Inc).
The expert panel consisted of 17 experts, drawn from universities, research institutes, and hospitals in China and abroad, based on their professional reputation and research domains. It included 5 scholars specializing in health management; 8 in marketing, business, and service management; 3 physicians; and 1 CEO of a research institute. The experts’ mean age was 49.93 years, mean work experience was 23.08 years, and all had a master’s degree or higher educational qualification.
The final concept of patient value co-creation behavior was constructed when agreement from more than 80% of the experts was obtained. Items were retained if more than 80% of the panel indicated agreement, or provisionally retained for the next testing rounds if the panel did not achieve consensus but less than 20% of panel members disagreed (ie, ≥ 80% of panel members agreed, strongly agreed, or were unsure).20,21 Items were further modified or deleted as deemed appropriate based on the comments provided by the expert panel and discussion among the research group. Three Delphi rounds were required to reach a final consensus on the concept of patient value co-creation behavior and the items to be included in the scale.
In terms of the final concept of patient value co-creation behavior, Dialogue refers to patients communicating and sharing knowledge with their doctors. Access means patients obtaining medical services and information about disease treatment through relevant channels or tools. Risk assessment means that patients evaluate and manage the potential dangers during treatment; it includes risk disclosure, risk selection, and risk management. Transparency refers to patients disclosing information on their conditions, and it emphasizes information authenticity and disclosure.
In terms of selection of the items, as the first-round consultation was aimed at developing a preliminary understanding of experts’ advice, most of the items were retained. We revised the items according to experts’ suggestions and discussions within the research group. Following the second round of consultation, 51 items (8 new items) were shortlisted. Twenty-eight items were deleted because they received less than 80% agreement or most of the experts thought them inappropriate, and 6 items were modified. Eleven of the deleted items were in the D (Dialogue) domain, 6 were in A (Access), 8 were in R (Risk assessment), and 3 were in T (Transparency). The expert panel found that they had little relevance to their respective dimension, and most of them were common behaviors that most patients could do.
The modified instrument was submitted to a third Delphi round to reach a final consensus. The modifications were generally minor and aimed to clarify items. For example, “I choose appropriate treatment plans provided by the doctor” was revised to “I choose treatment plans suggested by the doctor,” and “The condition that I share with my doctor is true” was revised to “I truthfully disclose my condition to the doctor.” The final instrument on the PVCBS based on the DART model contained 23 items (eAppendix A and eAppendix B [available at ajmc.com]).
Participants. A cross-sectional study was conducted in October 2019 in a tertiary hospital in Guangzhou, China. The inclusion criteria were (1) outpatients and inpatients, (2) 18 years or older, and (3) able to express their opinions. These patients were invited to participate in questionnaire investigation. Patients with dementia, psychosis, or cognitive or communicative impairments were excluded.
Investigation tool. A questionnaire was developed using the preliminary draft of the scale. It consisted of 2 parts: general information and self-evaluation of value co-creation behavior. A 5-point Likert scale was used to indicate agreement from 5, strongly agree, to 1, strongly disagree. Demographic information about respondents was collected, such as gender, age, marital status, and educational level.
Data collection. Because the PVCBS based on the DART model contained 23 items, we planned to collect 460 questionnaires (the product of 20 times 23). The outpatient and inpatient departments were surveyed according to the following classification by department: internal medicine, surgical, and others. At least 230 questionnaires were collected for inpatients and outpatients each, and about 70 questionnaires were collected across each of the 3 classified departments. Additionally, about 20 questionnaires were collected from 3 subdepartments under the 4 classified departments for inpatients and outpatients, respectively.
Prior to completing the survey, all respondents provided written informed consent, and each respondent was free to discontinue participation at any time. The questionnaires were distributed and collected in person by trained investigators. The respondents completed the questionnaires individually, and the interviewers provided explanations for any unclear items. The answers were double-checked before submission. Respondents were asked to correct or complete any missing answers. Ethical approval had been obtained from the ethics committee of the authors’ institution.
Data management.We distributed 393 questionnaires, and 378 were collected back. Data from 22 participants were excluded for 2 reasons: (1) missing responses to more than 5 items of the scale (valid questionnaire: ≥ 80% items were completed; invalid questionnaire: ≥ 20% items had missing responses) or (2) the respondent had not responded to the questionnaire seriously (eg, scores outside the normal variation or a majority of strongly agree or strongly disagree responses).21
Thus, data from 356 valid questionnaires (response rate, 90.59%) were analyzed in this study.
Statistical analysis. The reliability and validity of the PVCBS based on the DART model were evaluated. To test the internal consistency reliability, we calculated Cronbach’s α values for all constructs. A Cronbach’s α coefficient greater than 0.70 was considered satisfactory.22,23 Composite reliability (CR) and convergent and discriminant validity were tested through confirmatory factor analysis (CFA) using Amos 21.0 (IBM). The CFA model was evaluated by goodness-of-fit index (GFI) and adjusted GFI (AGFI) greater than 0.9 and root mean square error of approximation (RMSEA) values less than 0.08.8 CR is used to evaluate the consistency of latent construct indicators, namely showing the degree about measurement indicators sharing the latent variables; a CR greater than 0.70 was considered satisfactory.22
The average variance extracted (AVE) means the variation degree to which latent variables can explain the measurement indicators. It was used to determine convergent validity. When AVE reaches 0.50 or higher, the indicator variable can effectively reflect its latent variable.4,24 To check for discriminant validity, we conducted χ2 difference tests for each pair of constructs in a series of 2-factor confirmatory models. For all pairs, this research compared the constrained model, which constrained the phi coefficient to equal 1, with a free model without this constraint. In all cases, the χ2 difference was significant, indicating discriminant validity.22
All valid questionnaires were entered in duplicate into the database by 2 independent postgraduate students using the EpiData software version 3.1 (EpiData Association). Any discrepancy between the 2 operators was resolved by cross-checking the duplicate data manually and using the computer. In this study, 80% of the scale’s response rate can be considered acceptable. Missing values were replaced by mean item scores. The raw score for patient value co-creation behavior was derived by summing the item scores and converting it to a value from 0 to 100.25 It was then recalculated across the dimension as follows:
Transformed score = ([Actual raw score – Lowest possible raw score] / Possible raw score range) × 100
Among the participants in this study, 185 (52.0%) were outpatients, and 171 (48.0%) were inpatients; 184 (51.7%) were men, and 172 (48.3%) were women. The ages of the participants ranged from 18 to 80 years (mean [SD], 37.79 [14.99] years). The overall education level of the participants was relatively high: 71.6% had received junior high school education or above (Table 1).
Reliability and Validity of the Scale
The Cronbach’s α of the 4 latent variables ranged from 0.771 to 0.886 (the total investigation was 0.934), and all exceeded 0.70, indicating satisfactory internal consistency reliability.
We set the CFA model based on the theoretical structure of the scale. The χ2 was 640.495; df, 224; GFI, 0.843; AGFI, 0.807; and RMSEA, 0.072 with a 90% CI of 0.066 to 0.079. Most indexes met or were near the criteria; thus, the model was acceptable. The fit indices suggested an adequate fit of the model to the data (Figure).
CRs ranged from 0.843 to 0.911, exceeding 0.70. The AVEs of the 5 latent variables ranged from 0.473 to 0.659, with most being near or above 0.50.
For assessing discriminant validity, a χ2 difference test was performed on the constrained model, which constrained the phi coefficient to equal 1, with a free model without this constraint. In all cases, the χ2 difference was significant, indicating satisfactory discriminant validity (Table 2 and Table 3).
Scores of Patient Value Co-creation Behavior
Table 4 shows the values of patient value co-creation behavior scores. The mean value of the total score of patient value co-creation behavior was 83.16, and the average scores of all dimensions were higher than 70. The highest mean value (87.69) was observed for Transparency, followed by Risk assessment, Dialogue, and Access.
Many relevant studies indicate that the quality of medical care can be improved through joint efforts by doctors and patients.4-7 Although the DART model has been widely accepted in the commercial field, relevant studies in the field of health care are few.
In this study, we introduce the value co-creation theory and DART model into the field of health care. After 3 rounds of Delphi consultation with 17 experts, we established the 23-item PVCBS based on the DART model. A cross-sectional study was conducted with patients (both inpatients and outpatients) at a tertiary-level hospital in Guangzhou, China, to evaluate the applicability of the scale.
The reliability (internal consistency reliability and CR) and validity (convergent and discriminant validity) of the scale were tested. To test the internal consistency reliability, we calculated Cronbach’s α values, for which a value greater than 0.7 is acceptable.22,23 The study results show that Cronbach’s α correlation coefficients of the whole questionnaire (0.934) and the 4 dimensions (Dialogue, 0.788; Access, 0.837; Risk assessment, 0.886; Transparency, 0.771) meet the criterion. The CRs of the D, A, R, and T dimensions were 0.843, 0.872, 0.911, and 0.884, respectively, and fulfilled the minimal criterion of 0.70,22 indicating good CR. The AVEs of the 4 dimensions were near or above the criterion of 0.50.4,24 This is comparable with that seen when enterprises implement a value co-creation process based on the DART model.14,15 In all cases, the χ2 difference was significant, indicating acceptable convergent and discriminant validity. Similar results were found in a survey about customers’ value co-creation behavior22 and a survey about value co-creation activities of enterprises based on the DART model.16 Therefore, the PVCBS based on the DART model demonstrates proper repeatability and validity, indicating that the DART model is acceptable to measure patient value co-creation behavior.
The total score of patient value co-creation behavior was 83.16. The mean scores of dimensions D, R, and T were higher than 80. Self-evaluation scores of patient co-creation behavior were high, which might be related to most of the respondents being young (18-40 years) and well educated (junior high school education or higher). Most of them could participate in value co-creation actively. This is similar to the results from related studies which showed that patients who are young and with high educational background will participate in the treatment process actively.26-28 In terms of dimension scores, that of Transparency was the highest, whereas that of Access was the lowest. The Transparency dimension emphasizes information authenticity and disclosure, such as patients disclosing their condition and answering doctor’s questions truthfully or asking doctors about their health care (eg, reasons for taking drugs, prices of the services). The results showed that most of the patients were willing to disclose their condition and answer questions truthfully. Access refers to patients obtaining medical services and information through relevant tools, such as consulting with doctors and other patients actively to gain more information about diseases. The lowest evaluation score showed that patients still need to improve related behavior.
The findings suggest that hospitals or doctors aiming for patient satisfaction can pursue this based on the 4 dimensions. For instance, they can organize health lectures to increase patient medical literacy, so patients can improve their ability to participate in treatment discussions with their doctors. During treatment, doctors can communicate with patients frequently in order to encourage them to cooperate actively.
There were a few limitations to this study. First, although the interviewers received uniform training, their explanations of the questionnaire items may have influenced the results. Second, because the subjects were selected from only 1 tertiary hospital, the results cannot be generalized to the entire population of patients in mainland China. Therefore, further studies should be conducted in multiple regions and in different types of hospitals to evaluate patient value co-creation behavior more fully.
Our study defined the concept of patient value co-creation behavior systematically, which lays a theoretical foundation for empirical research. The psychometric properties of the PVCBS based on the DART model were satisfactory, suggesting that the scale provides a reliable tool to evaluate patient value co-creation behavior accurately. However, further large-scale investigations are necessary before the findings can be applied widely to specific interventions.
Author Affiliations: School of Health Management, Southern Medical University (SMM, DW), Guangzhou, China; School of Stomatology and Medicine, Foshan University (SWS), Foshan, China.
Source of Funding: This study was funded by a grant from Philosophy and Social Sciences of Guangdong College for the project “Public Health Policy Research and Evaluation” Key Laboratory (2015WSYS0010) and a grant from the Public Health Service System Construction Research Foundation of Guangzhou (2018-2020).
Author Disclosures: The authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (SMM, DW); acquisition of data (SMM); analysis and interpretation of data (SMM); drafting of the manuscript (SMM); critical revision of the manuscript for important intellectual content (SMM, SWS, DW); statistical analysis (SMM); obtaining funding (DW); administrative, technical, or logistic support (SWS, DW); and supervision (SWS, DW).
Address Correspondence to: Dong Wang, PhD, School of Health Management, Southern Medical University, 1023 Shatai Rd, Guangzhou 510515, China. Email: email@example.com.
1. Prahalad CK, Ramaswamy V. Co-creating unique value with customers. Strategy Leadersh. 2004;32(3):4-9. doi:10.1108/10878570410699249
2. Vargo SL, Lusch RF. Evolving to a new dominant logic for marketing. J Mark. 2004,68(1):1-17. doi:10.1509/jmkg.184.108.40.20636
3. McColl-Kennedy JR, Vargo SL, Dagger TS, Sweeney JC, van Kasteren Y. Health care customer value cocreation practice styles. J Serv Res. 2012;15(4):370-389. doi:10.1177/1094670512442806
4. Hau LN, Tram Anh PN, Thuy PN. The effects of interaction behaviors of service frontliners on customer participation in the value co-creation: a study of health care service. Serv Bus. 2017;11(2):253-277. doi:10.1007/s11628-016-0307-4
5. Osei-Frimpong K, Wilson A, Lemke F. Patient co-creation activities in healthcare service delivery at the micro level: the influence of online access to healthcare information. Technol Forecast Soc Change. 2018;126:14-27. doi:10.1016/j.techfore.2016.04.009
6. Gill L, White L, Cameron ID. Service co-creation in community-based aged healthcare. Manag Serv Qual. 2011;21(2):152-177. doi:10.1108/09604521111113447
7. Martin LR, Williams SL, Haskard KB, DiMatteo MR. The challenge of patient adherence. Ther Clin Risk Manag. 2005;1(3):189-199.
8. Mazur J, Zaborek P. Validating DART model. Int J Manag Econ. 2014;44(1):106-125. doi:10.1515/ijme-2015-0012
9. Luu TT. CSR and customer value co-creation behavior: the moderation mechanisms of servant leadership and relationship marketing orientation. J Bus Ethics. 2019;155(2):379-398. doi:10.1007/s10551-017-3493-7
10. Agrawal AK, Rahman Z. CCV scale: development and validation of customer co-created value scale in e-services. Curr Psychol. 2019;38(3):720-736. doi:10.1007/s12144-017-9639-z
11. Ranjan KR, Read S. Value co-creation: concept and measurement. J Acad Mark Sci. 2016;44(3):290-315. doi:10.1007/s11747-014-0397-2
12. Hsieh PL. Encounters in an online brand community: development and validation of a metric for value co-creation by customers. Cyberpsychol Behav Soc Netw. 2015;18(5):286-295. doi:10.1089/cyber.2014.0524
13. Morosan C, DeFranco A. Co-creating value in hotels using mobile devices: a conceptual model with empirical validation. Int J Hosp Manag. 2016;52:131-142. doi:10.1016/j.ijhm.2015.10.004
14. Taghizadeh SK, Jayaraman K, Ismail I, Rahman SA. Scale development and validation for DART model of value co-creation process on innovation strategy. J Bus Ind Mark. 2016;31(1):24-35. doi:10.1108/JBIM-02-2014-0033
15. Albinsson PA, Perera BY, Sautter PT. DART scale development: diagnosing a firm’s readiness for strategic value co-creation. J Mark Theory Pract. 2016;24(1):42-58. doi:10.1080/10696679.2016.1089763
16.Ren JF, Xu J, Liang XH . Development of inter-enterprise value co-creation scale based on DART model. Article in Chinese. Jinan J (Philos Soc Sci). 2014;36(4):93-102.
17. Sweeney JC, Danaher TS, McColl-Kennedy JR. Customer effort in value cocreation activities. J Serv Res. 2015;18(3):318-335. doi:10.1177/1094670515572128
18. Chen SC, Raab C. Construction and validation of the customer participation scale. J Hosp Tour Res. 2017;41(2):131-153. doi:10.1177/1096348014525631
19. Sumsion T. The Delphi technique: an adaptive research tool. Br J Occup Ther. 1998;61(4):153-156. doi:10.1177/030802269806100403
20. Green B, Jones M, Hughes D, Williams A. Applying the Delphi technique in a study of GPs’ information requirements. Health Soc Care Community. 1999;7(3):198-205. doi:10.1046/j.1365-2524.1999.00176.x
21. Wang D, Xing XH, Wu XB. The healthy lifestyle scale for university students: development and psychometric testing. Aust J Prim Health. 2012;18(4):339-345. doi:10.1071/PY11107
22. Yi Y, Gong T. Customer value co-creation behavior: scale development and validation. J Bus Res. 2013;66(9):1279-1284. doi:10.1016/j.jbusres.2012.02.026
23. Ahmadizadeh MJ, Ebadi A, Sirati Nir M, Tavallaii A, Sharif Nia H, Lotfi MS. Development and psychometric evaluation of the Treatment Adherence Questionnaire for patients with combat post-traumatic stress disorder. Patient Prefer Adherence. 2019;13:419-430. doi:10.2147/PPA.S175353
24. Hsieh YC, Chiu HC, Tang YC, Lin WY. Does raising value co-creation increase all customers’ happiness? J Bus Ethics. 2018;152(4):1053-1067. doi:10.1007/s10551-016-3293-5
25. Wang D, Ou CQ, Chen MY, Duan N. Health-promoting lifestyles of university students in Mainland China. BMC Public Health. 2009;9(1):379-387. doi:10.1186/1471-2458-9-379
26. McKee MM, McKee K, Winters P, Sutter E, Pearson T. Higher educational attainment but not higher income is protective for cardiovascular risk in Deaf American Sign Language (ASL) users. Disabil Health J. 2014;7(1):49-55. doi:10.1016/j.dhjo.2013.07.001
27. Newsome A, Sieber W, Smith M, Lillie D. If you build it, will they come? a qualitative evaluation of the use of video-based decision aids in primary care. Fam Med. 2012;44(1):26-31.
28. Levinson W, Kao A, Kuby A, Thisted RA. Not all patients want to participate in decision making: a national study of public preferences. J Gen Intern Med. 2005;20(6):531-535. doi:10.1111/j.1525-1497.2005.0088.x