A networked system designed to promote patient self-management appears to be safe and effective in capturing, integrating, and presenting medication adherence and physiologic information.
To gain early experience with a networked system designed to assess a patient’s adherence to oral medication and physiologic metrics in an ambulatory, at-home setting.
Prospective, observational studies.
Materials and Methods:
This networked system for patient self-management consists of ingestible markers and a wearable, personal monitor. When a marker is ingested, it communicates to a monitor that time-stamps the ingestion and identifies the marker as unique. The monitor also records heart rate and activity. Data from third-party monitoring equipment (eg, sphygmomanometer, weight scale) can be integrated into the system. Collected data are summarized for patient and physician review. Directly observed ingestion (DOI) of placebo tablet markers was used to assess the system’s technical performance. Markers were also coencapsulated with drugs to capture at-home adherence. A performance criterion of ≥95% was set as the objective for system performance.
A total of 111 subjects ingested 7144 ingestible markers; 3298 were DOIs. The system’s positive detection accuracy and negative detection accuracy in detecting ingested markers were 97.1% and 97.7%, respectively. It differentiated 100% of multiple drugs and doses taken simultaneously by type and by dose. Medication adherence was >85%. The most common adverse effect was mild skin rash from the monitor’s electrodes. No definitive marker-related adverse effects were reported.
The system appears to be safe and effective in capturing and integrating adherence and physiologic data. Efforts are under way to enhance system functionalities and refine user interfaces. By providing context-rich information, this system may enhance patient-provider collaboration.
(Am J Manag Care. 2011;17(7):e277-e287)
Early clinical experience with a networked system consisting of ingestible markers (integrated with oral medications to capture at-home adherence patterns) and a wearable, personal monitor indicates that this system appears to be safe and effective in capturing, integrating, and presenting medication adherence and physiologic information.
The World Health Organization has characterized poor adherence to treatment as a worldwide problem affecting developing as well as developed countries. In the United States, it is estimated that one-third to one-half of all patients do not take their medications properly.1 Patients who do not take their medications as prescribed cost the US healthcare system an estimated $290 billion in avoidable medical spending annually.2 The World Health Organization considers adherence to be the single modifiable factor that compromises treatment outcome across diseases. It has called for an evolution of the health systems to provide patient-tailored interventions to address poor adherence and to consider the patient’s family, community, and affiliated organizations to be key contributors to success in improving medication adherence.1
Barriers that patients face in taking their medications have been studied extensively.3-7 Typical reasons cited by patients for not taking their medications include forgetfulness (30%), other priorities (16%), deliberate decision to omit doses (11%), lack of information (9%), and emotional factors (7%).7 These barriers to adherence oftentimes can be improved upon or overcome by patient efforts independent of providers or other members of the healthcare system. Thus, a necessary and important first step in improving adherence is to provide attention and aid to patients.
Barriers to adherence are also related to poor interactions and/or communication between the patient, the healthcare providers, and the healthcare system. Traditionally, physicians and designated healthcare workers have played a key role in achieving adherence by providing the rationale for treatment to their patients, and involving family and caregivers whenever possible. However, it is time and resource intensive for providers to assess and influence adherence alone on a timely and ongoing basis. There remains an unmet need for a reliable and broadly utilizable means to accurately assess and manage a patient’s medication adherence.
An ideal system for improving adherence would not only engage the patients themselves, but also leverage their selected health providers, caregivers, and communal support network. The system would also allow a secure exchange of reliable and robust information among patients and clinical decision and support systems.2 By utilizing the latest medical technology, patients could be empowered in a novel way to promote self-management of their chronic conditions, beginning with better management of their adherence.
The purpose of this report is to discuss the early clinical experience with a networked system for promoting patient self-management. This system is designed to utilize unique ingestible markers that confirm the ingestion of individual oral medications and doses, to integrate this adherence data with physiologic parameters and wellness metrics, to offer patientdirected sharing of health information with caregivers and providers, and to incorporate individualized behavioral support tools. Some of the above mentioned functionalities have been implemented and evaluated in 4 separate clinical studies of 4 populations; early safety and technical performance results are presented.
MATERIALS AND METHODS
A Networked System
A networked system has been developed to electronically confirm adherence to oral medication, to acquire physiologic metrics periodically and remotely, and to gather and present this information in a comprehensive, centralized manner8-15 (). Briefly, upon ingestion, the ingestible marker dissociates from the medication or carrier within the stomach and is activated by stomach fluids. The marker then begins communicating its unique signature to the wearable, personal monitor. This data communication scheme is similar to what a heartbeat does in transmitting an electrocardiogram to the surface of the body. The communication process is unnoticed by, and not detected beyond, the system user. The personal monitor interprets the information from the marker, identifies it as unique, and stores the marker ingestion event to the memory of the monitor. Periodically, the personal monitor transfers the collected data to a mobile phone, which relays the data to a secure server. Once validated at the server level, adherence and physiologic data can be viewed via a Web browser on a computer or a mobile phone. The system components are described in detail below.
Ingestible Marker-Enabled Medication. The system utilizes ingestible markers that are incorporated into oral medication to electronically confirm medication adherence. The ingestible marker is considered biocompatible and toxicologically safe. It is 1 mm x 1 mm in size, and it is coated with a copper salt on one side and magnesium on the other. The levels of silicon, copper, magnesium, minerals, and cellulose present in the marker are far below the levels commonly present in the diet. The ingestible marker is also designed to be compatible with the formulation of oral pharmaceuticals. Upon ingestion, the marker is activated by gastric fluids and communicates a unique identifying signature to the personal monitor. The marker is currently designed to communicate for approximately 7 minutes. After that, the communication ceases and the marker becomes completely inactive; it goes through normal gastric transit and is eliminated from the body via fecal elimination.
Personal Monitor. The personal monitor serves 2 purposes. First, it records the identifying signatures from the ingestible marker-enabled medications and time-stamps the drug taken, its dose, and its time of ingestion. Second, it has internal markers that are capable of reporting metrics such as heart rate, respirations, activity, body position, and monitor-wearing compliance. The current iteration of the personal monitor is a miniaturized, soft foam, skin-patch device measuring 5 cm x 11 cm x 1 cm. It is capable of recording a variety of physiologic parameters and periodically transmitting stored data to a computing device via Bluetooth telemetry. It adheres to the torso of a subject in a similar fashion to an adhesive bandage.
Peripheral Wireless Devices. In addition to adherence and physiologic data collected by the ingestible markers and the personal monitor, other metrics can be collected and integrated into the networked system using peripheral wireless devices. A wireless sphygmomanometer, weight scale, and base station can be set up at a patient’s home. When a blood pressure or weight measurement is made, it is sent to the base station and subsequently to a centralized, secure data server via a phone or Internet connection. At the server level, data from these peripheral wireless devices are integrated with those from the ingestible markers and the personal monitor, to provide a comprehensive view of a patient’s physiologic and wellness profile. Data from other telemetric devices (eg, glucometer) may also be integrated with the system in this manner.
Mobile Phone, Web-Based Patient Communication. Once data are aggregated, they can be disseminated to appropriate stakeholders. Data can be securely viewed using a Web-based platform. Summary reports can be generated and shared with the patients. In the next-generation system, data could be sent to the patients directly, discreetly, and securely via a Web-based or mobile phone platform. With the patient’s permission, the same set or a subset of the gathered data could be shared with the persons they designate, including family members, caregivers, and/or healthcare providers.
To gather comprehensive information regarding system use, 4 separate small-scale, prospective, observational studies were conducted in 4 populations over a course of 19 months. Each of the 4 studies targeted a specific patient subject population including healthy volunteers and patients with tuberculosis (TBC), heart failure (HF), and hypertension (HTN). Studies were conducted at 5 clinical sites in the United States: 2 were clinical research organizations and 3 were outpatient clinics. Studies were approved by institutional review boards at Chesapeake Research Review, Inc, Western Institutional Review Board, University of North Texas Health Science Center, and Independent Review Consulting, Inc. Studies were routinely monitored by the sponsor according to Good Clinical Practice guidelines.
Study candidates were recruited through advertisement and referrals. In general, candidates identified for inclusion in the study were those who were willing to adhere to study procedure, had the capacity to provide informed consent, and for women of childbearing age, had a negative urine pregnancy test. Study candidates were excluded if they had acute or chronic gastrointestinal symptoms, terminal illness, known allergies that could preclude safe participation in the study, or current presence of an electronically active implanted medical device (except in the HF population study), or if they were participating or had participated in any clinical trial (drug or device) <30 days prior to study start.
Since each study targeted a particular subject population with specific procedural requirements, additional inclusion and exclusion criteria were implemented. summarizes these specific subject selection criteria. Study subjects were enrolled after providing written, informed consent per the International Conference on Harmonisation Guideline for Good Clinical Practice.
Two main objectives were common to all 4 studies. First, the networked system safety, including ingestible marker ingestion and personal monitor wearing, was evaluated. Secpropriate ondly, the technical performance of the networked system was characterized. Namely, the reliability of the system in detecting ingestible marker ingestions was compared with a gold standard: directly observed ingestion.
In addition to the main objectives described above, a number of corollary aims were unique to each study and subject population. The purpose of including these study aims was to expand the scope of the technical assessment of the networked system. The study aims and the population(s) that these aims were evaluated in were (1) to assess the effect of body mass index (BMI) on ingestible marker detection in all studies, (2) to assess the effect of meal type on ingestible marker detection in healthy users, (3) to characterize the effect of the ingestible marker carrier form factor on marker detection in all studies, (4) to characterize the unsupervised, at-home adherence pattern using marker-enabled medications in HF and HTN patients, and (5) to demonstrate the use of peripheral wireless devices for additional physiologic monitoring in HF and HTN patients.
To achieve the main objectives described above, several procedures were implemented and repeated in each study. First, a safety assessment was conducted in each protocol by evaluating the frequency and nature of the adverse events (AEs) occurring during the active and the follow-up phases of the study. An AE was defined as “any undesirable medical event occurring in a subject, whether or not the event is considered related to the investigational device.” Study investigators were asked to document and classify all AEs based on severity and relatedness to the study device and procedure.
Second, investigators periodically conducted direct observation of marker ingestions to assess the system’s accuracy in detecting marker ingestion. While at the clinic, subjects were instructed to ingest 2 to 4 markers in the presence of research personnel, who would observe and log each ingestion. Both functional and some nonfunctional markers were administered, to evaluate the positive detection accuracy and negative detection accuracy of the system, respectively. The system’s identification accuracy—the ability to correctly identify the unique identifier of the ingested device—was also assessed.
To address the corollary study aims, specific procedures were conducted. Subjects’ height and weight were recorded at enrollment to assess the effect of BMI on marker detection accuracy. Healthy subjects were given meals and beverages designed by a dietician prior to marker ingestion, to evaluate the effects of meal composition on system performance. Markers were delivered on a placebo tablet ingested alone, on a placebo tablet coingested with medication, or attached to a capsule body containing medication in these studies, to assess the impact of the marker carrier form factor on detection. In the HF and HTN studies, subjects’ prescribed furosemide and valsartan were marker enabled to capture subjects’ unsupervised, at-home medication adherence pattern using the networked system. Wireless devices including blood pressure cuff and weight scale were distributed to the subjects for use, to evaluate the system’s ability to integrate peripheral health monitoring equipment.
In these 4 studies, the active study participation duration varied from 2 to 42 days with periodic visits at the clinic with the study coordinators. The safety follow-up period ranged from 5 to 21 days, depending on the duration of study participation.
To characterize the technical performance of the networked system, a number of outcome measures were defined and assessed. The key outcome measures are summarized in .
Moreover, to focus primarily on ingestible marker in vivo activation and detectability in these early feasibility studies, the technical evaluation of positive detection accuracy (PDA) and negative detection accuracy (NDA) excluded instances where (1) data were collected from subjects during training prior to the observation phase, (2) there were user errors in properly activating monitor prototypes prior to marker ingestion, (3) there were malfunctions in prototype software or hardware, or (4) placement or location of the monitor prototype was unsatisfactory, as indicated by a measured electrode impedance of 1000 ohms or greater.
The system’s PDA, NDA, and identification accuracy were calculated for ingestible marker ingestions administered at directly observed ingestion across all subjects. All measurements were assumed to be independent. A 95% confidence interval (CI) was determined using the method of Clopper-Pearson (an exact method). When appropriate, descriptive statistics including number, mean, median, standard deviation, minimum, maximum, and 95% CI were presented. The association of a covariate of interest and the PDA was assessed by using the Wald X2 from the mixed model for repeated measures. The level of statistical significance was set at .05.
A total of 111 subjects, including 30 healthy volunteers, 30 patients with TBC, 8 patients with HF, and 43 patients with HTN, were enrolled in a series of 4 clinical studies. Results from all 111 subjects were used in the safety assessment of the networked system. Of the 111 subjects, data from 103 (92.8%) met protocol specification and were used in the technical assessment of the system. Study subjects’ demographic and baseline characteristics are summarized in .
A total of 7144 ingestible markers were ingested by this 111-subject cohort. The number of days that personal monitors were worn per study ranged from 2 to 42 days per protocol. The number of markers ingested per day ranged from 2 to 36 markers per protocol. Of the 7144 ingestible marker ingestions, 604 (8.5%) ingestions were excluded from technical evaluation of PDA and NDA based on the criteria defined above. A total of 6540 marker ingestions were analyzed: 3298 (50.4%) were administered in a directly observed ingestion setting, and 3242 (49.6%) were taken by the subjects in an unsupervised at-home setting, using a marker-enabled medication form.
Safety Assessment of the Networked System
A safety assessment was conducted per protocol. Records from 111 enrolled subjects were reviewed; 69 AEs were reported by 45 subjects. Of the 69 AEs, 67 (97.1%) were nonserious, and the 2 (2.9%) serious adverse events were both unrelated to the study procedure or device. No unanticipated device AEs were observed. The majority of the AEs (82.6%) were mild in nature. About 55% of the reported AEs were deemed by the study investigators to be either related or possibly related to the device. The most commonly observed device-related AEs were described as mild skin rash associated with the adhesive electrodes of the personal monitor placed on a subject’s body. No definitive ingestible marker-related AEs were observed.
Technical Assessment of the Networked System
Directly Observed Ingestion. Using the results from directly observed ingestion, the overall networked system’s PDA in detecting ingestible markers was 97.1% (95% CI 96.5%-97.7%, n = 3298 marker ingestions by 103 subjects). The system’s NDA was 97.7% (95% CI 94.8%-99.3%, n = 221 marker ingestions by 55 subjects). The unique identifiers of the detected markers were verified against those of the actual ingested device. The system’s identification accuracy was 100% (95% CI 99.9%-100%, n = 2641 marker ingestions by 55 subjects). The networked system technical performance results are summarized in .
In each of the 4 study populations, BMI was consistently found to be not significantly associated with PDA. In the study conducted in healthy volunteers, 4 meal types were evaluated, including liquid/no food, carbohydrate-rich, protein-rich, and lipid-rich diet. They were found not to be significantly associated with PDA (P = .151). Three methods of marker ingestion were utilized in the studies: (1) ingestible marker on a placebo tablet ingested alone, (2) ingestible marker on a placebo tablet coingested with medication, and (3) ingestible marker attached to a capsule body containing medication inside. The system demonstrated high PDA of 96.7% or above across ingestion methods, as shown in .
Unsupervised, at-Home Ingestion. In the study with HF and HTN patients, the networked system was used to capture the subjects’ unsupervised, at-home medication adherence pattern using marker-enabled drugs. The system was successful in identifying the medication ingested by analyzing the unique identifiers of the detected markers. The system detected, time-stamped, and differentiated the ingestion of one 20-mg furosemide capsule from two 20-mg capsules, ingestion of an 80-mg valsartan from a 160-mg valsartan, and also the ingestion of up to 3 simultaneously ingested marker-enabled capsules. In the 8-subject HF patient cohort, the mean taking adherence (see Table 3; taking adherence is also known as “dose count”) and scheduling adherence (see Table 3; scheduling adherence is also known as “dose time”) were 85.4% (median, minimum, and maximum were 86.0%, 67.0%, and 98.5%) and 68.5% (median, minimum, and maximum were 82.5%, 10.8%, and 89.3%), respectively. In the 40-subject HTN patient cohort, the mean taking and scheduling adherence were 90.0% (median, minimum, and maximum were 92.5%, 44.1%, and 100%) and 82.8% (median, minimum, and maximum were 88.6%, 12.7%, and 100%), respectively.
In addition to using marker-enabled medication, subjects in the HF and HTN studies were asked to take 2 blood pressure measurements (morning and nighttime) and 1 weight measurement (morning) daily, utilizing the wireless sphygmomanometer and weight scale provided. On average the subjects took 83.8% and 92.0% of the blood pressure and weight measurements prescribed, respectively. Data collected by these peripheral wireless devices were successfully integrated into the networked system, to be displayed side-by-side with the subject’s medication adherence behavior characterized via ingestible markers. An example of a subject’s comprehensive 7-day data report is shown in .
Having improved knowledge of a patient’s adherence is advantageous to healthcare providers, because it could potentially influence clinical decision making. When providers are able to distinguish between pharmaceutical underdosing, low pharmaceutical concentrations, ineffectiveness despite being adherent, and misleadingly acceptable pharmaceutical concentrations related to periodic adherence, they can determine whether ongoing therapeutic management should focus upon improving medication adherence, dose adjustment, drug substitution, or polypharmacy. Objective and accurate adherence data could have a critical impact on a patient’s treatment road map for his or her chronic condition.
Of the methods currently used to improve adherence to medication treatment, the most reliable has been directly observed therapy: namely, watching a patient swallow each dose of medication. Directly observed therapy has been widely used in the treatment of TBC and HIV.16,17 Although highly reliable when performed appropriately, directly observed therapy is resource intensive, time consuming, and costly, incurring an average incremental cost of about $1400 over that for selfadministered therapy.18 Alternative, indirect methods such as patient questioning, pill counts, and prescription refill rate monitoring have been used for assessing adherence. However, data obtained with these methods have been shown to be subjective and inaccurate.19 Electronic monitors that record the opening of a medication bottle cap could be used as a surrogate measure for drug dosing. However, this methodology does not offer a direct association between electronic cap opening and actual drug intake, particularly in situations where more than 1 dose or no dose is taken per each electronic cap opening event, or when a patient opens the medication bottle for refilling purposes. Moreover, no adherence data are captured when a patient uses medication from a bottle without the electronic monitor cap.20-23 The use of multiple electronic caps to confirm adherence to multiple drugs has also been shown to be too burdensome to be practical.24
Some clinical studies have considered rates of more than 80% to be acceptable for pharmaceutical adherence, whereas others consider rates of more than 95% to be mandatory for adequate adherence, particularly among patients with serious conditions such as HIV infection.7 The networked system described in this report exceeded the minimum performance criterion of 95% that was set for the PDA and NDA of detecting pharmaceutical ingestion when compared with directly observed therapy. This novel system represents a significant improvement on existing methods for confirming adherence. System usage, particularly ingestible marker ingestion, appears to be safe, with very few minor adverse events reported. The current system iteration demonstrated an overall 97.1% reliability in ingestible marker detection when compared with direct observation. The system also showed 100% accuracy in decoding the marker’s unique identifier.
While further system refinements are under way to improve PDA and NDA, the current achievement indicates that the networked system could be a valuable tool capable of reporting actual medication ingestion date, time, and drug information including type, dose, and manufacturing details. The current system could be useful in characterizing a patient’s adherence trend and pattern. As the system matures over time, it could provide more sophisticated features such as pill-by-pill monitoring, and reminders could be sent to a patient when a medication dose is not detected by a set time.
One of the novel features of using the ingestible markers to capture oral medication ingestion is that the communication is private. The method of marker communication to the personal monitor is similar to that of electrocardiography, where the individual is the communication pathway and communication of a heartbeat to the electrocardiograph is confined to the body. The unique signature of the ingestible marker is not broadcast in any way; the communication process is unnoticed by and not detectable beyond the system user. Furthermore, the adherence data gathered by the ingestible markers can be juxtaposed with physiologic and behavioral information collected by the personal monitor, peripheral wireless devices, and any other data source with a time stamp. The comprehensive data set offered by the networked system may provide new insights to the patients about their health and lifestyle, and may empower them to find new ways to achieve and sustain wellness.
Fundamentally, the information gathered by the networked system belongs to the patient user; he or she has the right to determine whether or not and with whom to share this information. To maintain privacy and to mitigate the risk of accidentally disseminating these health-related data to unintended parties, high-quality data exchange infrastructure must be implemented to allow individuals to discreetly and securely share their information. Such infrastructure could be modeled after financial and social systems, where credit card and social networking Web sites are now ubiquitous and allow millions of individuals to conduct transactions and share personal information with selected parties. Similar approaches should be feasible for care and wellness systems. Information sharing is powerful and could elicit support and new insights. A patient sharing information with family members, caregivers, and friends may gain communal encouragement in achieving wellness. A patient sharing information with healthcare providers may allow providers to truly individualize care.
The studies presented had some limitations. These were pilot investigations with small sample sizes and were of short duration; the system usability and user acceptability of the networked system for long-term, repeated use remain unknown, and these are areas of ongoing work. An early clinical trial version of the system was utilized in these studies, which led to some user errors and subsequent exclusion of data from analysis. A more mature version of the system shall be evaluated to further validate and confirm the performance of the system. Moreover, the study protocol required patient subjects to attend weekly clinic visits for study material replenishment and data collection. The study procedural requirements along with the potential Hawthorne effect might bias the results regarding medication adherence and system use compliance. Finally, the system PDA and NDA were assessed via repeated observations of the same subjects. To accurately quantify these metrics, additional independent observations from a wide range of user subjects are needed.
Despite these limitations, the networked system was demonstrated to be capable of capturing adherence electronically and acquiring physiologic data in an ambulatory, at-home setting. System enhancements are under way to increase the functionality of the system and to optimize it for everyday use. The unique identifier field of the ingest ible marker will be expanded such that every dose of any medication will be given a globally unique signature, allowing true unit-level identification of pharmaceuticals. Additional sensing modalities are also being developed for the ingestible marker. These additions will transform the ingestible marker from a simple marker of ingestion to a multifunctional data collection platform. The functionality of the personal monitor is also being expanded to further increase physiologic measurement. The future personal monitor will resemble a small, disposable electronic bandage.
A networked system has been developed to document actual ingestions of oral medications, to differentiate the types and doses of drugs simultaneously, and to provide these data along with physiologic information to patients and their designated persons as a potential aid for tailoring individual care. Early clinical studies have demonstrated that system safety appears to be satisfactory; gathering, integrating, and communicating of multiple data streams appear to be feasible. Perhaps the most exciting area for future system enhancement lies in data visualization, utilization, and user experience optimization to allow patients to gain insights into their own wellness and to provide them with useful tools to achieve and sustain health. Building upon current trends in behavioral research, self-actualization, and human-centered design, the networked system has the potential to become a comprehensive platform for exploring the relationship between objective health data and individual wellness.
Author Affiliations: From Proteus Biomedical, Inc (KAY, GDM, TLR, LAD), Redwood City, CA; Digestive Disorders Associates (MSE), Annapolis, MD; University of North Texas Health Science Center (SEW), Fort Worth; Denver Public Health TB Clinic (RRR), CO; Cardiovascular Medicine & Cardiac Arrhythmias (GE), Palo Alto, CA.
Funding Source: The clinical studies reported in this manuscript were funded by Proteus Biomedical, Inc. A clinical grant was received from Novartis International AG to study the use of the networked system in a hypertension population.
Author Disclosures: Drs Au-Yeung, Moon, DiCarlo, and Robertson report being employed by Proteus Biomedical, Inc, the funder of this study, and also report holding stock in the company. Dr Robertson reports being the holder and inventor of core technologies for networked systems. Dr Epstein and Dr Weis report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article. Dr Reves reports that grant funding was received by his employer for conducting research related to this study. Dr Engel reports that payments were received by his medical practice for research directly related to this manuscript.
Authorship Information: Concept and design (KAY, GDM, TLR, LAD, MSE, SEW, RRR); acquisition of data (KAY, GDM, TLR, MSE, SEW, RRR, GE); analysis and interpretation of data (KAY, GDM, TLR, LAD, MSE, SEW, RRR); drafting of the manuscript (KAY, LAD, SEW); critical revision of the manuscript for important intellectual content (KAY, LAD, GE); statistical analysis (KAY); provision of study materials or patients (TLR, RRR, SEW, GE); obtaining funding (GDM); administrative, technical, or logistic support (GDM, TLR, SEW); supervision (TLR, LAD, RRR); and study investigator (MSE).
Address correspondence to: Kit Yee Au-Yeung, PhD, Proteus Biomedical, Inc 2600 Bridge Parkway, Suite 101, Redwood City, CA 94065. E-mail: email@example.com.
1. World Health Organization. Adherence to Long-Term Therapies: Evidence for Action. whqlibdoc.who.int/publications/2003/9241545992. pdf. Published 2003. Accessed June 20, 2011.
2. New England Healthcare Institute. Thinking outside the pillbox: a system-wide approach to improving patient medication adherence in chronic disease. http://www.nehi.net/publications/44/thinking_outside_the_pillbox_a_systemwide_approach_to_improving_patient_medication_adherence_for_chronic_disease. Published August 12, 2009. Accessed January 12, 2010.
3. Black HR. Will better-tolerated antihypertensive agents improve blood pressure control? JNC VI revisited. Am J Hypertens. 1999;12(12, pt 3):225S-230S.
4. Elliott WJ, Maddy R, Toto R, Bakris G. Hypertension in patients with diabetes. Overcoming barriers to effective control. Postgrad Med. 2000; 107(3):29-32, 35-36, 38.
5. Golin CE, Liu H, Hays RD, et al. A prospective study of predictors of adherence to combination antiretroviral medication. J Gen Intern Med. 2002;17(10):756-765.
6. Ickovics JR, Meade CS. Adherence to HAART among patients with HIV: breakthroughs and barriers. AIDS Care 2002;14(3):309-318.
7. Osterberg L, Blaschke T. Adherence to medication. N Engl J Med. 2005;353(5):487-497.
8. Au-Yeung K, Intondi A, Abdel-Aleem S, et al. A novel system for electronically confirming adherence to tuberculosis therapy. Paper presented at: 9th Annual World Health Care Congress; April 12, 2010; Washington, DC.
9. Au-Yeung K, Intondi A, Abdel-Aleem S, et al. A novel ingestible microsensor system for characterizing adherence to prescribed medication. Paper presented at: Society of General Internal Medicine 33rd Annual Meeting; April 30, 2010; Minneapolis, MN.
10. Belknap R, Luna L, Reves R, et al. Feasibility of a microchip-based system for electronically observed tuberculosis therapy. Paper presented at: American Thoracic Society International Conference; May 14, 2010; New Orleans, LA.
11. Intondi A, Behzadi Y, Beaulieu, et al. A novel edible sensor system for electronically confirming oral pharmaceutical therapy. Paper presented at: American College of Clinical Pharmacology 39th Annual Meeting; September 14, 2010; Baltimore, MD.
12. Moon G, Hafezi H, Frank J, et al. Pre-clinical experience with an edible sensor system for electronically confirming oral pharmaceutical therapy. Paper presented at: American College of Clinical Pharmacology 39th Annual Meeting; September 14, 2010; Baltimore, MD.
13. Au-Yeung K, Intondi A, Abdel-Aleem S, et al. Early experience with a novel system for enhancing patient-physician collaboration in hypertension management. Paper presented at: 23rd Scientific Meeting of the International Society of Hypertension; September 30, 2010; Vancouver, British Columbia, Canada.
14. Au-Yeung K, Robertson T, Hafezi H, Moon G, DiCarlo L. A networked system for self-management of drug therapy and wellness. Paper presented at: Wireless Health 2010; October 6, 2010; La Jolla, CA. http://portalparts.acm.org/1930000/1921081/fm/frontmatter.pdf. Accessed July 13, 2011.
15. DiCarlo L, Au-Yeung K, Behzadi Y, et al. A networked system for promoting patient self-management of drug therapy and wellness. Paper presented at: mHealth Summit 2010; November 8, 2010; Washington, DC.
16. Alwood K, Keruly J, Moore-Rice K, Stanton DL, Chaulk CP, Chaisson RE. Effectiveness of supervised, intermittent therapy for tuberculosis in HIV-infected patients. AIDS. 1994;8(8):1103-1108.
17. Weis SE, Slocum PC, Blais FX, et al. The effect of directly observed therapy on the rates of drug resistance and relapse in tuberculosis. N Engl J Med. 1994;330(17):1179-1184.
18. Snyder DC, Chin DP. Cost-effectiveness analysis of directly observed therapy for patients with tuberculosis at low risk for treatment default. Am J Respir Crit Care Med. 1999;160(2):582-586.
19. Laine C, Newschaffer CJ, Zhang D, Cosler L, Hauck WW, Turner BJ. Adherence to antiretroviral therapy by pregnant women infected with human immunodeficiency virus: a pharmacy claims-based analysis. Obstet Gynecol. 2000;95(2):167-173.
20. Bova CA, Fennie KP, Knafl GJ, Dieckhaus KD, Watrous E, Williams AB. Use of electronic monitoring devices to measure antiretroviral adherence: practical considerations. AIDS Behav. 2005;9(1):103-110.
21. Wendel CS, Mohler MJ, Kroesen K, Ampel NM, Gifford AL, Coons SJ. Barriers to use of electronic adherence monitoring in an HIV clinic. Ann Pharmacother. 2001;35(9):1010-1015.
22. Olivieri NF, Matsui D, Hermann C, Koren G. Compliance assessed by the Medication Event Monitoring System. Arch Dis Child. 1991;66(12): 1399-1402.
23. Young-Xu Y, Chan KA. Pooling overdispersed binomial data to estimate event rate. BMC Med Res Methodol. 2008;8:58.
24. Wu JR, Moser DK, Chung ML, Lennie TA. Objectively measured, but not self-reported, medication adherence independently predicts event-free survival in patients with heart failure. J Card Fail. 2008;14(3):203-210.