Clinical and policy decisions made using early trial results could be misguided, according to a study that found early results in chronic disease trials are often exaggerated compared with findings in subsequent trials.
Early results from clinical trials in chronic medical conditions demonstrate a treatment effect that is often larger than what is found in subsequent trials, according to new research published in Mayo Clinical Proceedings. More than 1 in 3 early clinical trials may show exaggerated results.
Researchers identified 70 meta-analyses of 930 randomized controlled trials and estimated the prevalence of the first 2 published trials having the largest effect. They discovered that the first or second studies reported an effect 2.67 times larger than what subsequent trials eventually showed. This is known as the Proteus effect.
“This phenomenon of exaggerated early results was present in a whopping 37% of the studies we reviewed,” Fares Alahdab, MD, lead author of the study and a research fellow in Mayo Clinic’s Evidence-Based Practice Center, said in a statement. “Physicians and patients should be cautious about new or early clinical trial evidence. Exaggerated results could lead to false hope as well as possibly harmful effects.”
The researchers noted that clinical and policy decisions made using the early trial results could be misguided and based on incorrect estimates. They sought to evaluate the Proteus effect and explore factors associated with the phenomenon. The factors they evaluated included sample size, total number of events, study length, length of follow-up, risk of bias, whether trials were stopped early, and study settings.
The Proteus effect was more frequently seen in studies in the field of endocrinology compared with cardiology, oncology, nephrology, or pulmonary medicine. Meta-analyses evaluating a procedure were far less likely to exhibit the Proteus effect. The phenomenon was more likely to be seen in meta-analyses evaluating a medication.
The researchers found no factors were significantly associated with the Proteus effect.
“Some people may think this is an anti-innovation message,” Murad said. “To the contrary, we welcome new treatments. We just want people to know that the benefit seen in real practice, when treatments are given to people with various comorbidities and in different settings, may be smaller than what was seen in the earliest clinical trials.”
Reference
Alahdab F, Farah W, Almasri J, et al. Treatment effect in earlier trials of patients with chronic medical conditions: a meta-epidemiologic study [published online February 21, 2018]. Mayo Clin Proc. mayoclinicproceedings.org/article/S0025-6196(17)30836-4/fulltext. Accessed February 21, 2018.
Mental Health Diagnoses, Care Challenges Rise Among US Youth, Report Finds
April 26th 2024While behavioral health care utilization has been rising, the treatment landscape has been falling. New findings show that 20% of youths did not receive any form of treatment within 3 months of their initial behavioral health diagnosis.
Read More
Examining Low-Value Cancer Care Trends Amidst the COVID-19 Pandemic
April 25th 2024On this episode of Managed Care Cast, we're talking with the authors of a study published in the April 2024 issue of The American Journal of Managed Care® about their findings on the rates of low-value cancer care services throughout the COVID-19 pandemic.
Listen
Empowering Community Health Through Wellness and Faith
April 23rd 2024To help celebrate and recognize National Minority Health Month, we are bringing you a special month-long podcast series with our Strategic Alliance Partner, UPMC Health Plan. In the third episode, Camille Clarke-Smith, EdD, MS, CHES, CPT, discusses approaching community health holistically through spiritual and community engagement.
Listen
Males With Hemophilia A Report Physical, Mental Burdens of Disease Regardless of Severity
April 25th 2024Self-reported data from adult and pediatric males with hemophilia A show that burden of the disease persists regardless of severity, highlighting a need for improved prophylactic treatment.
Read More
Insurance Coverage Limits JAKi Therapy Access for Patients With AA, Especially Non-White Populations
April 25th 2024A survey study showed major barriers to Janus kinase inhibitor (JAKi) therapy for patients with alopecia areata, especially for non-White patients who face higher rates of being uninsured and struggle more to afford the treatment.
Read More