Affiliations
AffiliationItem in Clipboard
Treatment success in cancer: new cancer treatment successes identified in phase 3 randomized controlled trials conducted by the National Cancer Institute-sponsored cooperative oncology groups, 1955 to 2006Benjamin Djulbegovic et al. Arch Intern Med. 2008.
. 2008 Mar 24;168(6):632-42. doi: 10.1001/archinte.168.6.632. AffiliationItem in Clipboard
AbstractBackground: The evaluation of research output, such as estimation of the proportion of treatment successes, is of ethical, scientific, and public importance but has rarely been evaluated systematically. We assessed how often experimental cancer treatments that undergo testing in randomized clinical trials (RCTs) result in discovery of successful new interventions.
Methods: We extracted data from all completed (published and unpublished) phase 3 RCTs conducted by the National Cancer Institute cooperative groups since their inception in 1955. Therapeutic successes were determined by (1) assessing the proportion of statistically significant trials favoring new or standard treatments, (2) determining the proportion of the trials in which new treatments were considered superior to standard treatments according to the original researchers, and (3) quantitatively synthesizing data for main clinical outcomes (overall and event-free survival).
Results: Data from 624 trials (781 randomized comparisons) involving 216 451 patients were analyzed. In all, 30% of trials had statistically significant results, of which new interventions were superior to established treatments in 80% of trials. The original researchers judged that the risk-benefit profile favored new treatments in 41% of comparisons (316 of 766). Hazard ratios for overall and event-free survival, available for 614 comparisons, were 0.95 (99% confidence interval [CI], 0.93-0.98) and 0.90 (99% CI, 0.87- 0.93), respectively, slightly favoring new treatments. Breakthrough interventions were discovered in 15% of trials.
Conclusions: Approximately 25% to 50% of new cancer treatments that reach the stage of assessment in RCTs will prove successful. The pattern of successes has become more stable over time. The results are consistent with the hypothesis that the ethical principle of equipoise defines limits of discoverability in clinical research and ultimately drives therapeutic advances in clinical medicine.
FiguresFigure 1
Inclusion of trials and publication…
Figure 1
Inclusion of trials and publication rate. COG indicates cooperative group; RCT, randomized controlled…
Figure 1Inclusion of trials and publication rate. COG indicates cooperative group; RCT, randomized controlled trial.
Figure 2
Distribution of outcomes by statistical…
Figure 2
Distribution of outcomes by statistical significance of results according to primary outcome. EFS…
Figure 2Distribution of outcomes by statistical significance of results according to primary outcome. EFS indicates event-free survival; OS, overall survival; and RR, response rate.
Figure 3
Distribution of outcomes according to…
Figure 3
Distribution of outcomes according to the published judgment of the original researchers. “Breakthrough”…
Figure 3Distribution of outcomes according to the published judgment of the original researchers. “Breakthrough” treatments were defined as those that should replace the existing standard of care or that reduced the death rate by 50% or more. HR indicates hazard ratio.
Figure 4
Evaluation of treatment successes. A,…
Figure 4
Evaluation of treatment successes. A, Meta-analysis of main outcomes. B, Overall survival and…
Figure 4Evaluation of treatment successes. A, Meta-analysis of main outcomes. B, Overall survival and event-free survival according to cooperative oncology group. C, Sensitivity analysis according to type of treatment and disease. CALGB indicates Cancer and Leukemia Group B; ChOG, Children’s Oncology Groups; ECOG, Eastern Cooperative Oncology Group; GOG, Gynecological Oncology Group; NCCTG, Northern Central Cancer Treatment Group; NSABP, National Surgical Adjuvant Breast and Bowel Project; RTOG, Radiation Therapy Oncology Group; and SWOG, Southwest Oncology Group. Hazard ratios (HRs) are given for time to event data (overall survival and event-free survival) and odds ratios (ORs) for dichotomous data (response rate and treatment-related mortality). Vertical lines indicate lines of no difference between new and standard treatments. Note that a “no difference” result can be obtained when treatments are truly identical, or when experimental treatments are as successful as standard treatments (ie, sometimes new treatments are better and sometimes standard treatments are better). Squares indicate point estimates. Horizontal lines represent 99% confidence interval (CI). Asterisks indicate that the test for heterogeneity between subgroups was statistically significant at P=.05.
Figure 5
Sensitivity analysis according to the…
Figure 5
Sensitivity analysis according to the most important methodologic domains. Vertical lines indicate lines…
Figure 5Sensitivity analysis according to the most important methodologic domains. Vertical lines indicate lines of no difference between new and standard treatments. Note that a “no difference” result can be obtained when treatments are truly identical, or when experimental treatments are as successful as standard treatments (ie, sometimes new treatments are better and sometimes standard treatments are better). Squares indicate point estimates. Horizontal lines represent 99% confidence interval (CI).
Figure 6
Assessment of the pattern of…
Figure 6
Assessment of the pattern of treatment successes over time. A, Time series analysis…
Figure 6Assessment of the pattern of treatment successes over time. A, Time series analysis of treatment effect (natural logarithm of hazard ratio [ln HR]) performed by the National Cancer Institute cooperative oncology groups. “White noise” pattern indicates no significant autocorrelation between studies carried out at various time intervals. An ln HR less than 0 indicates superiority of new treatments; greater than 0, superiority of standard treatments. B, Subgroup analysis stratified by time periods, showing a slight improvement in overall survival over time, unlikely to be clinically meaningful (P for trend=.005). Vertical lines indicate lines of no difference between new and standard treatments. Note that a “no difference” result can be obtained when treatments are truly identical, or when experimental treatments are as successful as standard treatments (ie, sometimes new treatments are better and sometimes standard treatments are better). Squares indicate point estimates. Horizontal lines represent 99% confidence interval (CI).
Figure 7
Subgroup analysis stratified by time…
Figure 7
Subgroup analysis stratified by time according to type of treatment (A) and type…
Figure 7Subgroup analysis stratified by time according to type of treatment (A) and type of disease (B). Vertical lines indicate lines of no difference between new and standard treatments. Note that a “no difference” result can be obtained when treatments are truly identical, or when experimental treatments are as successful as standard treatments (ie, sometimes new treatments are better and sometimes standard treatments are better). Squares indicate point estimates. Horizontal lines represent 99% confidence interval (CI).
Figure 8
Distribution of treatment success in…
Figure 8
Distribution of treatment success in oncology. A, Although the data resemble normal distribution,…
Figure 8Distribution of treatment success in oncology. A, Although the data resemble normal distribution, the curve significantly deviates from normality (Shapiro-Wilks test: z=7.97; P<.001). B, The best fit was accomplished by using a power law function, y=A/[1+(B×x2)], where y represents the percentage of treatment success with experimental or standard treatment, and x is expressed as natural logarithm of the hazard ratio (ln HR). If ln HR is less than 0, then y predicts success of experimental treatments and vice versa. A=10.76; B=21.87; r2=95%.
Comment inPeters WP. Peters WP. Arch Intern Med. 2008 Oct 27;168(19):2172-3; author reply 2173-4. doi: 10.1001/archinte.168.19.2172-b. Arch Intern Med. 2008. PMID: 18955657 No abstract available.
Korn EL, Mooney MM, Abrams JS. Korn EL, et al. Arch Intern Med. 2008 Oct 27;168(19):2173; author reply 2173-4. doi: 10.1001/archinte.168.19.2173-a. Arch Intern Med. 2008. PMID: 18955658 No abstract available.
Crider K, Williams J, Qi YP, Gutman J, Yeung L, Mai C, Finkelstain J, Mehta S, Pons-Duran C, Menéndez C, Moraleda C, Rogers L, Daniels K, Green P. Crider K, et al. Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
Soares HP, Kumar A, Daniels S, Swann S, Cantor A, Hozo I, Clark M, Serdarevic F, Gwede C, Trotti A, Djulbegovic B. Soares HP, et al. JAMA. 2005 Feb 23;293(8):970-8. doi: 10.1001/jama.293.8.970. JAMA. 2005. PMID: 15728168 Free PMC article.
Soll RF, Ovelman C, McGuire W. Soll RF, et al. Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
Kumar A, Soares HP, Balducci L, Djulbegovic B; National Cancer Institute. Kumar A, et al. J Clin Oncol. 2007 Apr 1;25(10):1272-6. doi: 10.1200/JCO.2006.09.2759. J Clin Oncol. 2007. PMID: 17401017 Review.
Dent L, Raftery J. Dent L, et al. Trials. 2011 May 4;12:109. doi: 10.1186/1745-6215-12-109. Trials. 2011. PMID: 21542934 Free PMC article. Review.
Wenzel JA, Mbah O, Xu J, Moscou-Jackson G, Saleem H, Sakyi K, Ford JG. Wenzel JA, et al. J Racial Ethn Health Disparities. 2015 Jun;2(2):192-9. doi: 10.1007/s40615-014-0063-x. J Racial Ethn Health Disparities. 2015. PMID: 25960945 Free PMC article.
Unger JM, Blanke CD, LeBlanc M, Barlow WE, Vaidya R, Ramsey SD, Hershman DL. Unger JM, et al. JAMA Netw Open. 2020 Apr 1;3(4):e203842. doi: 10.1001/jamanetworkopen.2020.3842. JAMA Netw Open. 2020. PMID: 32352530 Free PMC article.
Vickers AJ. Vickers AJ. Trials. 2008 Jun 3;9:31. doi: 10.1186/1745-6215-9-31. Trials. 2008. PMID: 18522732 Free PMC article.
Herpers M, Dintsios CM. Herpers M, et al. Eur J Health Econ. 2019 Feb;20(1):45-57. doi: 10.1007/s10198-018-0981-3. Epub 2018 Apr 25. Eur J Health Econ. 2019. PMID: 29696458
Colli A, Pagliaro L, Duca P. Colli A, et al. Intern Emerg Med. 2014 Oct;9(7):799-804. doi: 10.1007/s11739-014-1118-z. Epub 2014 Sep 7. Intern Emerg Med. 2014. PMID: 25194693
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.3