Affiliations
AffiliationsItem in Clipboard
The Scientific Impact of Positive and Negative Phase 3 Cancer Clinical TrialsJoseph M Unger et al. JAMA Oncol. 2016.
. 2016 Jul 1;2(7):875-81. doi: 10.1001/jamaoncol.2015.6487. AffiliationsItem in Clipboard
AbstractImportance: Positive phase 3 cancer clinical trials are widely hailed, while trials with negative results are often interpreted as scientific failures. We hypothesized that these interpretations would be reflected in the scientific literature.
Objective: To compare the scientific impact of positive vs negative phase 3 cancer clinical treatment trials.
Design, setting, and participants: We examined the phase 3 trial history of SWOG, a national cancer clinical trials consortium, over a 30-year period (1985-2014). Scientific impact was assessed according to multiple publication and citation outcomes. Citation data were obtained using Google Scholar. Citation counts were compared using generalized estimating equations for Poisson regression. Any trial that was formally evaluated for the randomized treatment comparison was included for analysis of publication and citation outcomes. Trials were categorized as positive if they achieved a statistically significant result in favor of the new experimental treatment for the protocol-specified primary end point. Trials were categorized as negative if they achieved a statistically significant result in favor of standard therapy or a null result with no statistically significant benefit for either the experimental or standard therapy.
Main outcomes and measures: Impact factors for the journals publishing the primary trial results, and the number of citations for the primary trial articles and all secondary articles associated with the trials.
Results: Ninety-four studies enrolling n = 46 424 patients were analyzed. Twenty-eight percent of trials were positive (26 of 94). The primary publications from positive trials were published in journals with higher mean (SD) 2-year impact factors (28 [19] vs 18 [13]; P = .007) and were cited twice as often as negative trials (mean per year, 43 vs 21; relative risk, 2.0; 95% CI, 1.1-3.9; P = .03). However, the number of citations from all primary and secondary articles did not significantly differ between positive and negative trials (mean per year, 55 vs 45; relative risk, 1.2; 95% CI, 0.7-2.3; P = .53).
Conclusions and relevance: The scientific impact of the primary articles from positive phase 3 randomized cancer clinical trials was twice as great as for negative trials. But when all of the articles associated with the trials were considered, the scientific impact between positive and negative trials was similar. Positive trials indicate clinical advances, but negative trials also have a sizeable scientific impact by generating important scientific observations and new hypotheses and by showing what new treatments should not be used.
Conflict of interest statementConflict of Interest Disclosures: The authors have no disclosures.
FiguresFigure 1
Number of citations by calendar…
Figure 1
Number of citations by calendar year for primary manuscripts (Panel A), secondary manuscripts…
Figure 1Number of citations by calendar year for primary manuscripts (Panel A), secondary manuscripts (Panel B), and the combination of primary and secondary manuscripts (Panel C). Calendar year was truncated at 1995 for presentation purposes. The number of publications that were at risk of citation are shown below each panel.
Figure 2
Average citations by year after…
Figure 2
Average citations by year after primary manuscript publication for primary manuscripts (Panel A)…
Figure 2Average citations by year after primary manuscript publication for primary manuscripts (Panel A) and both primary and secondary manuscripts (panel B). The solid blue lines show the model fitted results for positive trials, and the solid red lines show the model fitted results for negative trials. The blue crosses indicate observed mean number of citations for positive trials, and the red dots indicate observed mean number of citations for negative trials. The observed and fitted values occurring prior to the primary manuscript publication year were due to citations from secondary publications associated with a given trial (for instance, articles reporting on the trial design). Citation counts for the first 20 years after primary manuscript publication were included for the analysis of primary manuscripts only. For the analysis of primary and secondary manuscripts, citation counts from 5 years prior to primary manuscript publication to 20 years after primary manuscript publication were included.
Similar articlesNielsen MB, Seitz K. Nielsen MB, et al. Ultraschall Med. 2016 Aug;37(4):343-5. doi: 10.1055/s-0042-111209. Epub 2016 Aug 4. Ultraschall Med. 2016. PMID: 27490462 English.
Unger JM, Barlow WE, Tangen CM, Ramsey SD, Thompson IM Jr, Klein EA, LeBlanc M, Blanke CD, Goodman PJ, Minasian LM, Nghiem VT, Hershman DL. Unger JM, et al. Cancer Epidemiol. 2018 Aug;55:117-122. doi: 10.1016/j.canep.2018.06.005. Epub 2018 Jun 21. Cancer Epidemiol. 2018. PMID: 29936140 Free PMC article.
Donato H, de Oliveira CF. Donato H, et al. Acta Med Port. 2009 Jan-Feb;22(1):41-50. Epub 2009 Mar 25. Acta Med Port. 2009. PMID: 19341592 Portuguese.
Addeo A, Weiss GJ, Gyawali B. Addeo A, et al. JAMA Netw Open. 2019 May 3;2(5):e193684. doi: 10.1001/jamanetworkopen.2019.3684. JAMA Netw Open. 2019. PMID: 31074821 Free PMC article. Review.
Holliday EB, Ahmed AA, Yoo SK, Jagsi R, Hoffman KE. Holliday EB, et al. Int J Radiat Oncol Biol Phys. 2015 Jul 15;92(4):721-31. doi: 10.1016/j.ijrobp.2015.03.011. Epub 2015 Mar 18. Int J Radiat Oncol Biol Phys. 2015. PMID: 26104927 Review.
Park YD, Sun W, Salas A, Antia A, Carvajal C, Wang A, Xu X, Meng Z, Zhou M, Tawa GJ, Dehdashti J, Zheng W, Henderson CM, Zelazny AM, Williamson PR. Park YD, et al. mBio. 2016 Aug 2;7(4):e01073-16. doi: 10.1128/mBio.01073-16. mBio. 2016. PMID: 27486194 Free PMC article.
Schwab S, Kreiliger G, Held L. Schwab S, et al. BMJ Open. 2021 Sep 14;11(9):e045942. doi: 10.1136/bmjopen-2020-045942. BMJ Open. 2021. PMID: 34521659 Free PMC article.
Spreafico A, Hansen AR, Abdul Razak AR, Bedard PL, Siu LL. Spreafico A, et al. Cancer Discov. 2021 Apr;11(4):822-837. doi: 10.1158/2159-8290.CD-20-1301. Cancer Discov. 2021. PMID: 33811119 Free PMC article. Review.
Ito C, Hashimoto A, Uemura K, Oba K. Ito C, et al. JAMA Netw Open. 2021 Dec 1;4(12):e2135765. doi: 10.1001/jamanetworkopen.2021.35765. JAMA Netw Open. 2021. PMID: 34874407 Free PMC article.
Kempf E, de Beyer JA, Cook J, Holmes J, Mohammed S, Nguyên TL, Simera I, Trivella M, Altman DG, Hopewell S, Moons KGM, Porcher R, Reitsma JB, Sauerbrei W, Collins GS. Kempf E, et al. Br J Cancer. 2018 Nov;119(10):1288-1296. doi: 10.1038/s41416-018-0305-5. Epub 2018 Oct 24. Br J Cancer. 2018. PMID: 30353050 Free PMC article.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.3