To randomize, or not to randomize, that is the question: Using data from prior clinical trials to guide future designs

Background. Understanding the value of randomization is critical in designing clinical trials. Here, we introduce a simple and interpretable quantitative method to compare randomized designs versus single-arm designs using indication-specific parameters derived from the literature. We demonstrate the approach through application to phase II trials in newly diagnosed glioblastoma (ndGBM). Methods. We abstracted data from prior ndGBM trials and derived relevant parameters to compare phase II randomized controlled trials (RCTs) and single-arm designs within a quantitative framework. Parameters included in our model were (i) the variability of the primary endpoint distributions across studies, (ii) potential for incorrectly specifying the single-arm trial's benchmark, and (iii) the hypothesized effect size. Strengths and weaknesses of RCT and single-arm designs were quantified by various metrics, including power and false positive error rates. Results. We applied our method to show that RCTs should be preferred to single-arm trials for evaluating overall survival in ndGBM patients based on parameters estimated from prior trials. More generally, for a given effect size, the utility of randomization compared with single-arm designs is highly dependent on (i) interstudy variability of the outcome distributions and (ii) potential errors in selecting standard of care efficacy estimates for single-arm studies. Conclusions. A quantitative framework using historical data is useful in understanding the utility of randomization in designing prospective trials. For typical phase II ndGBM trials using overall survival as the primary endpoint, randomization should be preferred over single-arm designs.