- Open Access
Editorial on hypothesis and objectives in clinical trials: superiority, equivalence and non-inferiority
Thrombosis Journal volume 7, Article number: 3 (2009)
Randomized clinical trial is often considered as the Gold Standard method for comparing treatment effects. In practice, taking into consideration their main objectives, the majority of clinical trials are aimed to establish the superiority of an intervention regarding to an active control or placebo . Within the methodological core of these so called superiority trials, the assessment of the statistical signification of the differences between or among interventions, and their clinical relevance, are both of main importance. Appropriate statistical tests to assess this superiority should be performed, with the null hypothesis being: the difference between treatments is equal to 0 (H0 ≡ Δ = 0), and the alternative hypothesis: treatments are different -or, the difference between treatments is not equal to 0 (H1 ≡ Δ ≠ 0)(if two sided)-. The rejection of the null hypothesis is in the foundation of the methodological assessment of superiority . The number of patients required to confront the hypotheses is inversely related to the expected between-treatment differences. The smallest the expected difference between two interventions, the highest the number of patients to be included into the trial. But, how to interpret a non-significant result obtained from a clinical study designed as a superiority trial? Does this mean that the interventions under study should be considered as equivalent?. Clearly, the answer is negative. From the methodological standpoint, the expression: we have no evidence of difference between treatments, should not be considered as equivalent to: we have evidence of no difference between interventions .
Very often, the aim of a clinical trial is to show that a certain intervention is equivalent to or non inferior than another one. In this case, as stated before, a non-significant superiority testing should not be interpreted as a proof of no difference between treatments. Under an equivalence hypothesis, where the between treatments difference is assumed to be equal to 0, the calculation of a sample size following the rules established for superiority trials is impossible or in the best case (by employing an estimated difference close to 0) would result in an unrealistic extremely large number . Instead, equivalence and non-inferiority trials should be conceived, planned and applied to these purposes. In general, neither equivalence nor non-inferiority should be definitively concluded from superiority trials exhibiting non-significant results.
Improvements into the galenics of a formulation or a modification in a drug delivery system should not affect the pharmacokinetic (PK) profile of the drug. That is also the case for the comparison between the PK parameters of a generic preparation versus an original product. This is the rationale for the so called bioequivalence trials, the most frequent type of equivalence study. Being μS the mean value for an specific PK indicator in the standard or the original product, and μT the mean for the same parameter of the new product under testing, the null hypothesis in a bioequivalence trial would be: H0 ≡ μS-μT ≤ -Δ or μS-μT>Δ, (where Δ is the magnitude of a prespecified difference between the standard (S) and the new product T. Typically, the main PK indicators under study are: the peak concentration of the drugs on trial (Cmax), their areas-under-the-curve of concentrations in relation to time (AUC) and the time-to-peak (Tmax) .
The purpose of a "non-inferiority trial" is to show that a new intervention is no worse than the standard reference therapy. Here, the assumption is that the difference in effect is no less than a prespecified Δ. It should be designed as a one-sided trial. The null hypothesis is: H0 ≡ πS-πT ≥ M, being πS and πT the outcomes rate for a qualitative dependent variable (e.g. death, infarctions, stroke), and M a maximum allowable limit of difference, or, H0 ≡ μS-μT ≥ M in case of a quantitative outcome (where μ are means).
Non-inferiority trials are carried out when: 1) a placebo-controlled trial is not ethically feasible; 2) the treatment under test is not expected to be better that the standard or reference intervention in terms of efficacy, but is supposedly better regarding to other secondary endpoints, safety, costs, compliance or convenience .
In non-inferiority trials, the choice of the maximum allowable margin is crucial. The rationale to determine these limits require careful consideration and should be appropriately described into the specific section of the protocol. ASSENT 2 trial is an early example of non-inferiority trial within the scope of thrombolytic therapy [5, 6]. Alternative hypothesis in this study was that the 30 days mortality is not inferior for a single bolus of tecneplase when compared with an accelerate infusion of alteplase. The path to determine the allowable margin involved several steps. It was finally accepted that considering an event rate cut off of 7.2% in patients treated with alteplase, the non-inferiority area could be defined as follows: if πS (alteplase events rate) were >7.2%, then πS-πT (difference in events between alteplase and tecneplase) <1%; in case of a πS < 7.2%, a ratio πS/πT < 1.14 would be considered as within the non-inferiority region. Results of this trial showed that the events rate for the alteplase treated group was 6.18%; in the tecneplase treated patients was 6.16%. Events rate in the alteplase group was below 7.2; as the ratio πS/πT was 0.99 (with a 90% confidence interval of 0.90 to 1.10) always below 1.14 (even considering the upper 90% confidence interval limit), the non-inferiority hypothesis was considered as proven. TARGET (Do Tirofiban and ReoPro Give Similar Efficacy Outcomes Trial) is another good example of non-inferiority trial, comparing two glycoprotein IIb/IIIa receptor blockers ; nevertheless, in this case, tirofiban failed to demonstrate non-inferiority to abciximab (the ischemic event rate was higher in the tirofiban group).
Non-inferiority trials offer some issues to the methodological debate: selection of the appropriate margin could be sometimes considered as arbitrary (it is dependant on the indication, the clinical judgment and the regulatory guidance), and in many occasions would require a clear estimation/prediction of the effect of the control therapy (and this is not always available). While in superiority trials intention-to-treat (ITT) based analysis is always recommendable, it is unclear that this approach could provide any benefits in non-inferiority trials and "per procolol" analyses are preferred by some authors. In the ITT approach, all patients we intended to treat will be included into the analysis, whether they completed the trial following the protocol or not. The purpose is to minimize the potential impact of withdrawals and non-compliance on the interpretation of the results. Conversely, in a "as per protocol" breakdown, patients who were non-compliant, or unable to complete the assigned treatment or have missing data are excluded from the analysis. In a pragmatic approach, most of the specialists recommend to apply both ITT and "per protocol" analyses, assuring that the results of these two analysis are not conflictive. Nevertheless, in the field of non-inferiority trials, this issue is still a matter of methodological controversy [2, 8].
In spite of the limitations in the doctrine that supports the classification of the clinical experiments as "superiority", "equivalence" and "non-inferiority" trials, this methodological approach allowed for a improved production and understanding of the medical evidence when compared with the traditional view. Further epistemological refinements of this theory are granted.
Christensen E: Methodology of superiority vs equivalence trials and non-inferiority trials. Journal of Hepatology 2007, 46: 947-954. 10.1016/j.jhep.2007.02.015
Lesaffre E: Superiority, equivalence and non-inferiority trials. Bulletin of the NYU Hospital for Joint Diseases 2008, 66(2):150-154.
Chow S-C, Liu J-P: Classification of Clinical Trials. In Design and Analysis of Clinical Trials: Concepts and Methodologies. Second edition. Edited by: Chow, Liu. John Wiley & Sons, Inc., New Jersey, US; 2004:239-299.
Wang D, Arezina R, Bakhai A: Bioquivalence Trials. In Clinical Trials. A practical guide to design, analysis and reporting. Edited by: Wang, Bakhai. Remedica, London, UK; 2006:119-129.
ASSENT 2 Investigators: Single-bolus tecneplase compared with front-loaded alteplase in acute myocardial infarction: the ASSSENT-2 double blind randomised trial. Lancet 1999, 354: 716-722. 10.1016/S0140-6736(99)07403-6
Lesaffre E, Bluhmki E, Wang-Clow F, Berioli S, Danays T, Fox NL, Werf F: The general concepts of an equivalence trial, applied to ASSENT-2, a large-scale mortality study comparing two fibrinolytic agents in acute myocardial infarction. European Heart Journal 2001, 22(11):898-902. 10.1053/euhj.2000.2323
Topol EJ, Moliterno DJ, Herrmann HC, Powers ER, Grines CL, Cohen DJ, Cohen EA, Bertrand M, Neumann FJ, Stone GW, DiBattiste PM, Demopoulos L, TARGET Investigators: Comparison of two platelet glycoprotein IIb/IIIa inhibitors, tirofiban and abciximab, for the prevention of ischemic events with percutaneous coronary revascularization. New England Journal of Medicine 2001, 344(25):1888-1894. 10.1056/NEJM200106213442502
Miller S, Neate C, Wand D: Noninferiority Trials. In Clinical Trials. A practical guide to design, analysis and reporting. Edited by: Wang, Bakhai. Remedica, London, UK; 2006:131-140.
About this article
Cite this article
Gonzalez, C.D., Bolaños, R. & de Sereday, M. Editorial on hypothesis and objectives in clinical trials: superiority, equivalence and non-inferiority. Thrombosis J 7, 3 (2009) doi:10.1186/1477-9560-7-3