- Original clinical investigation
- Open Access
Derivation of the non-inferiority margin for the evaluation of direct oral anticoagulants in the treatment of venous thromboembolism
Thrombosis Journal volume 11, Article number: 13 (2013)
Direct oral anticoagulants that target a single coagulation factor have been developed as an alternative to standard therapies with heparin and/or vitamin K antagonists. The purpose of this study was to derive non-inferiority margins suitable for randomised clinical studies designed to evaluate these agents for the treatment of venous thromboembolism (VTE).
We performed a systematic review to derive non-inferiority margins suitable for use in studies evaluating direct oral anticoagulants for the treatment of VTE. A PubMed search identified publications that evaluated current standard treatment versus placebo, ‘no treatment’ or ‘less intensive treatment’ in patients with symptomatic deep vein thrombosis (DVT) and/or pulmonary embolism (PE). Publications were eligible if they had a randomised study design, included patients with symptomatic DVT and/or PE, used objective diagnostic methods to document the index event and reported objectively confirmed symptomatic recurrent VTE.
Fourteen publications were included in the analysis. Recurrent VTE occurred in 25 (1.5%) out of 1715 patients who received current standard of care and in 157 (9.2%) out of 1711 patients who received placebo, ‘no treatment’ or ‘less intensive treatment’, for an odds ratio of 0.18 (95% confidence interval, 0.14−0.25; test for heterogeneity, p=0.87). In order to preserve 50% or 75% of the established treatment effect using a linear scale, the corresponding thresholds for non-inferiority equalled 2.50 and 1.75, respectively.
This systematic review and statistical approach determined non-inferiority margins suitable for use in studies of direct oral anticoagulants for the treatment of DVT and/or PE.
Adjusted-dose unfractionated heparin or bodyweight-adjusted low molecular weight heparin overlapping with and followed by laboratory-titrated vitamin K antagonists (VKAs) is widely accepted as the standard treatment for patients presenting with acute deep vein thrombosis (DVT) and/or pulmonary embolism (PE) . Although highly efficacious and relatively safe, this treatment regimen is associated with a considerable number of disadvantages, including the need for parenteral administration of heparin and frequent laboratory monitoring of the pharmacodynamic effects of VKAs with subsequent dose adjustments.
Recently, small molecules have been developed that directly inhibit a single component of the coagulation cascade (such as Factor Xa or thrombin), can be taken orally and have a predictable pharmacokinetic/pharmacodynamic profile [2–4]. Although this eliminates the need for parenteral administration and routine coagulation monitoring, it is essential that these new compounds are demonstrated to be clinically as efficacious as the current standard treatment. Demonstration of similar efficacy requires randomised trials involving patients with symptomatic DVT and/or PE that compare the incidences of recurrent venous thromboembolism (VTE) between the new compounds and the current standard treatment. To exclude a clinically relevant excess of recurrent VTE, the direct oral anticoagulants need to satisfy a non-inferiority margin that is based on the documented efficacy of current standard treatments [5, 6].
In this paper, we systematically reviewed all studies that have evaluated the efficacy of the current standard treatment for DVT and/or PE and calculated accompanying non-inferiority margins from the meta-analysis.
A PubMed search was undertaken for articles reporting the results of controlled randomised trials between the dates of 1959 and 2013 to identify studies that compared the currently recommended anticoagulant treatment approach with placebo, ‘no treatment’ or a ‘less intensive’ heparin/VKA regimen. The search relied on titles, abstracts and multiple database descriptors and was not restricted by language. The following key words were used to identify potential relevant publications and eligible studies for inclusion from a search of MEDLINE: heparin or low molecular weight heparin, venous thrombo*, vitamin K antagonist, warfarin, acenocoumarol, phenprocoumon and fluindione, and the publications were limited to randomised controlled trials. This broad search approach was followed by an extensive manual search. Reports were eligible if they included a randomised study design, included patients with symptomatic DVT and/or PE, used objective diagnostic methods to document the index event and reported objectively confirmed symptomatic recurrent VTE. The early study of Barritt and Jordan in 1960 is, in fact, the only ‘no-treatment controlled’ study and treated patients for 14 days only . Other early studies dated between 1979 and 1993 addressed mainly the initial 3 months of treatment and used ‘less intensive’ heparin therapy and/or VKA treatment [8–13]. Studies published since 1993 addressed mainly the need for continuation of VKA therapy and compared this therapy to ‘no treatment’ or placebo treatment in the initial 4 weeks to 6 months after the index event [14–20]. All studies involving ‘less intensive’ regimens that were demonstrated to be superior versus placebo or ‘no treatment’ were excluded.
The authors independently extracted the following data from each of the eligible publications: presentation with DVT and/or PE, treatment characteristics, number of patients per group and incidence of recurrent fatal/non-fatal VTE per group during the period of comparison between placebo, ‘no treatment’ or ‘less intensive treatment’. Differences in opinion or interpretation were resolved by consensus.
The incidences of recurrent VTE for the different treatment arms were used to calculate a separate odds ratio for each trial. These odds ratios were then combined across studies, giving weight to the number of events in each of the two treatment groups in each separate study, using the Mantel–Haenszel procedure , which assumes a fixed treatment effect. In addition, risk ratios were calculated using the metafor package in ‘R’. Likewise, 95% confidence intervals (CIs) for the effect estimate were calculated, and heterogeneity was statistically assessed. From the observed efficacy estimates and the lower limits of the CIs, thresholds were calculated for the retention of 50%, 66% and 75% of the treatment effect on both arithmetic and geometric scales.
A total of 5388 publications were identified in our literature search, which used the seminal publication of Barritt and Jordan as a starting point . Review of the identified publications in accordance with the eligibility criteria resulted in the selection of a further 14 studies. One study was excluded because the ‘less intensive treatment’ regimen had been shown to be superior to placebo in another study [22, 23]. Of the 14 studies included, nine evaluated anticoagulant therapy for a duration of up to 3 months [7–15], three for a duration of up to 12 months, [16, 17, 19] and two for longer durations [18, 20].
Current standard of care was compared with placebo in five studies, with ‘no treatment’ in three studies and with ‘less intensive treatment’ in six studies. The design characteristics of these studies are summarised in Table 1. The results per study are summarised in Table 2.
Establishing the non-inferiority margin
Recurrent VTE occurred in 25 (1.5%) of 1715 patients who received current standard of care and in 157 (9.2%) of 1711 patients who received placebo, ‘no treatment’ or ‘less intensive treatment’ (Table 2). Therefore, the observed treatment effect for prevention of recurrent VTE was associated with an odds ratio of 0.18 (95% CI 0.14−0.25; test for heterogeneity, p=0.87) and a risk ratio of 0.19 (95% CI 0.12−0.28; test for heterogeneity, p=0.85). Conversely, in the absence of current standard treatment, the risk of recurrent VTE increased with an odds ratio of 5.56 (95% CI 4.00−7.14) or a risk ratio of 5.26 (95% CI 3.57−8.33) (Table 3). Hence, the lower limits of the 95% CIs of the effect needed to be maintained relevant for the calculation of the non-inferiority thresholds were 4.00 for the odds ratio and 3.57 for the risk ratio (Table 3). Thus, to preserve 50% of the established treatment effect, the threshold for non-inferiority equalled 2.50 if calculated using an odds ratio and 2.29 if calculated using a risk ratio on a linear scale. Likewise, to preserve 75% of the treatment effect, these thresholds should be 1.75 and 1.64, respectively (Table 3). In Table 3, the limits on a geometric scale are also presented.
The point estimates of the relative treatment effects between studies with a treatment duration of 3 months and studies with a treatment duration of longer than 3 months were consistent with odds ratios of 0.18 (95% CI 0.11−0.32) and of 0.18 (95% CI 0.12−0.28), respectively.
Our systematic review of the medical literature demonstrates that the current standard treatment for VTE is highly efficacious, with a pooled odds ratio of 0.18 and a pooled risk ratio of 0.19, corresponding to a relative risk reduction of over 80%. Based on this review, non-inferiority margins of 2.50, 2.00 and 1.75 could be calculated using odd ratios, corresponding to maintenance of documented efficacy of current standard treatment of 50%, 66% and 75%, respectively, on a linear scale. In general, if the non-inferiority margins were based on a risk ratio, the margins would be lower than that based on the odds ratio, which would lead to somewhat larger sample sizes.
The meta-analysis on which these margins are based included a large variety of studies undertaken over a long time period (i.e. between 1960 and 2013). Our search yielded more than 5000 potential references for review. However, attempts to narrow the search resulted in the loss of pertinent articles known to the authors. Even using these broad search criteria, the pertinent reference of Barritt and Jordan was not found. Therefore, the approach was supplemented by an extensive manual search to identify all relevant studies. All 14 included studies had a randomised design, reported clinical outcomes and documented the incidence of recurrent VTE. Although all studies included a group of patients that received the current standard of care, the comparator varied between placebo and ‘no treatment’ or some form of anticoagulant treatment that lacked evidence of efficacy. Despite the lack of evidence of efficacy, it cannot be excluded that these ‘less intensive’ anticoagulant regimens offered some protection against recurrent VTE, which would make our estimates of effect and accompanying non-inferiority margins relatively conservative. No statistical heterogeneity was identified when combining the results of the 14 identified studies. Based on the consistency of the observed effect in all studies and the high number of patients in the meta- analysis, the 95% CIs around the observed summary treatment effect are relatively narrow. With the observed large risk reduction, the calculated non-inferiority margin to demonstrate maintenance of 50% of the treatment effect, a commonly accepted approach, is 2.50 on a linear scale, which might be viewed as unacceptable because it involves clinically important events.
On a geometric scale, the comparable number for the non-inferiority margin would be 2.00. From our calculations, it is apparent that calculating a summary relative risk and then applying a geometric scale results in more stringent non-inferiority margins (Table 3). Part of this effect is caused by the wider CI around the summary effect estimate when using risk ratios rather than odds ratios, as a result of the different underlying statistical models. The other important choice is using an arithmetic (linear) or geometric scale. When reasoning from the event rate in a ‘no treatment’ situation, the logical choice would be to use a geometric scale (relative reduction of outcome rates upon relative reduction). However, when clinically evaluating the allowed excess of outcome events versus current standard treatment, the starting point is the observed incidence on current standard treatment and the logical choice would be to use a linear scale.
Recent published studies that evaluated direct oral anticoagulants in patients with symptomatic DVT and/or PE used 1.80, 2.00, 2.75 and 2.85 as non-inferiority margins to calculate their sample size. For the EINSTEIN DVT and EINSTEIN PE studies that evaluated the direct Factor Xa inhibitor rivaroxaban, it was calculated that a total of 88 events were needed for each study to demonstrate non-inferiority versus standard of care with a margin of 2.0 [24, 25]. The observed upper limits of the 95% CIs around the relative treatment effect were 1.04 in the EINSTEIN DVT study, 1.68 in the EINSTEIN PE study, and 1.19 for all patients in the EINSTEIN DVT and EINSTEIN PE studies, corresponding to a retention of treatment effect of 99%, 77% and 94%, respectively, on a linear scale. Using a geometric scale, these values become 97%, 63% and 87%, respectively. In the RE-COVER and RE-MEDY studies that evaluated the direct thrombin inhibitor dabigatran versus current standard treatment in patients with DVT and/or PE, it was calculated that 46 and 40 events were needed for each of the studies to demonstrate non-inferiority versus standard of care with a margin of 2.75 and 2.85, respectively [26, 27]. The observed upper limits of the 95% CIs around the relative treatment effect were 1.84 in the RE-COVER trial and 2.64 in RE-MEDY trial, corresponding to retention of treatment effect of 72% and 45%, respectively, on a linear scale. Using a geometric scale, these values become 56% and 30%, respectively. For the AMPLIFY study that evaluated the direct Factor Xa inhibitor apixaban in patients with DVT and/or PE, it was calculated that a total of 123 events were needed to demonstrate non-inferiority versus standard of care with a margin of 1.80 . The observed upper limits of the 95% CIs around the relative treatment effect were 1.26 in patients with DVT, 1.61 in patients with PE, and 1.18 for all patients, corresponding to a retention of treatment effect of 91%, 79% and 94%, respectively, on a linear scale. Using a geometric scale, these values become 83%, 65% and 88%, respectively. In the HOKUSAI-VTE study, evaluating the direct Factor Xa inhibitor edoxaban in patients with symptomatic DVT and/or PE, a non-inferiority margin of 1.50 has been adopted (clinicaltrials.gov: NCT00986154) .
In summary, the available studies allow the calculation of non-inferiority margins using a statistical approach that are appropriate for the evaluation of direct oral anticoagulants in patients with DVT and/or PE. Studies on direct oral anticoagulants that were conducted or are ongoing have adopted various margins and differ in the amount of retention of treatment effect that they have demonstrated.
Deep vein thrombosis
Vitamin K antagonist
Kearon C, Akl EA, Comerota AJ, Prandoni P, Bounameaux H, Goldhaber SZ, Nelson ME, Wells PS, Gould MK, Dentali F, Crowther M, Kahn SR: Antithrombotic therapy for VTE disease: antithrombotic therapy and prevention of thrombosis, 9th ed: American College of Chest Physicians evidence-based clinical practice guidelines. Chest 2012, 141: e419S-e494S. 10.1378/chest.11-2301
Perzborn E, Roehrig S, Straub A, Kubitza D, Misselwitz F: The discovery and development of rivaroxaban, an oral, direct Factor Xa inhibitor. Nat Rev Drug Discov 2011, 10: 61-75. 10.1038/nrd3185
Eisert WG, Hauel N, Stangier J, Wienen W, Clemens A, van Ryn J: Dabigatran: an oral novel potent reversible nonpeptide inhibitor of thrombin. Arterioscler Thromb Vasc Biol 2010, 30: 1885-1889. 10.1161/ATVBAHA.110.203604
Wong PC, Pinto DJ, Zhang D: Preclinical discovery of apixaban, a direct and orally bioavailable Factor Xa inhibitor. J Thromb Thrombolysis 2011, 31: 478-492. 10.1007/s11239-011-0551-3
European Medicines Agency: Guideline on the choice of the non-inferiority margin. 2005.http://www.emea.europa.eu/docs/en_GB/document_library/Scientific_guideline/2009/09/WC500003636.pdf 
Food and Drug Administration: Guidance for industry non-inferiority trials. 2010.http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM202140.pdf 
Barritt DW, Jordan SC: Anticoagulant drugs in the treatment of pulmonary embolism. A controlled trial. Lancet 1960, 1: 1309-1312.
Hull R, Delmore T, Genton E, Hirsh J, Gent M, Sackett D, McLoughlin D, Armstrong P: Warfarin sodium versus low-dose heparin in the long-term treatment of venous thrombosis. N Engl J Med 1979, 301: 855-858. 10.1056/NEJM197910183011602
Holmgren K, Andersson G, Fagrell B, Johnsson H, Ljungberg B, Nilsson E, Wilhelmsson S, Zetterquist S: One-month versus six-month therapy with oral anticoagulants after symptomatic deep vein thrombosis. Acta Med Scand 1985, 218: 279-284.
Lagerstedt CI, Olsson CG, Fagher BO, Oqvist BW, Albrechtsson U: Need for long-term anticoagulant treatment in symptomatic calf-vein thrombosis. Lancet 1985, 2: 515-518.
Hull RD, Raskob GE, Hirsh J, Jay RM, Leclerc JR, Geerts WH, Rosenbloom D, Sackett DL, Anderson C, Harrison L: Continuous intravenous heparin compared with intermittent subcutaneous heparin in the initial treatment of proximal-vein thrombosis. N Engl J Med 1986, 315: 1109-1114. 10.1056/NEJM198610303151801
Brandjes DP, Heijboer H, Büller HR, de Rijk M, Jagt H, ten Cate JW: Acenocoumarol and heparin compared with acenocoumarol alone in the initial treatment of proximal-vein thrombosis. N Engl J Med 1992, 327: 1485-1489. 10.1056/NEJM199211193272103
Raschke RA, Reilly BM, Guidry JR, Fontana JR, Srinivas S: The weight-based heparin dosing nomogram compared with a “standard care” nomogram. A randomized controlled trial. Ann Intern Med 1993, 119: 874-881. 10.7326/0003-4819-119-9-199311010-00002
Levine MN, Hirsh J, Gent M, Turpie AG, Weitz J, Ginsberg J, Geerts W, Leclerc J, Neemeh J, Powers P: Optimal duration of oral anticoagulant therapy: a randomized trial comparing four weeks with three months of warfarin in patients with proximal deep vein thrombosis. Thromb Haemost 1995, 74: 606-611.
Schulman S, Rhedin AS, Lindmarker P, Carlsson A, Lärfars G, Nicol P, Loogna E, Svensson E, Ljungberg B, Walter H: A comparison of six weeks with six months of oral anticoagulant therapy after a first episode of venous thromboembolism. Duration of Anticoagulation Trial Study Group. N Engl J Med 1995, 332: 1661-1665. 10.1056/NEJM199506223322501
Agnelli G, Prandoni P, Santamaria MG, Bagatella P, Iorio A, Bazzan M, Moia M, Guazzaloca G, Bertoldi A, Tomasi C, Scannapieco G, Ageno W: Three months versus one year of oral anticoagulant therapy for idiopathic deep venous thrombosis. Warfarin Optimal Duration Italian Trial Investigators. N Engl J Med 2001, 345: 165-169. 10.1056/NEJM200107193450302
Agnelli G, Prandoni P, Becattini C, Silingardi M, Taliani MR, Miccio M, Imberti D, Poggio R, Ageno W, Pogliani E, Porro F, Zonzin P: Extended oral anticoagulant therapy after a first episode of pulmonary embolism. Ann Intern Med 2003, 139: 19-25. 10.7326/0003-4819-139-1-200307010-00008
Kearon C, Gent M, Hirsh J, Weitz J, Kovacs MJ, Anderson DR, Turpie AG, Green D, Ginsberg JS, Wells P, MacKinnon B, Julian JA: A comparison of three months of anticoagulation with extended anticoagulation for a first episode of idiopathic venous thromboembolism. N Engl J Med 1999, 340: 901-907. 10.1056/NEJM199903253401201
Pinede L, Ninet J, Duhaut P, Chabaud S, Demolombe-Rague S, Durieu I, Nony P, Sanson C, Boissel JP: Comparison of 3 and 6 months of oral anticoagulant therapy after a first episode of proximal deep vein thrombosis or pulmonary embolism and comparison of 6 and 12 weeks of therapy after isolated calf deep vein thrombosis. Circulation 2001, 103: 2453-2460. 10.1161/01.CIR.103.20.2453
Schulman S, Granqvist S, Holmström M, Carlsson A, Lindmarker P, Nicol P, Eklund SG, Nordlander S, Lärfars G, Leijd B, Linder O, Loogna E: The duration of oral anticoagulant therapy after a second episode of venous thromboembolism. The Duration of Anticoagulation Trial Study Group. N Engl J Med 1997, 336: 393-398. 10.1056/NEJM199702063360601
Mantel N, Haenszel W: Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst 1959, 22: 719-748.
Ridker PM, Goldhaber SZ, Danielson E, Rosenberg Y, Eby CS, Deitcher SR, Cushman M, Moll S, Kessler CM, Elliott CG, Paulson R, Wong T, Bauer KA, Schwartz BA, Miletich JP, Bounameaux H, Glynn RJ: Long-term, low-intensity warfarin therapy for the prevention of recurrent venous thromboembolism. N Engl J Med 2003, 348: 1425-1434. 10.1056/NEJMoa035029
Kearon C, Ginsberg JS, Kovacs MJ, Anderson DR, Wells P, Julian JA, MacKinnon B, Weitz JI, Crowther MA, Dolan S, Turpie AG, Geerts W, Solymoss S, van Nguyen P, Demers C, Kahn SR, Kassis J, Rodger M, Hambleton J, Gent M, Extended Low-Intensity Anticoagulation for Thrombo-Embolism Investigators: Comparison of low-intensity warfarin therapy with conventional-intensity warfarin therapy for long-term prevention of recurrent venous thromboembolism. N Engl J Med 2003, 349: 631-639. 10.1056/NEJMoa035422
The EINSTEIN–PE Investigators: Oral rivaroxaban for the treatment of symptomatic pulmonary embolism. N Engl J Med 2012, 366: 1287-1297.
The EINSTEIN Investigators: Oral rivaroxaban for symptomatic venous thromboembolism. N Engl J Med 2010, 363: 2499-2510.
Schulman S, Kearon C, Kakkar AK, Mismetti P, Schellong S, Eriksson H, Baanstra D, Schnee J, Goldhaber SZ, for the RE-COVER Study Group: Dabigatran versus warfarin in the treatment of acute venous thromboembolism. N Engl J Med 2009, 361: 2342-2352. 10.1056/NEJMoa0906598
Schulman S, Kearon C, Kakkar AK, Schellong S, Eriksson H, Baanstra D, Kvamme AM, Friedman J, Mismetti P, Goldhaber SZ: Extended use of dabigatran, warfarin, or placebo in venous thromboembolism. N Engl J Med 2013, 368: 709-718. 10.1056/NEJMoa1113697
Agnelli G, Buller HR, Cohen A, Curto M, Gallus AS, Johnson M, Masiukiewicz U, Pak R, Thompson J, Raskob GE, Weitz JI: Oral apixaban for the treatment of acute venous thromboembolism. N Engl J Med 2013. 10.1056/NEJMoa1302507
Raskob G, Büller H, Prins M, Segers A, Shi M, Schwocho L, van Kranen R, Mercuri M, The Hokusai-VTE Investigators: Edoxaban for the long-term treatment of venous thromboembolism: rationale and design of the Hokusai-VTE study. J Thromb Haemost 2013. 10.1111/jth.12230
The authors would like to thank David Whitford who provided editorial support with funding from Bayer HealthCare Pharmaceuticals and Janssen Scientific Affairs, LLC.
MHP: Has acted as a consultant for Bayer HealthCare, Sanofi-aventis, Boehringer Ingelheim, GlaxoSmithKline, Daiichi Sankyo, Leo Pharma, Thrombogenics, Pfizer. AWAL is an employee of Bayer Pharma AG.
MHP and AWAL performed the analysis and interpreted the data, were involved in drafting and revising the manuscript, and provided final approval for publication of the manuscript.
About this article
Cite this article
Prins, M.H., Lensing, A.W. Derivation of the non-inferiority margin for the evaluation of direct oral anticoagulants in the treatment of venous thromboembolism. Thrombosis J 11, 13 (2013) doi:10.1186/1477-9560-11-13
- Non-inferiority margin
- Oral anticoagulants
- Venous thromboembolism