Honest Criticisms and Limitations of the ODYSSEY OUTCOMES Trial

Clinical medical image for trials odyssey outcomes: Honest Criticisms and Limitations of the ODYSSEY OUTCOMES Trial

At a glance

| Parameter | Detail | |---|---| | N | 18,924 | | Intervention | Alirocumab 75 mg or 150 mg SC every 2 weeks (dose-titrated to LDL-C target) | | Comparator | Matching placebo | | Duration | Median 2.8 years | | Primary endpoint | Composite MACE: coronary heart disease death, nonfatal MI, ischemic stroke, unstable angina requiring hospitalization | | Key result | HR 0.85 (95% CI 0.73, 0.98; p = 0.02); absolute risk reduction ~1.6 percentage points |

Why This Page Exists

Most summaries of ODYSSEY OUTCOMES repeat the headline: alirocumab cut MACE by 15% in post-ACS patients already on maximally tolerated statins. That number is real, but it does not tell the whole story. Clinical decision-making requires understanding what the trial did not prove, where its design choices shape the result, and which patient populations remain unstudied. This page catalogs the trial's genuine weaknesses, drawing on the primary publication, subsequent editorials, and FDA review documents.

1. Enrollment Enrichment and Selection Bias

ODYSSEY OUTCOMES enrolled patients 1 to 12 months after an acute coronary syndrome event who had LDL-C ≥ 70 mg/dL (or non-HDL-C ≥ 100 mg/dL, or apolipoprotein B ≥ 80 mg/dL) despite high-intensity or maximally tolerated statin therapy. This creates a population enriched for residual lipid risk, a group already known to carry higher event rates.

Several enrollment features deserve scrutiny:

  • Run-in period filtering. Patients who could not tolerate the study drug or adhere to the injection schedule during run-in were excluded before randomization. This inflates apparent tolerability and adherence compared to real-world practice.
  • Geographic concentration. Roughly 27% of patients came from Western Europe and 23% from North America. Representation from sub-Saharan Africa, South Asia, and Southeast Asia was minimal. The 2018 AHA/ACC cholesterol guidelines acknowledged that PCSK9 inhibitor trial populations do not fully reflect U.S. demographic diversity.
  • Statin optimization window. The protocol required 2 to 16 weeks of statin optimization before screening. Patients whose LDL-C fell below threshold during optimization were excluded, meaning the trial systematically removed the best statin responders and studied only those with persistent elevation.

The net effect: ODYSSEY OUTCOMES tested alirocumab in a carefully selected subgroup of post-ACS patients, not the broader population a clinician might consider for PCSK9 inhibition.

2. Absolute Risk Reduction and the NNT Problem

The 15% relative risk reduction translates to an absolute risk difference of approximately 1.6 percentage points over 2.8 years of median follow-up. The number needed to treat (NNT) to prevent one MACE event is roughly 63 over that period.

For context, high-intensity statins achieve NNTs of 15 to 25 for secondary prevention over 5 years in landmark trials like 4S and PROVE IT-TIMI 22. Alirocumab's incremental benefit on top of statins is real but substantially smaller in absolute terms.

This matters because alirocumab's annual wholesale cost exceeded $14,000 at U.S. launch. Even after subsequent price reductions, cost-effectiveness analyses from ICER and others have consistently flagged the NNT-to-cost ratio as a concern. Clinicians weighing this drug for a given patient must consider whether a ~1.6% absolute benefit over nearly 3 years justifies the expense, injection burden, and monitoring requirements.

3. The HealthRX Limitation-Severity Framework

To organize these criticisms beyond a simple list, we score each limitation on two axes: impact on internal validity (does it threaten whether the measured effect is real?) and impact on external validity (does it threaten whether the result applies to your patient?). Each axis is rated low, moderate, or high.

| Limitation | Internal Validity Threat | External Validity Threat | Net Concern | |---|---|---|---| | Run-in period filtering | Moderate | High | Inflates tolerability; real-world discontinuation rates will be higher | | Dose-titration to LDL target | Moderate | High | Clinicians cannot replicate blinded titration; ~25% received reduced dose or placebo-equivalent | | 4-component composite endpoint | Low | Low | Standard in CV trials, but dilutes signal from hardest endpoints | | Short median follow-up (2.8 yr) | Low | Moderate | Long-term safety unknown; benefit trajectory unclear | | Enriched post-ACS population | Low | High | Results may not extend to stable ASCVD or primary prevention | | Industry sponsorship and authorship | Moderate | Low | Sponsor controlled data; independent replication absent | | All-cause mortality non-significance | Low | Moderate | 15% MACE reduction did not translate to a statistically significant survival benefit in the ITT population |

This framework is not a rejection of the trial. It is a structured way to weigh which limitations matter most for a specific clinical scenario.

4. The Dose-Titration Design: Strength or Weakness?

ODYSSEY OUTCOMES used a blinded dose-adjustment protocol. Patients started on alirocumab 75 mg every 2 weeks; if LDL-C remained ≥ 50 mg/dL at week 8, the dose was increased to 150 mg. If LDL-C dropped below 15 mg/dL at consecutive visits, the dose was reduced to 75 mg, and if it remained below 15 mg/dL, the patient was switched to placebo in a blinded fashion.

This design has two consequences:

  1. It is impossible to replicate in clinical practice. Treat-to-target dosing with blinded switching requires knowledge of randomization status that the prescribing physician does not have. The FDA-approved Praluent label offers fixed-dose options (75 mg or 150 mg), but the titration algorithm used in the trial does not map cleanly onto clinical workflow.
  2. It muddies the effective dose. Approximately 25% of alirocumab-arm patients were receiving placebo by study end due to the blinded switch-down protocol. The ITT analysis includes these patients as "alirocumab-treated," which dilutes the observed treatment effect. On-treatment analyses suggest the benefit may be larger among those who stayed on active drug, but on-treatment analyses are susceptible to confounding.

5. Follow-Up Duration and Long-Term Safety

The median follow-up was 2.8 years, with a maximum of approximately 5 years. For a drug intended for chronic, potentially lifelong use in secondary prevention, this is a narrow observation window.

Specific concerns include:

  • Neurocognitive safety. Very low LDL-C levels (<25 mg/dL) were common in the alirocumab arm. The EBBINGHAUS substudy found no signal for cognitive decline over 2 years, but neurodegenerative processes unfold over decades, not years. The 2017 ACC Expert Consensus on nonstatin therapies noted that longer follow-up is needed to rule out neurocognitive risk at very low LDL-C.
  • Cancer incidence. No signal appeared during the trial, but the follow-up is too short to detect effects on malignancies with long latency periods.
  • Diabetes incidence. Post hoc analyses suggested a possible reduction in new-onset diabetes with alirocumab, but the trial was not powered or designed to confirm this. Citing it as a benefit is premature.

6. The All-Cause Mortality Signal: Real or Artifact?

A secondary analysis showed a nominally significant reduction in all-cause mortality (HR 0.85; 95% CI 0.73, 0.98) in the overall population, but this result was not adjusted for multiplicity within the hierarchical testing framework. In the prespecified testing hierarchy, the primary composite endpoint was significant, but subsequent endpoints in the hierarchy did not all reach significance, meaning the mortality finding cannot be treated as confirmatory.

A post hoc analysis restricted to patients with baseline LDL-C ≥ 100 mg/dL showed a more pronounced mortality reduction (HR 0.71), but post hoc subgroup analyses carry well-known risks of false-positive findings from multiple comparisons. The trial was not powered to detect mortality differences in subgroups.

7. Conflict of Interest and Sponsorship

ODYSSEY OUTCOMES was funded by Sanofi and Regeneron Pharmaceuticals, who jointly market alirocumab. The sponsors were involved in trial design, data collection, data analysis, and manuscript preparation. The steering committee had academic independence in interpretation, but the raw data were held by the sponsor.

This is standard practice in large cardiovascular outcomes trials, but it is still a limitation. Independent reanalysis of patient-level data has not been published. The FOURIER trial of evolocumab (the competing PCSK9 inhibitor) had a similar sponsor-dependent structure, meaning the entire PCSK9 inhibitor evidence base for MACE reduction rests on industry-sponsored trials without independent data verification.

Several letters to the editor following the NEJM publication raised concerns about the presentation of the mortality data and the emphasis on relative rather than absolute risk reduction in the primary manuscript.

8. Generalizability Gaps

Populations not well represented or explicitly excluded from ODYSSEY OUTCOMES include:

  • Stable ASCVD without recent ACS. The trial enrolled only post-ACS patients (1 to 12 months). Results cannot be directly extrapolated to patients with stable coronary artery disease, peripheral arterial disease, or cerebrovascular disease without a recent acute event.
  • Patients on moderate-intensity statins by choice. Many real-world patients take moderate-intensity statins due to preference or tolerability concerns rather than true intolerance. The trial required maximally tolerated statin therapy.
  • Statin-intolerant patients. Though a common reason for prescribing PCSK9 inhibitors, truly statin-intolerant patients made up a small fraction of enrollment.
  • Primary prevention. No data from this trial apply to primary prevention populations, despite the eventual expansion of alirocumab prescribing into some higher-risk primary prevention scenarios.
  • Patients over 80. The mean age was 58; enrollment of octogenarians was minimal.

9. Composite Endpoint Composition

The primary endpoint was a four-component composite: CHD death, nonfatal MI, ischemic stroke, and hospitalization for unstable angina. Including unstable angina hospitalization is somewhat unusual. It is a softer endpoint than MI or death, more susceptible to ascertainment bias and clinical judgment variation.

When the composite is decomposed, the strongest individual signal came from nonfatal MI reduction. CHD death alone did not reach significance. This pattern, where a composite is driven by softer components, is a recognized limitation across cardiovascular outcomes trials but is worth noting explicitly.

The Bottom Line

ODYSSEY OUTCOMES is a well-conducted, appropriately powered trial that provides genuine evidence for alirocumab's benefit in a specific post-ACS population. Its limitations do not invalidate its findings. They do, however, constrain how broadly those findings should be applied and how enthusiastically the mortality signal should be cited. Clinicians should weigh the modest absolute benefit, the cost, the injection burden, and the gaps in long-term safety data before prescribing, particularly for patients who fall outside the trial's enriched enrollment criteria.

Frequently asked questions

References

  1. Schwartz GG, Steg PG, Szarek M, et al. Alirocumab and Cardiovascular Outcomes after Acute Coronary Syndrome. N Engl J Med. 2018;379(22):2097-2107. PubMed
  2. Sabatine MS, Giugliano RP, Keech AC, et al. Evolocumab and Clinical Outcomes in Patients with Cardiovascular Disease (FOURIER). N Engl J Med. 2017;376(18):1713-1722. PubMed
  3. Grundy SM, Stone NJ, Bailey AL, et al. 2018 AHA/ACC/AACVPR/AAPA/ABC/ACPM/ADA/AGS/APhA/ASPC/NLA/PCNA Guideline on the Management of Blood Cholesterol. J Am Coll Cardiol. 2019;73(24):e285-e350. PubMed
  4. Lloyd-Jones DM, Morris PB, Ballantyne CM, et al. 2017 Focused Update of the 2016 ACC Expert Consensus Decision Pathway on the Role of Non-Statin Therapies for LDL-Cholesterol Lowering. J Am Coll Cardiol. 2017;70(14):1785-1822. PubMed
  5. Praluent (alirocumab) prescribing information. Regeneron Pharmaceuticals / Sanofi. FDA Label