Associations between uncertainties identified by the European Medicines Agency and national decision making on reimbursement by HTA agencies

We aimed to determine whether uncertainties identified by the European Medicines Agency (EMA) were associated with negative relative effectiveness assessments (REAs) and negative overall reimbursement recommendations by national health technology assessment (HTA) agencies. Therefore, we identified all HTA reports from Haute Autorité de Santé (HAS; France), National Institute for Health and Care Excellence (NICE; England/Wales), Scottish Medicine Consortium (SMC; Scotland), and Zorginstituut Nederland (ZIN; The Netherlands) for a cohort of innovative medicines that the EMA had approved in 2009 to 2010 (excluding vaccines). Uncertainty regarding pivotal trial methodology, clinical outcomes, and their clinical relevance were combined to reflect a low, medium, or high level of uncertainty. We assessed associations by calculating risk ratios (RRs) and 95% confidence intervals (CIs), and agreement between REA and overall reimbursement recommendation outcomes. We identified 36 medicines for which 121 reimbursement recommendations had been issued by the HTA agencies between September 2009 and July 2018. High versus low uncertainty was associated with an increased risk for negative REAs and negative overall reimbursement recommendations: RRs 1.9 (95% CI 0.9–3.9) and 1.6 (95% CI 0.7–3.5), respectively, which was supported by further sensitivity analyses. We identified a lack of agreement between 33 (27%) REA and overall reimbursement recommendation outcomes, which were mostly restricted recommendations that followed on negative REAs in case of low or medium uncertainty. In conclusion, high uncertainty identified by the EMA was associated with negative REAs and negative overall reimbursement recommendations. To reduce uncertainty and ultimately facilitate efficient patient access, regulators, HTA agencies, and other stakeholders should discuss how uncertainties should be weighed and addressed early in the drug life cycle of innovative treatments.