Consolidated Health Economic Evaluation Reporting Standards for Interventions That Use Artificial Intelligence (CHEERS-AI)

The CHEERS-AI Steering Group, Jamie Elvidge*, Claire Hawksworth, Tuba Saygın Avşar, Antal Zemplenyi, Anastasia Chalkidou, Stavros Petrou, Zsuzsanna Petykó, Divya Srivastava, Gunjan Chandra, Julien Delaye, Manuel Gomes, Saskia Knies, Petros Nousios, Pekka Siirtola, Junfeng Wang, Dalia Dawoud

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Objectives: Economic evaluations (EEs) are commonly used by decision makers to understand the value of health interventions. The Consolidated Health Economic Evaluation Reporting Standards (CHEERS 2022) provide reporting guidelines for EEs. Healthcare systems will increasingly see new interventions that use artificial intelligence (AI) to perform their function. We developed Consolidated Health Economic Evaluation Reporting Standards for Interventions that use AI (CHEERS-AI) to ensure EEs of AI-based health interventions are reported in a transparent and reproducible manner. Methods: Potential CHEERS-AI reporting items were informed by 2 published systematic literature reviews of EEs and a contemporary update. A Delphi study was conducted using 3 survey rounds to elicit multidisciplinary expert views on 26 potential items, through a 9-point Likert rating scale and qualitative comments. An online consensus meeting was held to finalize outstanding reporting items. A digital health patient group reviewed the final checklist from a patient perspective. Results: A total of 58 participants responded to survey round 1, 42, and 31 of whom responded to rounds 2 and 3, respectively. Nine participants joined the consensus meeting. Ultimately, 38 reporting items were included in CHEERS-AI. They comprised the 28 original CHEERS 2022 items, plus 10 new AI-specific reporting items. Additionally, 8 of the original CHEERS 2022 items were elaborated on to ensure AI-specific nuance is reported. Conclusions: CHEERS-AI should be used when reporting an EE of an intervention that uses AI to perform its function. CHEERS-AI will help decision makers and reviewers to understand important AI-specific details of an intervention, and any implications for the EE methods used and cost-effectiveness conclusions.

Original languageEnglish
Pages (from-to)1196-1205
Number of pages10
JournalValue in Health
Volume27
Issue number9
Early online date23 May 2024
DOIs
Publication statusPublished - Sept 2024

Bibliographical note

Publisher Copyright:
© 2024

Funding

This study has been supported by Next Generation Health Technology Assessment (HTx) . The HTx project has received funding from the European Union's Horizon 2020 research and innovation program under grant agreement No 825162. Its main aim is to create a framework for the next generation of HTA to support patient-centered, societally oriented, and real-time decision making on access to and reimbursement for health technologies throughout Europe. This dissemination reflects only the authors' views, and the Commission is not responsible for any use that may be made of the information it contains. Stavros Petrou receives support as a UK National Institute for Health and Care Research (NIHR) Senior Investigator (NF-SI-0616-10103) and from the NIHR Applied Research Collaboration Oxford and Thames Valley.

FundersFunder number
Next Generation Health Technology Assessment
Thames Valley.Role of Funders
Health Technology Assessment Programme
Sponsors
NIHR Applied Research Collaboration Oxford
European Commission
HTx
Horizon 2020
Horizon 2020 Framework Programme825162
Horizon 2020 Framework Programme
National Institute for Health and Care ResearchNF-SI-0616-10103
National Institute for Health and Care Research

    Keywords

    • artificial intelligence
    • CHEERS checklist
    • health economic evaluation
    • reporting guideline

    Fingerprint

    Dive into the research topics of 'Consolidated Health Economic Evaluation Reporting Standards for Interventions That Use Artificial Intelligence (CHEERS-AI)'. Together they form a unique fingerprint.

    Cite this