Increasing Authenticity of Simulation-Based Assessment in Diagnostic Radiology

Anouk van der Gijp, Cécile J. Ravesloot, Corinne A Tipker, Kim de Crom, Dik R Rutgers, Marieke F van der Schaaf, Irene C. van der Schaaf, Christian P. Mol, Koen L Vincken, Olle Th J Ten Cate, Mario Maas, Jan P J van Schaik

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

INTRODUCTION: Clinical reasoning in diagnostic imaging professions is a complex skill that requires processing of visual information and image manipulation skills. We developed a digital simulation-based test method to increase authenticity of image interpretation skill assessment.

METHODS: A digital application, allowing volumetric image viewing and manipulation, was used for three test administrations of the national Dutch Radiology Progress Test for residents. This study describes the development and implementation process in three phases. To assess authenticity of the digital tests, perceived image quality and correspondence to clinical practice were evaluated and compared with previous paper-based tests (PTs). Quantitative and qualitative evaluation results were used to improve subsequent tests.

RESULTS: Authenticity of the first digital test was not rated higher than the PTs. Test characteristics and environmental conditions, such as image manipulation options and ambient lighting, were optimized based on participants' comments. After adjustments in the third digital test, participants favored the image quality and clinical correspondence of the digital image questions over paper-based image questions.

CONCLUSIONS: Digital simulations can increase authenticity of diagnostic radiology assessments compared with paper-based testing. However, authenticity does not necessarily increase with higher fidelity. It can be challenging to simulate the image interpretation task of clinical practice in a large-scale assessment setting, because of technological limitations. Optimizing image manipulation options, the level of ambient light, time limits, and question types can help improve authenticity of simulation-based radiology assessments.

Original languageEnglish
JournalSimulation in healthcare : journal of the Society for Simulation in Healthcare
Volume12
Issue number6
DOIs
Publication statusPublished - Dec 2017

Keywords

  • Journal Article

Fingerprint

Dive into the research topics of 'Increasing Authenticity of Simulation-Based Assessment in Diagnostic Radiology'. Together they form a unique fingerprint.

Cite this