Assessing competence in cochlear implant surgery using the newly developed Cochlear Implant Surgery Assessment Tool.
Eur Arch Otorhinolaryngol. 2021 Feb 19;:
Authors: Frendø M, Frithioff A, Konge L, Foghsgaard S, Mikkelsen PT, Sørensen MS, Cayé-Thomasen P, Andersen SAW
Abstract
PURPOSE: To develop and gather validity evidence for a novel tool for assessment of cochlear implant (CI) surgery, including virtual reality CI surgery training.
METHODS: Prospective study gathering validity evidence according to Messick's framework. Four experts developed the CI Surgery Assessment Tool (CISAT). A total of 35 true novices (medical students), trained novices (residents) and CI surgeons performed two CI-procedures each in the Visible Ear Simulator, which were rated by three blinded experts. Classical test theory and generalizability theory were used for reliability analysis.
RESULTS: The CISAT significantly discriminated between the three groups (p < 0.001). The generalizability coefficient was 0.76 and most of the score variance (53.3%) was attributable to the participant and only 6.8% to the raters. When exploring a standard setting for CI surgery, the contrasting groups method suggested a pass/fail score of 36.0 points (out of 55), but since the trained novices performed above this, we propose using the mean CI surgeon performance score (45.3 points).
CONCLUSION: Validity evidence for simulation-based assessment of CI performance supports the CISAT. Together with the standard setting, the CISAT might be used to monitor progress in competency-based training of CI surgery and to determine when the trainee can advance to further training.
PMID: 33604749 [PubMed - as supplied by publisher]
No comments:
Post a Comment