Validation of a New Assessment Tool for Chest Tube Insertion (ACTION) on Two Different Simulators

Educational assessments need a validity argument before they are being used to evaluate trainees. An assessment needs to show it can be used as an objective and reliable tool. Messick's framework of validity collects this evidence from five different sources: content, response process, relation to other variables, internal structure and consequences. The ACTION-tool has been developed based on a Delphi consensus study (and has established content evidence as a result). This study will collect evidence from the four remaining sources. Two groups of participants (novices and experienced) will be recruited. All participants will provide informed consent and demographic information. Afterwards, they will be informed of the study, will familiarise themselves with the simulators, watch an educational video, and will be asked to perform two chest tube insertions (CTI). All participants will be evaluated by a live rater, and will be recorded using a head-mounted GoPro and an overview camera. The recordings will be edited to ensure anonymization, and will be subsequently rated by three blinded raters. Statistical analysis will evaluate the difference in mean scores between the groups, the internal structure using G-theory, and will establish a pass/fail score.