Differential rater function over time (DRIFT) during student simulations
Sebastian Diebel, Eve Boissonneault, Luc Perreault, René Lapierre
Saturday, July 2, 2022
Background:
The field of paramedicine continues to advance in scope. Simulation training is frequently used to teach and evaluate students. Simulation examinations are often evaluated using a standardised global rating scale (GRS) that is reliable and valid. However, differential rater function over time (DRIFT) has not been evaluated when using the GRS during simulations.
Aims:
This study aimed to assess if DRIFT arises when applying the GRS.
Methods:
Data were collected at six simulation evaluations. Raters were randomly assigned to evaluate several students at the same station. Each station lasted 12 minutes and there was a total of 11 stations. A model to test DRIFT scores was created and was tested against both a leniency and perceptual model.
Findings:
Of the models explored, one that included students, the rater, and the dimensions had the greatest evidence (−3151 Bayes factors). This model was then tested against leniency (K=−9.1 dHart) and perceptual models (K=−7.1 dHart). This suggests a substantial finding against DRIFT; however, the tested models used a wide parameter so the possibility of a minor effect is not fully excluded.
Conclusion:
DRIFT was not found; however, further studies with multiple centres and longer evaluations should be conducted.
Subscribe to get full access to International Paramedic Practice
Thank you for vising International Paramedic Practice and reading our archive of expert clinical content. If you would like to read more from the only journal dedicated to those working in emergency care, you can start your subscription today for just £48.
CPD Focus
Reading the International Paramedic Practice counts towards your professional development
Develop your career
We provide professional information dedicated to paramedics covering training, education and jobs
Stay informed
Get the latest clinical information to ensure you are aware of the latest think and best practice in paramedicne
Subscribe now
Already registered? - Sign in here
