Psychometric validation of the Ottawa Global Rating Scale for Crisis Resource Management in clinical simulation: evidence of inter-rater reliability and convergent validity in Argentina

Carolina Iris Pereyra-Girardi , Norma Beatriz Raúl , Gustavo Alberto Costa , Silvia Liliana García , Silvia Déborah Ofman

INTRODUCTION. Clinical simulation (CS) has become a key tool for the training of healthcare professionals, allowing the development of both technical and non-technical skills (NTS) in safe environments. The assessment of NTS remains challenging due to the lack of locally validated instruments. The aim of this study was to analyze the psychometric properties of the Ottawa Global Rating Scale for Crisis Resource Management adapted to the Argentine context.
MATERIAL AND METHODS. We conducted a quantitative, nonexperimental psychometric instrumental study. The sample consisted of 95 simulated cases recorded on video at Hospital Universitario de Simulación Clínica de la Universidad Nacional Arturo Jauretche. Three expert judges evaluated the performance of health care teams using the scale. Intraclass correlation coefficients (ICC) were calculated to estimate interrater reliability, Cronbach’s alpha for internal consistency, and Pearson correlations for concurrent validity.
RESULTS. Internal consistency values were excellent (α = 0.932–0.977). Interrater reliability was moderate for individual measures (ICC, 0.455–0.808) and excellent for average measures (ICC, 0.914–0.944). Positive and significant correlations were observed between both versions of the scale (r = 0.749–0.920; P < .01), confirming concurrent validity.
CONCLUSIONS. The Argentine version of the Ottawa Global Rating Scale for Crisis Management shows strong evidence of reliability and validity and represents a useful, reliable, and culturally appropriate tool for assessing non-technical skills in clinical simulation among health care teams.