Summary

Toxicology questions in Spanish medical licensing exams (MIR): accuracy of artificial intelligence vs a group of clinical toxicology experts

Santiago Nogué-Xarau1, José Ríos-Guillermo2, Montserrat Amigó-Tadin3, en nombre del Grupo de Trabajo de Toxicología de la Sociedad Catalana de Medicina de Urgencias y Emergencias (SoCMUETox)

Affiliation of the authors

1Fundación Española de Toxicología Clínica, Spain. 2Departamento de Farmacología Clínica, Hospital Clínic y Unidad de Estadística Médica, Instituto de Investigaciones Biomédicas August Pi i Sunyer (FCRB-IDIBAPS), Barcelona, Spain. 3Servicio de Urgencias, Hospital Clínic de Barcelona, Spain.

DOI

Quote

Nogué-Xarau S, Ríos-Guillermo J, Amigó-Tadin M, en nombre del Grupo de Trabajo de Toxicología de la Sociedad Catalana de Medicina de Urgencias y Emergencias (SoCMUETox). Toxicology questions in Spanish medical licensing exams (MIR): accuracy of artificial intelligence vs a group of clinical toxicology experts. Rev Esp Urg Emerg. 2026;5:36–41

Summary

OBJECTIVE. To assess the ability of several artificial intelligence (AI) systems to correctly answer toxicology questions from Spain’s Médico Interno Residente (MIR) licensing exams and to compare their accuracy with that of a group of clinical toxicologists.
MATERIAL AND METHODS. We selected toxicology-related questions from the MIR exams (2019–2023) and showed them to 7 AI chatbots (ChatGPT, Gemini, Copilot, Luzia, Claude, Deepseek, and Le Chat) and to a group of clinical toxicologists. The number of correct answers was recorded for each participant.
RESULTS. A total of 44 questions were included. AI systems completed the exam in a median of 1.01 (0.82–1.52) minutes vs 42.00 (28.50–53.50) minutes for toxicologists (P < .001). AI achieved a median of 41 (39–42) correct answers while toxicologists achieved 32 answers (26–36) (P < .001). No differences were found among toxicologists by age, sex, or specialty, nor between theoretical and case report-based questions.
CONCLUSIONS. AI chatbots answered toxicology questions from MIR exams faster and with higher accuracy than a group of clinical toxicologists.

 

More articles by the authors

Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.