Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort study

Background Identifying predictors of success in postgraduate examinations can help guide the career choices of medical students and may aid early identification of trainees requiring extra support to progress in specialty training. We assessed whether performance on the educational performance measu...

Full description

Saved in:
Bibliographic Details
Main Authors: Jennifer Cleland, Peter A Brennan, Amanda J Lee, Ricky Ellis, Duncan S G Scrimgeour
Format: Article
Language:English
Published: BMJ Publishing Group 2021-08-01
Series:BMJ Open
Online Access:https://bmjopen.bmj.com/content/11/8/e046615.full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846133741648347136
author Jennifer Cleland
Peter A Brennan
Amanda J Lee
Ricky Ellis
Duncan S G Scrimgeour
author_facet Jennifer Cleland
Peter A Brennan
Amanda J Lee
Ricky Ellis
Duncan S G Scrimgeour
author_sort Jennifer Cleland
collection DOAJ
description Background Identifying predictors of success in postgraduate examinations can help guide the career choices of medical students and may aid early identification of trainees requiring extra support to progress in specialty training. We assessed whether performance on the educational performance measurement (EPM) and situational judgement test (SJT) used for selection into foundation training predicted success at the Membership of the Royal College of Surgeons (MRCS) examination.Methods This was a longitudinal, cohort study using data from the UK Medical Education Database (https://www.ukmed.ac.uk). UK medical graduates who had attempted Part A (n=2585) and Part B (n=755) of the MRCS between 2014 and 2017 were included. χ2 and independent t-tests were used to examine the relationship between medical school performance and sociodemographic factors with first-attempt success at MRCS Part A and B. Multivariate logistic regression was employed to identify independent predictors of MRCS performance.Results The odds of passing MRCS increased by 55% for Part A (OR 1.55 (95% CI 1.48 to 1.61)) and 23% for Part B (1.23 (1.14 to 1.32)) for every additional EPM decile point gained. For every point awarded for additional degrees in the EPM, candidates were 20% more likely to pass MRCS Part A (1.20 (1.13 to 1.29)) and 17% more likely to pass Part B (1.17 (1.04 to 1.33)). For every point awarded for publications in the EPM, candidates were 14% more likely to pass MRCS Part A (1.14 (1.01 to 1.28)). SJT score was not a statistically significant independent predictor of MRCS success.Conclusion This study has demonstrated the EPM’s independent predictive power and found that medical school performance deciles are the most significant measure of predicting later success in the MRCS. These findings can be used by medical schools, training boards and workforce planners to inform evidence-based and contemporary selection and assessment strategies.
format Article
id doaj-art-416d1d0d813f4a17bedd8a5a3feb75d3
institution Kabale University
issn 2044-6055
language English
publishDate 2021-08-01
publisher BMJ Publishing Group
record_format Article
series BMJ Open
spelling doaj-art-416d1d0d813f4a17bedd8a5a3feb75d32024-12-09T13:35:08ZengBMJ Publishing GroupBMJ Open2044-60552021-08-0111810.1136/bmjopen-2020-046615Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort studyJennifer Cleland0Peter A Brennan1Amanda J Lee2Ricky Ellis3Duncan S G Scrimgeour4Lee Kong Chian School of Medicine, Nanyang Technological University, SingaporeDepartment of Maxillo-Facial Surgery, Queen Alexandra Hospital, Portsmouth, UKDepartment of Medical Statistics, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, UKUniversity of Aberdeen Institute of Applied Health Sciences, Aberdeen, UKUniversity of Aberdeen Institute of Applied Health Sciences, Aberdeen, UKBackground Identifying predictors of success in postgraduate examinations can help guide the career choices of medical students and may aid early identification of trainees requiring extra support to progress in specialty training. We assessed whether performance on the educational performance measurement (EPM) and situational judgement test (SJT) used for selection into foundation training predicted success at the Membership of the Royal College of Surgeons (MRCS) examination.Methods This was a longitudinal, cohort study using data from the UK Medical Education Database (https://www.ukmed.ac.uk). UK medical graduates who had attempted Part A (n=2585) and Part B (n=755) of the MRCS between 2014 and 2017 were included. χ2 and independent t-tests were used to examine the relationship between medical school performance and sociodemographic factors with first-attempt success at MRCS Part A and B. Multivariate logistic regression was employed to identify independent predictors of MRCS performance.Results The odds of passing MRCS increased by 55% for Part A (OR 1.55 (95% CI 1.48 to 1.61)) and 23% for Part B (1.23 (1.14 to 1.32)) for every additional EPM decile point gained. For every point awarded for additional degrees in the EPM, candidates were 20% more likely to pass MRCS Part A (1.20 (1.13 to 1.29)) and 17% more likely to pass Part B (1.17 (1.04 to 1.33)). For every point awarded for publications in the EPM, candidates were 14% more likely to pass MRCS Part A (1.14 (1.01 to 1.28)). SJT score was not a statistically significant independent predictor of MRCS success.Conclusion This study has demonstrated the EPM’s independent predictive power and found that medical school performance deciles are the most significant measure of predicting later success in the MRCS. These findings can be used by medical schools, training boards and workforce planners to inform evidence-based and contemporary selection and assessment strategies.https://bmjopen.bmj.com/content/11/8/e046615.full
spellingShingle Jennifer Cleland
Peter A Brennan
Amanda J Lee
Ricky Ellis
Duncan S G Scrimgeour
Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort study
BMJ Open
title Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort study
title_full Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort study
title_fullStr Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort study
title_full_unstemmed Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort study
title_short Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort study
title_sort does performance at medical school predict success at the intercollegiate membership of the royal college of surgeons mrcs examination a retrospective cohort study
url https://bmjopen.bmj.com/content/11/8/e046615.full
work_keys_str_mv AT jennifercleland doesperformanceatmedicalschoolpredictsuccessattheintercollegiatemembershipoftheroyalcollegeofsurgeonsmrcsexaminationaretrospectivecohortstudy
AT peterabrennan doesperformanceatmedicalschoolpredictsuccessattheintercollegiatemembershipoftheroyalcollegeofsurgeonsmrcsexaminationaretrospectivecohortstudy
AT amandajlee doesperformanceatmedicalschoolpredictsuccessattheintercollegiatemembershipoftheroyalcollegeofsurgeonsmrcsexaminationaretrospectivecohortstudy
AT rickyellis doesperformanceatmedicalschoolpredictsuccessattheintercollegiatemembershipoftheroyalcollegeofsurgeonsmrcsexaminationaretrospectivecohortstudy
AT duncansgscrimgeour doesperformanceatmedicalschoolpredictsuccessattheintercollegiatemembershipoftheroyalcollegeofsurgeonsmrcsexaminationaretrospectivecohortstudy