Oral Examination versus Simulation-Based Assessment in Assessing Patient Care Competencies for Emergency Medicine Residents
Background: Assessment is essential for any accreditation process in the medical field. If a candidate passes a high-stakes assessment, they can work independently. While oral examinations are common, given the complexity of clinical competencies, such an approach may not be the most effective asses...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Knowledge E
2022-07-01
|
| Series: | Dubai Medical Journal |
| Subjects: | |
| Online Access: | https://beta.karger.com/Article/FullText/525868 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846146201848643584 |
|---|---|
| author | Wail Bamadhaf |
| author_facet | Wail Bamadhaf |
| author_sort | Wail Bamadhaf |
| collection | DOAJ |
| description | Background: Assessment is essential for any accreditation process in the medical field. If a candidate passes a high-stakes assessment, they can work independently. While oral examinations are common, given the complexity of clinical competencies, such an approach may not be the most effective assessment method. A form of performance-based assessment, such as a simulation, may be beneficial in this context. Objectives: This study aims to determine whether the results of oral examinations match those of simulation-based assessments when both modalities are used to evaluate residents’ performance in scenarios featuring similar content. It also seeks to determine whether oral examinations under- or overestimate residents’ competencies concerning patient care when compared to their simulation performance. Methods: This is a cross-sectional, single-centre study. Emergency medicine residents underwent an oral examination and completed a simulation-based assessment. Standardized scenarios were used to assess the residents’ emergency medicine competencies. A global rating scale was used to rate participants’ performance in each assessment modality. Results: There was a moderate positive correlation between oral examination and simulation-based assessment results (r = 0.699, p < 0.05, n = 28). A paired t test indicates that the oral examination overestimates residents’ competency compared to the simulation-based assessment; the mean difference is 0.26 (confidence interval: 0.041–0.493). Conclusions: Emergency medicine residents whose knowledge was assessed at the “know-how” level of Miller’s pyramid in the oral examination were not necessarily able to move up to the level of “show-how” by demonstrating the ability to apply their knowledge in the simulation-based assessment. The findings of this study confirm that simulation-based assessments should be an essential aspect of high-stakes examinations intended to determine residents’ different clinical competencies. |
| format | Article |
| id | doaj-art-0954cae1522d4c74b102fbd5e1f8ad05 |
| institution | Kabale University |
| issn | 2571-726X |
| language | English |
| publishDate | 2022-07-01 |
| publisher | Knowledge E |
| record_format | Article |
| series | Dubai Medical Journal |
| spelling | doaj-art-0954cae1522d4c74b102fbd5e1f8ad052024-12-02T04:06:48ZengKnowledge EDubai Medical Journal2571-726X2022-07-011610.1159/000525868525868Oral Examination versus Simulation-Based Assessment in Assessing Patient Care Competencies for Emergency Medicine ResidentsWail Bamadhafhttps://orcid.org/0000-0002-6609-4551Background: Assessment is essential for any accreditation process in the medical field. If a candidate passes a high-stakes assessment, they can work independently. While oral examinations are common, given the complexity of clinical competencies, such an approach may not be the most effective assessment method. A form of performance-based assessment, such as a simulation, may be beneficial in this context. Objectives: This study aims to determine whether the results of oral examinations match those of simulation-based assessments when both modalities are used to evaluate residents’ performance in scenarios featuring similar content. It also seeks to determine whether oral examinations under- or overestimate residents’ competencies concerning patient care when compared to their simulation performance. Methods: This is a cross-sectional, single-centre study. Emergency medicine residents underwent an oral examination and completed a simulation-based assessment. Standardized scenarios were used to assess the residents’ emergency medicine competencies. A global rating scale was used to rate participants’ performance in each assessment modality. Results: There was a moderate positive correlation between oral examination and simulation-based assessment results (r = 0.699, p < 0.05, n = 28). A paired t test indicates that the oral examination overestimates residents’ competency compared to the simulation-based assessment; the mean difference is 0.26 (confidence interval: 0.041–0.493). Conclusions: Emergency medicine residents whose knowledge was assessed at the “know-how” level of Miller’s pyramid in the oral examination were not necessarily able to move up to the level of “show-how” by demonstrating the ability to apply their knowledge in the simulation-based assessment. The findings of this study confirm that simulation-based assessments should be an essential aspect of high-stakes examinations intended to determine residents’ different clinical competencies.https://beta.karger.com/Article/FullText/525868miller’s pyramid of assessmentoral examinationsimulation-based assessmenthigh-stakes assessmentmedical education |
| spellingShingle | Wail Bamadhaf Oral Examination versus Simulation-Based Assessment in Assessing Patient Care Competencies for Emergency Medicine Residents Dubai Medical Journal miller’s pyramid of assessment oral examination simulation-based assessment high-stakes assessment medical education |
| title | Oral Examination versus Simulation-Based Assessment in Assessing Patient Care Competencies for Emergency Medicine Residents |
| title_full | Oral Examination versus Simulation-Based Assessment in Assessing Patient Care Competencies for Emergency Medicine Residents |
| title_fullStr | Oral Examination versus Simulation-Based Assessment in Assessing Patient Care Competencies for Emergency Medicine Residents |
| title_full_unstemmed | Oral Examination versus Simulation-Based Assessment in Assessing Patient Care Competencies for Emergency Medicine Residents |
| title_short | Oral Examination versus Simulation-Based Assessment in Assessing Patient Care Competencies for Emergency Medicine Residents |
| title_sort | oral examination versus simulation based assessment in assessing patient care competencies for emergency medicine residents |
| topic | miller’s pyramid of assessment oral examination simulation-based assessment high-stakes assessment medical education |
| url | https://beta.karger.com/Article/FullText/525868 |
| work_keys_str_mv | AT wailbamadhaf oralexaminationversussimulationbasedassessmentinassessingpatientcarecompetenciesforemergencymedicineresidents |