The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions

Abstract Background Retrieval practice is a highly effective learning strategy that enhances long-term retention by encouraging the active recall of information. However, the optimal question format for maximizing knowledge retention remains uncertain. In this study, we compared the effect of very s...

Full description

Saved in:
Bibliographic Details
Main Authors: Elise V. van Wijk, Mario de Jonge, Floris M. van Blankenstein, Roemer J. Janse, Alexandra M.J. Langers
Format: Article
Language:English
Published: BMC 2024-12-01
Series:BMC Medical Education
Subjects:
Online Access:https://doi.org/10.1186/s12909-024-06538-0
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841559403860328448
author Elise V. van Wijk
Mario de Jonge
Floris M. van Blankenstein
Roemer J. Janse
Alexandra M.J. Langers
author_facet Elise V. van Wijk
Mario de Jonge
Floris M. van Blankenstein
Roemer J. Janse
Alexandra M.J. Langers
author_sort Elise V. van Wijk
collection DOAJ
description Abstract Background Retrieval practice is a highly effective learning strategy that enhances long-term retention by encouraging the active recall of information. However, the optimal question format for maximizing knowledge retention remains uncertain. In this study, we compared the effect of very short answer (VSAQ) versus multiple-choice question (MCQ) practice tests on students’ knowledge retention. By analyzing these two formats, we aim to identify the most effective approach to retrieval practice, thereby helping to optimize its implementation and improve learning outcomes. Methods In this randomized within-subjects study, students (n = 45) practiced with both VSAQs and MCQs in an extracurricular lifestyle course, without receiving feedback. The final retention test consisted of identical questions in both formats. A 2 × 2 repeated measures ANOVA was used to determine the effect of question format in practice testing and final test on final test score. Additionally, digital questionnaires were used to explore students’ test-taking experiences. Results The VSAQs were answered incorrectly more frequently on the practice tests and final test. There was no main effect of practice question format on final test performance, and no interaction effect between question format on the practice and final test. Regardless of question format, most students thought the practice tests were beneficial for learning. Conclusions We found no evidence indicating that either MCQ or VSAQ is more effective for knowledge retention during retrieval practice. The lower initial retrieval success in the VSAQs, indicated by the higher degree of incorrect answers on the practice tests, might have limited their effectiveness during retrieval practice. To optimize the use of VSAQs in retrieval practice, it seems important to improve initial retrieval success to maximize learning outcomes. Clinical trial number Not applicable.
format Article
id doaj-art-f5dc8321dd0742f7b8ea2677bd30a446
institution Kabale University
issn 1472-6920
language English
publishDate 2024-12-01
publisher BMC
record_format Article
series BMC Medical Education
spelling doaj-art-f5dc8321dd0742f7b8ea2677bd30a4462025-01-05T12:33:49ZengBMCBMC Medical Education1472-69202024-12-0124111010.1186/s12909-024-06538-0The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questionsElise V. van Wijk0Mario de Jonge1Floris M. van Blankenstein2Roemer J. Janse3Alexandra M.J. Langers4Center for Innovation in Medical Education, Leiden University Medical CenterLeiden University Graduate School of Teaching, Leiden UniversityCenter for Innovation in Medical Education, Leiden University Medical CenterDepartment of Clinical Epidemiology, Leiden University Medical CenterDepartment of Gastroenterology and Hepatology, Leiden University Medical CenterAbstract Background Retrieval practice is a highly effective learning strategy that enhances long-term retention by encouraging the active recall of information. However, the optimal question format for maximizing knowledge retention remains uncertain. In this study, we compared the effect of very short answer (VSAQ) versus multiple-choice question (MCQ) practice tests on students’ knowledge retention. By analyzing these two formats, we aim to identify the most effective approach to retrieval practice, thereby helping to optimize its implementation and improve learning outcomes. Methods In this randomized within-subjects study, students (n = 45) practiced with both VSAQs and MCQs in an extracurricular lifestyle course, without receiving feedback. The final retention test consisted of identical questions in both formats. A 2 × 2 repeated measures ANOVA was used to determine the effect of question format in practice testing and final test on final test score. Additionally, digital questionnaires were used to explore students’ test-taking experiences. Results The VSAQs were answered incorrectly more frequently on the practice tests and final test. There was no main effect of practice question format on final test performance, and no interaction effect between question format on the practice and final test. Regardless of question format, most students thought the practice tests were beneficial for learning. Conclusions We found no evidence indicating that either MCQ or VSAQ is more effective for knowledge retention during retrieval practice. The lower initial retrieval success in the VSAQs, indicated by the higher degree of incorrect answers on the practice tests, might have limited their effectiveness during retrieval practice. To optimize the use of VSAQs in retrieval practice, it seems important to improve initial retrieval success to maximize learning outcomes. Clinical trial number Not applicable.https://doi.org/10.1186/s12909-024-06538-0Retrieval practiceTest-enhanced learningTesting effectQuestion formatVery short answer questionMultiple-choice question
spellingShingle Elise V. van Wijk
Mario de Jonge
Floris M. van Blankenstein
Roemer J. Janse
Alexandra M.J. Langers
The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions
BMC Medical Education
Retrieval practice
Test-enhanced learning
Testing effect
Question format
Very short answer question
Multiple-choice question
title The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions
title_full The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions
title_fullStr The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions
title_full_unstemmed The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions
title_short The battle of question formats: a comparative study of retrieval practice using very short answer questions and multiple choice questions
title_sort battle of question formats a comparative study of retrieval practice using very short answer questions and multiple choice questions
topic Retrieval practice
Test-enhanced learning
Testing effect
Question format
Very short answer question
Multiple-choice question
url https://doi.org/10.1186/s12909-024-06538-0
work_keys_str_mv AT elisevvanwijk thebattleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT mariodejonge thebattleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT florismvanblankenstein thebattleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT roemerjjanse thebattleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT alexandramjlangers thebattleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT elisevvanwijk battleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT mariodejonge battleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT florismvanblankenstein battleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT roemerjjanse battleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions
AT alexandramjlangers battleofquestionformatsacomparativestudyofretrievalpracticeusingveryshortanswerquestionsandmultiplechoicequestions