Development and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in Nigeria
Abstract Background The personal qualities of health workers determine the way health services are provided to clients. Some key personal qualities (also called behavioural competencies) of physicians that contribute to quality healthcare delivery include ethical responsibility, empathy, patient-cen...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2024-11-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12909-024-06298-x |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846165148750839808 |
|---|---|
| author | Uche Shalom Obi Adanna Chukwuma Ifunanya Agu Godstime Eigbiremolen Chinyere Mbachu |
| author_facet | Uche Shalom Obi Adanna Chukwuma Ifunanya Agu Godstime Eigbiremolen Chinyere Mbachu |
| author_sort | Uche Shalom Obi |
| collection | DOAJ |
| description | Abstract Background The personal qualities of health workers determine the way health services are provided to clients. Some key personal qualities (also called behavioural competencies) of physicians that contribute to quality healthcare delivery include ethical responsibility, empathy, patient-centeredness, diligence, good judgment, respectful, teamwork, team leadership/conflict management, ability to take correction and tolerance. In this study, we developed and validated clinical scenarios (dilemmas) for assessing priority behavioural competencies for medical practice in Nigeria. Methods Drawing on prioritized competencies generated via a scoping review and nominal group technique (NGT) exercises in a previous study in the study series, Faculty members from the University of Nigeria Teaching Hospital were consulted to develop or adapt clinical scenarios that could be used to assess these competencies in a physician. The clinical scenarios and options were framed as situational judgement tests (SJTs) and these tests were administered to a random sample of 192 undergraduate and 111 postgraduate medical doctors in a tertiary hospital in Enugu State. Using Kane’s validity argument framework, we assessed scoring and generalization inferences of situational judgment tests (SJT) based on the developed scenarios. Result Scoring inference – difficulty and discrimination index – shows that most of the SJT items are good test items and can differentiate between high and low performers. The corrected point biserial correlations show positive correlation for most of the items. Generalization inference shows the items represent the domains of interest and are internally consistent. However, few items that show poor difficulty and discrimination index were subjected to re-evaluation and possible elimination. Conclusion This study has produced a set of valid clinical scenarios that can be used to evaluate specific behavioural competencies among trainee medical doctors. It demonstrates that SJTs can be used to assess behavioural competencies for medical practice. However, further research is needed to establish the applicability of SJT beyond the immediate context, such as the medical school, in which it is developed. |
| format | Article |
| id | doaj-art-d733f6c7279a4e5fa862497f6f277633 |
| institution | Kabale University |
| issn | 1472-6920 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj-art-d733f6c7279a4e5fa862497f6f2776332024-11-17T12:33:45ZengBMCBMC Medical Education1472-69202024-11-0124111010.1186/s12909-024-06298-xDevelopment and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in NigeriaUche Shalom Obi0Adanna Chukwuma1Ifunanya Agu2Godstime Eigbiremolen3Chinyere Mbachu4Health Policy Research Group, University of NigeriaWorld Bank GroupHealth Policy Research Group, University of NigeriaDepartment of Economics, University of NigeriaDepartment of Community Medicine, College of Medicine, University of Nigeria, Enugu-CampusAbstract Background The personal qualities of health workers determine the way health services are provided to clients. Some key personal qualities (also called behavioural competencies) of physicians that contribute to quality healthcare delivery include ethical responsibility, empathy, patient-centeredness, diligence, good judgment, respectful, teamwork, team leadership/conflict management, ability to take correction and tolerance. In this study, we developed and validated clinical scenarios (dilemmas) for assessing priority behavioural competencies for medical practice in Nigeria. Methods Drawing on prioritized competencies generated via a scoping review and nominal group technique (NGT) exercises in a previous study in the study series, Faculty members from the University of Nigeria Teaching Hospital were consulted to develop or adapt clinical scenarios that could be used to assess these competencies in a physician. The clinical scenarios and options were framed as situational judgement tests (SJTs) and these tests were administered to a random sample of 192 undergraduate and 111 postgraduate medical doctors in a tertiary hospital in Enugu State. Using Kane’s validity argument framework, we assessed scoring and generalization inferences of situational judgment tests (SJT) based on the developed scenarios. Result Scoring inference – difficulty and discrimination index – shows that most of the SJT items are good test items and can differentiate between high and low performers. The corrected point biserial correlations show positive correlation for most of the items. Generalization inference shows the items represent the domains of interest and are internally consistent. However, few items that show poor difficulty and discrimination index were subjected to re-evaluation and possible elimination. Conclusion This study has produced a set of valid clinical scenarios that can be used to evaluate specific behavioural competencies among trainee medical doctors. It demonstrates that SJTs can be used to assess behavioural competencies for medical practice. However, further research is needed to establish the applicability of SJT beyond the immediate context, such as the medical school, in which it is developed.https://doi.org/10.1186/s12909-024-06298-xValidationMedical assessmentBehavioral competenicesMedical practice |
| spellingShingle | Uche Shalom Obi Adanna Chukwuma Ifunanya Agu Godstime Eigbiremolen Chinyere Mbachu Development and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in Nigeria BMC Medical Education Validation Medical assessment Behavioral competenices Medical practice |
| title | Development and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in Nigeria |
| title_full | Development and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in Nigeria |
| title_fullStr | Development and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in Nigeria |
| title_full_unstemmed | Development and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in Nigeria |
| title_short | Development and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in Nigeria |
| title_sort | development and validation of situational judgement test for assessment of behavioural competencies required for effective medical practice in nigeria |
| topic | Validation Medical assessment Behavioral competenices Medical practice |
| url | https://doi.org/10.1186/s12909-024-06298-x |
| work_keys_str_mv | AT ucheshalomobi developmentandvalidationofsituationaljudgementtestforassessmentofbehaviouralcompetenciesrequiredforeffectivemedicalpracticeinnigeria AT adannachukwuma developmentandvalidationofsituationaljudgementtestforassessmentofbehaviouralcompetenciesrequiredforeffectivemedicalpracticeinnigeria AT ifunanyaagu developmentandvalidationofsituationaljudgementtestforassessmentofbehaviouralcompetenciesrequiredforeffectivemedicalpracticeinnigeria AT godstimeeigbiremolen developmentandvalidationofsituationaljudgementtestforassessmentofbehaviouralcompetenciesrequiredforeffectivemedicalpracticeinnigeria AT chinyerembachu developmentandvalidationofsituationaljudgementtestforassessmentofbehaviouralcompetenciesrequiredforeffectivemedicalpracticeinnigeria |