Comparison of the validity, perceived usefulness and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability: a study protocol
Introduction Research has shown that improvements to the usability of medication alert systems are needed. For designers and decisions-makers to assess usability of their alert systems, two paper-based tools are currently available: the instrument for evaluating human-factors principles in medicatio...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2021-08-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/11/8/e050448.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846127855670394880 |
|---|---|
| author | Melissa T Baysari Wu Yi Zheng Regis Beuscart |
| author_facet | Melissa T Baysari Wu Yi Zheng Regis Beuscart |
| author_sort | Melissa T Baysari |
| collection | DOAJ |
| description | Introduction Research has shown that improvements to the usability of medication alert systems are needed. For designers and decisions-makers to assess usability of their alert systems, two paper-based tools are currently available: the instrument for evaluating human-factors principles in medication-related decision support alerts (I-MeDeSA) and the tool for evaluating medication alerting systems (TEMAS). This study aims to compare the validity, usability and usefulness of both tools to identify their strengths and limitations and assist designers and decision-makers in making an informed decision about which tool is most suitable for assessing their current or prospective system.Methods and analysis First, TEMAS and I-MeDeSA will be translated into French. This translation will be validated by three experts in human factors. Then, in 12 French hospitals with a medication alert system in place, staff with expertise in the system will evaluate their alert system using the two tools successively. After the use of each tool, participants will be asked to fill in the System Usability Scale (SUS) and complete a survey on the understandability and perceived usefulness of each tool. Following the completion of both assessments, participants will be asked to nominate their preferred tool and relay their opinions on the tools. The design philosophy of TEMAS and I-MeDeSA differs on the calculation of a score, impacting the way the comparison between the tools can be performed. Convergent validity will be evaluated by matching the items of the two tools with respect to the usability dimensions they assess. SUS scores and answers to the survey will be statistically compared for I-MeDeSA and TEMAS to identify differences. Free-text responses in surveys will be analysed using an inductive approach.Ethics and dissemination Ethical approval is not required in France for a study of this nature. The results will be published in a peer-reviewed journal. |
| format | Article |
| id | doaj-art-ef4dcdc110704b89bcc9f14bee23c04b |
| institution | Kabale University |
| issn | 2044-6055 |
| language | English |
| publishDate | 2021-08-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj-art-ef4dcdc110704b89bcc9f14bee23c04b2024-12-11T08:40:09ZengBMJ Publishing GroupBMJ Open2044-60552021-08-0111810.1136/bmjopen-2021-050448Comparison of the validity, perceived usefulness and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability: a study protocolMelissa T Baysari0Wu Yi Zheng1Regis Beuscart24 The University of Sydney, Faculty of Medicine and Health, School of Medical Sciences, Biomedical Informatics and Digital Health, Sydney, New South Wales, AustraliaBlack Dog Institute, Randwick, New South Wales, Australia1 Univ. Lille, CHU Lille, ULR 2694 - METRICS: Évaluation des technologies de santé et des pratiques médicales, F-59000 Lille, FranceIntroduction Research has shown that improvements to the usability of medication alert systems are needed. For designers and decisions-makers to assess usability of their alert systems, two paper-based tools are currently available: the instrument for evaluating human-factors principles in medication-related decision support alerts (I-MeDeSA) and the tool for evaluating medication alerting systems (TEMAS). This study aims to compare the validity, usability and usefulness of both tools to identify their strengths and limitations and assist designers and decision-makers in making an informed decision about which tool is most suitable for assessing their current or prospective system.Methods and analysis First, TEMAS and I-MeDeSA will be translated into French. This translation will be validated by three experts in human factors. Then, in 12 French hospitals with a medication alert system in place, staff with expertise in the system will evaluate their alert system using the two tools successively. After the use of each tool, participants will be asked to fill in the System Usability Scale (SUS) and complete a survey on the understandability and perceived usefulness of each tool. Following the completion of both assessments, participants will be asked to nominate their preferred tool and relay their opinions on the tools. The design philosophy of TEMAS and I-MeDeSA differs on the calculation of a score, impacting the way the comparison between the tools can be performed. Convergent validity will be evaluated by matching the items of the two tools with respect to the usability dimensions they assess. SUS scores and answers to the survey will be statistically compared for I-MeDeSA and TEMAS to identify differences. Free-text responses in surveys will be analysed using an inductive approach.Ethics and dissemination Ethical approval is not required in France for a study of this nature. The results will be published in a peer-reviewed journal.https://bmjopen.bmj.com/content/11/8/e050448.full |
| spellingShingle | Melissa T Baysari Wu Yi Zheng Regis Beuscart Comparison of the validity, perceived usefulness and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability: a study protocol BMJ Open |
| title | Comparison of the validity, perceived usefulness and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability: a study protocol |
| title_full | Comparison of the validity, perceived usefulness and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability: a study protocol |
| title_fullStr | Comparison of the validity, perceived usefulness and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability: a study protocol |
| title_full_unstemmed | Comparison of the validity, perceived usefulness and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability: a study protocol |
| title_short | Comparison of the validity, perceived usefulness and usability of I-MeDeSA and TEMAS, two tools to evaluate alert system usability: a study protocol |
| title_sort | comparison of the validity perceived usefulness and usability of i medesa and temas two tools to evaluate alert system usability a study protocol |
| url | https://bmjopen.bmj.com/content/11/8/e050448.full |
| work_keys_str_mv | AT melissatbaysari comparisonofthevalidityperceivedusefulnessandusabilityofimedesaandtemastwotoolstoevaluatealertsystemusabilityastudyprotocol AT wuyizheng comparisonofthevalidityperceivedusefulnessandusabilityofimedesaandtemastwotoolstoevaluatealertsystemusabilityastudyprotocol AT regisbeuscart comparisonofthevalidityperceivedusefulnessandusabilityofimedesaandtemastwotoolstoevaluatealertsystemusabilityastudyprotocol |