Interrater reliability and agreement of the NEUMOBACT checklist about infection-prevention performance of intensive care nurses in simulation-based scenarios.
<h4>Objective</h4>To analyse the interrater reliability of the NEUMOBACT checklist and verify whether consistent results are reproducible.<h4>Methods</h4>A validation study with a cross-sectional design, compliant with the GRRAS checklist, among ICU nurses attending a SIMULAZ...
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0313175 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841555558733185024 |
|---|---|
| author | Marta Raurell-Torredà Ignacio Zaragoza-García Oscar Arrogante Anna María Aliberch-Raurell Francisco Javier Sánchez-Chillón Martín Torralba-Melero Andrés Rojo-Rojo Alfonso Muriel-García Ana Carolina Amaya Arias Juan Roldán-Merino Mariona Farrés-Tarafa |
| author_facet | Marta Raurell-Torredà Ignacio Zaragoza-García Oscar Arrogante Anna María Aliberch-Raurell Francisco Javier Sánchez-Chillón Martín Torralba-Melero Andrés Rojo-Rojo Alfonso Muriel-García Ana Carolina Amaya Arias Juan Roldán-Merino Mariona Farrés-Tarafa |
| author_sort | Marta Raurell-Torredà |
| collection | DOAJ |
| description | <h4>Objective</h4>To analyse the interrater reliability of the NEUMOBACT checklist and verify whether consistent results are reproducible.<h4>Methods</h4>A validation study with a cross-sectional design, compliant with the GRRAS checklist, among ICU nurses attending a SIMULAZERO course with an Objective Structured Clinical Evaluation simulation format, to verify transfer from theory to clinical practice of knowledge and skills in ventilator-associated pneumonia (VAP) and catheter-related bacteraemia (CRB) prevention. A minimum sample size of 111 pairs of nurse raters was calculated. Interrater agreement was analysed using Gwet's AC1 for each item and as a total for each of the three checklists in the NEUMOBACT instrument.<h4>Results</h4>A total of 95 pairs of valid NEUMOBACT checklists were completed by 190 raters with a median age of 29 [25-35] years, 93.7% were female. At the Central Venous Catheter insertion station, Gwet's AC1 was 0.934 (95% CI [0.919-0.949]). Only 2 of the 17 items scored below 0.9. At the Endotracheal Suctioning station, Gwet's AC1 was 0.869 (95% CI [0.851-0.886]). Of the 26 items that made up this station, 16 had an agreement percentage above 0.9, a further 9 were between 0.821 and 0.884, and item 13 had a value of 0.789. At the Patient Care station, Gwet's AC1 was 0.911 (95% CI [0.896-0.927]). Of the 21 items, 17 showed an agreement percentage above 0.9 and 4 were between 0.810 and 0.894.<h4>Conclusions</h4>The interrater reliability of the NEUMOBACT checklist shows substantial agreement between pairs of raters and is therefore validated in this large sample of ICU nurses.<h4>Relevance to clinical practice</h4>The NEUMOBACT checklist can be useful for assessing skills before and after training in VAP and CRB prevention measures and during debriefing (post-simulation feedback), to reinforce the scientific evidence behind actions and decisions for items that have been performed incorrectly, thus consolidating training already received. |
| format | Article |
| id | doaj-art-6a168301f35a453f882f6c0e82e6ef5f |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-6a168301f35a453f882f6c0e82e6ef5f2025-01-08T05:32:15ZengPublic Library of Science (PLoS)PLoS ONE1932-62032024-01-011912e031317510.1371/journal.pone.0313175Interrater reliability and agreement of the NEUMOBACT checklist about infection-prevention performance of intensive care nurses in simulation-based scenarios.Marta Raurell-TorredàIgnacio Zaragoza-GarcíaOscar ArroganteAnna María Aliberch-RaurellFrancisco Javier Sánchez-ChillónMartín Torralba-MeleroAndrés Rojo-RojoAlfonso Muriel-GarcíaAna Carolina Amaya AriasJuan Roldán-MerinoMariona Farrés-Tarafa<h4>Objective</h4>To analyse the interrater reliability of the NEUMOBACT checklist and verify whether consistent results are reproducible.<h4>Methods</h4>A validation study with a cross-sectional design, compliant with the GRRAS checklist, among ICU nurses attending a SIMULAZERO course with an Objective Structured Clinical Evaluation simulation format, to verify transfer from theory to clinical practice of knowledge and skills in ventilator-associated pneumonia (VAP) and catheter-related bacteraemia (CRB) prevention. A minimum sample size of 111 pairs of nurse raters was calculated. Interrater agreement was analysed using Gwet's AC1 for each item and as a total for each of the three checklists in the NEUMOBACT instrument.<h4>Results</h4>A total of 95 pairs of valid NEUMOBACT checklists were completed by 190 raters with a median age of 29 [25-35] years, 93.7% were female. At the Central Venous Catheter insertion station, Gwet's AC1 was 0.934 (95% CI [0.919-0.949]). Only 2 of the 17 items scored below 0.9. At the Endotracheal Suctioning station, Gwet's AC1 was 0.869 (95% CI [0.851-0.886]). Of the 26 items that made up this station, 16 had an agreement percentage above 0.9, a further 9 were between 0.821 and 0.884, and item 13 had a value of 0.789. At the Patient Care station, Gwet's AC1 was 0.911 (95% CI [0.896-0.927]). Of the 21 items, 17 showed an agreement percentage above 0.9 and 4 were between 0.810 and 0.894.<h4>Conclusions</h4>The interrater reliability of the NEUMOBACT checklist shows substantial agreement between pairs of raters and is therefore validated in this large sample of ICU nurses.<h4>Relevance to clinical practice</h4>The NEUMOBACT checklist can be useful for assessing skills before and after training in VAP and CRB prevention measures and during debriefing (post-simulation feedback), to reinforce the scientific evidence behind actions and decisions for items that have been performed incorrectly, thus consolidating training already received.https://doi.org/10.1371/journal.pone.0313175 |
| spellingShingle | Marta Raurell-Torredà Ignacio Zaragoza-García Oscar Arrogante Anna María Aliberch-Raurell Francisco Javier Sánchez-Chillón Martín Torralba-Melero Andrés Rojo-Rojo Alfonso Muriel-García Ana Carolina Amaya Arias Juan Roldán-Merino Mariona Farrés-Tarafa Interrater reliability and agreement of the NEUMOBACT checklist about infection-prevention performance of intensive care nurses in simulation-based scenarios. PLoS ONE |
| title | Interrater reliability and agreement of the NEUMOBACT checklist about infection-prevention performance of intensive care nurses in simulation-based scenarios. |
| title_full | Interrater reliability and agreement of the NEUMOBACT checklist about infection-prevention performance of intensive care nurses in simulation-based scenarios. |
| title_fullStr | Interrater reliability and agreement of the NEUMOBACT checklist about infection-prevention performance of intensive care nurses in simulation-based scenarios. |
| title_full_unstemmed | Interrater reliability and agreement of the NEUMOBACT checklist about infection-prevention performance of intensive care nurses in simulation-based scenarios. |
| title_short | Interrater reliability and agreement of the NEUMOBACT checklist about infection-prevention performance of intensive care nurses in simulation-based scenarios. |
| title_sort | interrater reliability and agreement of the neumobact checklist about infection prevention performance of intensive care nurses in simulation based scenarios |
| url | https://doi.org/10.1371/journal.pone.0313175 |
| work_keys_str_mv | AT martaraurelltorreda interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT ignaciozaragozagarcia interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT oscararrogante interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT annamariaaliberchraurell interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT franciscojaviersanchezchillon interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT martintorralbamelero interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT andresrojorojo interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT alfonsomurielgarcia interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT anacarolinaamayaarias interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT juanroldanmerino interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios AT marionafarrestarafa interraterreliabilityandagreementoftheneumobactchecklistaboutinfectionpreventionperformanceofintensivecarenursesinsimulationbasedscenarios |