How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation.
Learning about how to evaluate implementation-focused networks is important as they become more commonly used. This research evaluated the emergence, legitimacy and effectiveness of a multi-country Quality of Care Network (QCN) aiming to improve maternal, newborn and child health (MNCH) outcomes. We...
Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-01-01
|
| Series: | PLOS Global Public Health |
| Online Access: | https://doi.org/10.1371/journal.pgph.0001897 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841555241383755776 |
|---|---|
| author | Gloria Seruwagi Mike English Nehla Djellouli Yusra Shawar Kasonde Mwaba Abdul Kuddus Agnes Kyamulabi Kohenour Akter Catherine Nakidde Hilda Namakula Mary Kinney Tim Colbourn QCN Evaluation Group |
| author_facet | Gloria Seruwagi Mike English Nehla Djellouli Yusra Shawar Kasonde Mwaba Abdul Kuddus Agnes Kyamulabi Kohenour Akter Catherine Nakidde Hilda Namakula Mary Kinney Tim Colbourn QCN Evaluation Group |
| author_sort | Gloria Seruwagi |
| collection | DOAJ |
| description | Learning about how to evaluate implementation-focused networks is important as they become more commonly used. This research evaluated the emergence, legitimacy and effectiveness of a multi-country Quality of Care Network (QCN) aiming to improve maternal, newborn and child health (MNCH) outcomes. We examined the QCN global level, national and local level interfaces in four case study countries. This paper presents the evaluation team's reflections on this 3.5 year multi-country, multi-disciplinary project. Specifically, we examine our approach, methodological innovations, lessons learned and recommendations for conducting similar research. We used a reflective methodological approach to draw lessons on our practice while evaluating the QCN. A 'reflections' tool was developed to guide the process, which happened within a period of 2-4 weeks across the different countries. All country research teams held focused 'reflection' meetings to discuss questions in the tool before sharing responses with this paper's lead author. Similarly, the different lead authors of all eight QCN papers convened their writing teams to reflect on the process and share key highlights. These data were thematically analysed and are presented across key themes around the implementation experience including what went well, facilitators and critical methodological adaptations, what can be done better and recommendations for undertaking similar work. Success drivers included the team's global nature, spread across seven countries with members affiliated to nine institutions. It was multi-level in expertise and seniority and highly multidisciplinary including experts in medicine, policy and health systems, implementation research, behavioural sciences and MNCH. Country Advisory Boards provided technical oversight and support. Despite complexities, the team effectively implemented the QCN evaluation. Strong leadership, partnership, communication and coordination were key; as were balancing standardization with in-country adaptation, co-production, flattening hierarchies among study team members and the iterative nature of data collection. Methodological adaptations included leveraging technology which became essential during COVID-19, clear division of roles and responsibilities, and embedding capacity building as both an evaluation process and outcome, and optimizing technology use for team cohesion and quality outputs. |
| format | Article |
| id | doaj-art-631742d235b649b09251bf06f87544c5 |
| institution | Kabale University |
| issn | 2767-3375 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLOS Global Public Health |
| spelling | doaj-art-631742d235b649b09251bf06f87544c52025-01-08T05:51:37ZengPublic Library of Science (PLoS)PLOS Global Public Health2767-33752024-01-0148e000189710.1371/journal.pgph.0001897How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation.Gloria SeruwagiMike EnglishNehla DjellouliYusra ShawarKasonde MwabaAbdul KuddusAgnes KyamulabiKohenour AkterCatherine NakiddeHilda NamakulaMary KinneyTim ColbournQCN Evaluation GroupLearning about how to evaluate implementation-focused networks is important as they become more commonly used. This research evaluated the emergence, legitimacy and effectiveness of a multi-country Quality of Care Network (QCN) aiming to improve maternal, newborn and child health (MNCH) outcomes. We examined the QCN global level, national and local level interfaces in four case study countries. This paper presents the evaluation team's reflections on this 3.5 year multi-country, multi-disciplinary project. Specifically, we examine our approach, methodological innovations, lessons learned and recommendations for conducting similar research. We used a reflective methodological approach to draw lessons on our practice while evaluating the QCN. A 'reflections' tool was developed to guide the process, which happened within a period of 2-4 weeks across the different countries. All country research teams held focused 'reflection' meetings to discuss questions in the tool before sharing responses with this paper's lead author. Similarly, the different lead authors of all eight QCN papers convened their writing teams to reflect on the process and share key highlights. These data were thematically analysed and are presented across key themes around the implementation experience including what went well, facilitators and critical methodological adaptations, what can be done better and recommendations for undertaking similar work. Success drivers included the team's global nature, spread across seven countries with members affiliated to nine institutions. It was multi-level in expertise and seniority and highly multidisciplinary including experts in medicine, policy and health systems, implementation research, behavioural sciences and MNCH. Country Advisory Boards provided technical oversight and support. Despite complexities, the team effectively implemented the QCN evaluation. Strong leadership, partnership, communication and coordination were key; as were balancing standardization with in-country adaptation, co-production, flattening hierarchies among study team members and the iterative nature of data collection. Methodological adaptations included leveraging technology which became essential during COVID-19, clear division of roles and responsibilities, and embedding capacity building as both an evaluation process and outcome, and optimizing technology use for team cohesion and quality outputs.https://doi.org/10.1371/journal.pgph.0001897 |
| spellingShingle | Gloria Seruwagi Mike English Nehla Djellouli Yusra Shawar Kasonde Mwaba Abdul Kuddus Agnes Kyamulabi Kohenour Akter Catherine Nakidde Hilda Namakula Mary Kinney Tim Colbourn QCN Evaluation Group How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation. PLOS Global Public Health |
| title | How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation. |
| title_full | How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation. |
| title_fullStr | How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation. |
| title_full_unstemmed | How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation. |
| title_short | How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation. |
| title_sort | how to evaluate a multi country implementation focused network reflections from the quality of care network qcn evaluation |
| url | https://doi.org/10.1371/journal.pgph.0001897 |
| work_keys_str_mv | AT gloriaseruwagi howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT mikeenglish howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT nehladjellouli howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT yusrashawar howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT kasondemwaba howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT abdulkuddus howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT agneskyamulabi howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT kohenourakter howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT catherinenakidde howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT hildanamakula howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT marykinney howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT timcolbourn howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation AT qcnevaluationgroup howtoevaluateamulticountryimplementationfocusednetworkreflectionsfromthequalityofcarenetworkqcnevaluation |