A Mechanism-Centred Approach to Evaluating Complex Aid Interventions: The Case of Accompanying Measures to Budget Support
Background: Current methodological debates related to theory-based evaluations (TBE) centre around questions how to improve the explanatory strength of these approaches and how to integrate mechanisms as analytic concept. Particularly in complex aid interventions, when multiple elements are expecte...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Evaluation Center at Western Michigan University
2017-05-01
|
| Series: | Journal of MultiDisciplinary Evaluation |
| Subjects: | |
| Online Access: | https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/455 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841561316688396288 |
|---|---|
| author | Johannes Schmitt Franziska Krisch |
| author_facet | Johannes Schmitt Franziska Krisch |
| author_sort | Johannes Schmitt |
| collection | DOAJ |
| description |
Background: Current methodological debates related to theory-based evaluations (TBE) centre around questions how to improve the explanatory strength of these approaches and how to integrate mechanisms as analytic concept. Particularly in complex aid interventions, when multiple elements are expected to interact and thus create an added value, exploring mechanisms as an analytical tool can be promising.
Purpose: This paper seeks to contribute to the discussion on the use of TBE for evaluating complex aid interventions by sharing experiences from a recent evaluation of accompanying measures to general budget support.
Setting: Nine countries of sub-Saharan Africa which have received German budget support, namely Burkina Faso, Ghana, Malawi, Mali, Mozambique, Rwanda, Tanzania, Uganda, Zambia.
Intervention: Accompanying measures (mainly in the form of technical assistance and capacity development) are one element of the budget support package, which further encompasses financial contributions, policy dialogue, and conditionalities.
Research Design: We focus on interrelations between different elements of budget support and apply a mechanism-centred approach to programme theory building,
Data Collection and Analysis: After defining accompanying measures and integrating them into the intervention logic of budget support used in recent multi-donor evaluations, key mechanisms were identified on an explorative mission to Mozambique, validated in an online survey, and further discussed in expert interviews and during field research in Tanzania.
Findings: For the specific example relating to two elements of budget support (policy dialogue and accompanying measures), some of the hypothesized mechanisms were found to create an added value and thus increase the effectiveness of budget support as a package. The applied approach helped generate a more comprehensive implementation theory and provided insights into potential benefits and challenges of combining different elements in one programme. Beyond its use for future evaluations in the field of budget support, we argue that TBE of complex interventions can benefit from adopting such a mechanism-centred approach to create a better understanding of how different elements of the programme interact. Moreover, the focus on mechanisms when analysing programme implementation enables evaluators to improve their empirical inquiry on the identified mechanisms and to draw valid conclusions on the programme’s contribution to the observed outcomes.
|
| format | Article |
| id | doaj-art-266ac419de134cffb862f94dd6246db1 |
| institution | Kabale University |
| issn | 1556-8180 |
| language | English |
| publishDate | 2017-05-01 |
| publisher | The Evaluation Center at Western Michigan University |
| record_format | Article |
| series | Journal of MultiDisciplinary Evaluation |
| spelling | doaj-art-266ac419de134cffb862f94dd6246db12025-01-03T01:46:33ZengThe Evaluation Center at Western Michigan UniversityJournal of MultiDisciplinary Evaluation1556-81802017-05-01132810.56645/jmde.v13i28.455A Mechanism-Centred Approach to Evaluating Complex Aid Interventions: The Case of Accompanying Measures to Budget SupportJohannes Schmitt0Franziska Krisch1German Institute for Development Evaluation - DEval; University of Duisburg-EssenDeutsche Gesellschaft für Internationale Zusammenarbeit – GIZ Background: Current methodological debates related to theory-based evaluations (TBE) centre around questions how to improve the explanatory strength of these approaches and how to integrate mechanisms as analytic concept. Particularly in complex aid interventions, when multiple elements are expected to interact and thus create an added value, exploring mechanisms as an analytical tool can be promising. Purpose: This paper seeks to contribute to the discussion on the use of TBE for evaluating complex aid interventions by sharing experiences from a recent evaluation of accompanying measures to general budget support. Setting: Nine countries of sub-Saharan Africa which have received German budget support, namely Burkina Faso, Ghana, Malawi, Mali, Mozambique, Rwanda, Tanzania, Uganda, Zambia. Intervention: Accompanying measures (mainly in the form of technical assistance and capacity development) are one element of the budget support package, which further encompasses financial contributions, policy dialogue, and conditionalities. Research Design: We focus on interrelations between different elements of budget support and apply a mechanism-centred approach to programme theory building, Data Collection and Analysis: After defining accompanying measures and integrating them into the intervention logic of budget support used in recent multi-donor evaluations, key mechanisms were identified on an explorative mission to Mozambique, validated in an online survey, and further discussed in expert interviews and during field research in Tanzania. Findings: For the specific example relating to two elements of budget support (policy dialogue and accompanying measures), some of the hypothesized mechanisms were found to create an added value and thus increase the effectiveness of budget support as a package. The applied approach helped generate a more comprehensive implementation theory and provided insights into potential benefits and challenges of combining different elements in one programme. Beyond its use for future evaluations in the field of budget support, we argue that TBE of complex interventions can benefit from adopting such a mechanism-centred approach to create a better understanding of how different elements of the programme interact. Moreover, the focus on mechanisms when analysing programme implementation enables evaluators to improve their empirical inquiry on the identified mechanisms and to draw valid conclusions on the programme’s contribution to the observed outcomes. https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/455theory-based evaluationtheory of changedevelopment evaluationbudget supporttechnical assistancecapacity development |
| spellingShingle | Johannes Schmitt Franziska Krisch A Mechanism-Centred Approach to Evaluating Complex Aid Interventions: The Case of Accompanying Measures to Budget Support Journal of MultiDisciplinary Evaluation theory-based evaluation theory of change development evaluation budget support technical assistance capacity development |
| title | A Mechanism-Centred Approach to Evaluating Complex Aid Interventions: The Case of Accompanying Measures to Budget Support |
| title_full | A Mechanism-Centred Approach to Evaluating Complex Aid Interventions: The Case of Accompanying Measures to Budget Support |
| title_fullStr | A Mechanism-Centred Approach to Evaluating Complex Aid Interventions: The Case of Accompanying Measures to Budget Support |
| title_full_unstemmed | A Mechanism-Centred Approach to Evaluating Complex Aid Interventions: The Case of Accompanying Measures to Budget Support |
| title_short | A Mechanism-Centred Approach to Evaluating Complex Aid Interventions: The Case of Accompanying Measures to Budget Support |
| title_sort | mechanism centred approach to evaluating complex aid interventions the case of accompanying measures to budget support |
| topic | theory-based evaluation theory of change development evaluation budget support technical assistance capacity development |
| url | https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/455 |
| work_keys_str_mv | AT johannesschmitt amechanismcentredapproachtoevaluatingcomplexaidinterventionsthecaseofaccompanyingmeasurestobudgetsupport AT franziskakrisch amechanismcentredapproachtoevaluatingcomplexaidinterventionsthecaseofaccompanyingmeasurestobudgetsupport AT johannesschmitt mechanismcentredapproachtoevaluatingcomplexaidinterventionsthecaseofaccompanyingmeasurestobudgetsupport AT franziskakrisch mechanismcentredapproachtoevaluatingcomplexaidinterventionsthecaseofaccompanyingmeasurestobudgetsupport |