Evaluation of Budget Support in Zambia
In order to evaluate the effectiveness of budget support and with it the efficiency of development cooperation, a lager set of budget evaluations were undertaken in different developing countries. Embedded in the specific country context of Zambia the German Development Institute / Deutsches Institut für Entwicklungspolitik (DIE) carried out the major component of the evaluation in this country by using a methodological approach.
2009 - 2011 / completed
This project - commissioned by the German Ministry for International Cooperation and Development - evaluated inputs and induced outputs of Budget Support in Zambia.
During the past decade donors and recipient countries have shifted increasingly from a project approach to a programme based approach and general and sector budget support. It was felt that budget support, by contributing to the overall national development strategy and sector strategies would enhance the effectiveness and efficiency of development cooperation.
The growth of budget support created the need to evaluate their effectiveness and contribution to the realisation of the recipient country's strategies. There is a demand from parliaments to show the results of this support. Proponents and opponents seem to hold strong views about the effectiveness of budget support, but these views are not necessarily supported by (rigorous) evidence. Recent evaluations of budget support focused on the political economy and policy processes, but did not analyse the impact on the objectives of budget support.
Several cooperating partners have developed a methodology for the evaluation of budget support. The methodology group is an initiative of the Evaluation Unit of the Europe Aid Co-operation Office of the European Commission. The Steering Group on budget support further includes the evaluation departments of Belgium, Canada (CIDA), Denmark (DANIDA), Finland, France (AFD), Germany (BMZ), Ireland (Irish Aid), the Netherlands (IOB), Norway (NORAD), Sweden (Sida), The United Kingdom (DFID) and the OECD/DAC secretariat.
Based on a methodological approach suggested by Caputo, E., A. Lawson and M. van der Linde (2008), under the authority of the Unit of the Europe Aid Co-operation Office of the European Commission, a round of evaluations of budget support has been initiated in a number of countries. In every country, a number of donors take the lead in the evaluation, preferably in close cooperation with the government of the recipient country. At the same time, these evaluations are supported by all members of the steering group. Therefore, while not every evaluation department of a donor is involved in the day to day management of the evaluation, the evaluations are joint evaluations, in accordance with the principles and characteristics of budget support.
One of the first countries, where the new approach to evaluate budget support is to be applied and refined is Zambia. For the cooperating partners, the evaluation for Zambia is be led by the Policy and Operations Evaluation Department of the Netherlands Ministry of Foreign Affairs (IOB), Evaluation and Audit Department of the German Federal Ministry for Economic Cooperation and Development (BMZ-E) and the Secretariat for Evaluation of the Swedish International Development Cooperation Agency (Sida).
This project - commissioned by the German Ministry for International Cooperation and Development - evaluates inputs and induced outputs of Budget Support in Zambia. The evaluation is embedded in the specific country context of Zambia and is based upon the instrument’s intervention logic covering financial and non-financial contributions of Budget Support. As such, the evaluation focuses upon strategies of cooperating partners to provide Budget Support, the process and structure of donor harmonization and alignment to government policies and systems as well as the effects of Budget Support on induced outputs such as institutional performance, public financial management and budget allocations.
This evaluation is part of an initiative of the Evaluation Unit of the EU (Directorate-General for Development, External Relations and EuropeAid) assessing the effectiveness of Budget Support and improving the methodology for evaluating this complex instrument of development cooperation. Guided by the principles of the Paris-Declaration, evaluation units of bilateral EU member states and the EC have set up a management group in 2008 to accompany the overall evaluation process. Based upon an EC-commissioned “issue paper” two preliminary papers on methodology were drafted and different evaluation teams were set up to asses the effectiveness of BS in three African countries: Mali, Zambia and Tanzania.
In cooperation with the Government of the Republic of Zambia, the present evaluation on Budget Support is a joint effort of the Policy and Operations Evaluation Department of the Netherlands Ministry of Foreign Affairs (IOB), the Evaluation and Audit Department of the German Federal Ministry for Economic Cooperation and Development (BMZ-E) and the Secretariat for Evaluation of the Swedish International Development Cooperation Agency (Sida). Different elements of the overall evaluation are undertaken by the Amsterdam Institute for International Development (AIID), the German Development Institute / Deutsches Institut für Entwicklungspolitik (DIE), IOB, the evaluation unit of the KfW Development Bank and Oxford Policy Management.
Hence, the undertaken study, which is basically focused on the inputs and induced outputs of BS in Zambia, is part of a larger set of assessments, which also focus upon the outcome and impact level in different sectors; namely agriculture, education, health and infrastructure. The division of labour among the above mentioned evaluation and research organizations is related to the ambitious goal of providing a comprehensive assessment of Budget Support’s effectiveness in Zambia, ranging from the input level to the outcome and impact level in several sectors. To achieve this goal and to advance the methodological knowledge on how to best evaluate Budget Support, the overall evaluation relies on different - qualitative and quantitative - comparative methods. These methods were selected according to their appropriateness for answering the evaluation questions with their varying focus on different aspects of BS’s intervention logic.
- Zur Wirksamkeit und Evaluierung von Budgethilfen
Leiderer, Stefan (2010)
in: Jörg Faust / Susanne Neubert (Hrsg.), Wirksamere Entwicklungspolitik: Befunde, Reformen, Instrumente (Entwicklungstheorie und Entwicklungspolitik 8), Baden-Baden: Nomos Verl.-Ges., 229-255
- Budgethilfe in der Entwicklungszusammenarbeit: weder Teufelszeug noch Allheilmittel
Leiderer, Stefan (2009)
Analysen und Stellungnahmen 10/2009
- Zur Effektivität und politischen Ökonomie der Entwicklungszusammenarbeit
Faust, Jörg / Stefan Leiderer (2008)
in: Politische Vierteljahresschrift 49 (1), 129-152
- Chancen, Risiken und Perspektiven von Budgethilfe in der Entwicklungszusammenarbeit
Leiderer, Stefan (2007)
Schriftliche Stellungnahme zur öffentlichen Anhörung des Deutschen Bundestages, Ausschuss für wirtschaftliche Zusammenarbeit und Entwicklung am 7. November 2007 in Berlin, Bonn: German Development Institute / Deutsches Institut für Entwicklungspolitik (DIE)
- Wie wirksam sind neue Modalitäten der Entwicklungszusammenarbeit? Erste Erfahrungen mit Programme-Based Approaches (PBAs)
Klingebiel, Stephan / Stefan Leiderer / Petra Schmidt (2007)
Discussion Paper 7/2007
- Chances of effective cooperation and partnership with sub-Saharan Africa: programme-based approaches
Klingebiel, Stephan / Stefan Leiderer (2007)
in: Stephan Klingebiel (ed), Africa agenda for 2007: suggestions for the German G8 and EU Council Presidencies, Bonn: German Development Institute / Deutsches Institut für Entwicklungspolitik (Discussion Paper 4/2007), 77-80
- Chance für eine wirksame Kooperation und Partnerschaft mit Subsahara-Afrika: programmorientierte Ansätze
Klingebiel, Stephan/ Stefan Leiderer (2006)
in: Stephan Klingebiel (Hrsg.), Afrika-Agenda 2007. Ansatzpunkte für den deutschen G8-Vorsitz und die EU-Ratspräsidentschaft, Bonn: German Development Institute / Deutsches Institut für Entwicklungspolitik (DIE) (Discussion Paper 18/2006), 79-83
- Paradoxe Effekte: Befunde zur Wirksamkeit der Entwicklungszusammenarbeit im statistischen Ländervergleich
Faust, Jörg / Stefan Leiderer (2006)
in: eins 9/2006, 34-37
- Diagnosis and reform of public financial management systems: a key cross-cutting issue for program-based approaches in development policy
Leiderer, Stefan (2005)
Briefing Paper 3/2005
- Programmfinanzierung und öffentliche Budgets: neue Instrumente und Inhalte der Entwicklungspolitik
Klingebiel, Stephan / Stefan Leiderer / Petra Schmidt (2005)
in: Dirk Messner / Imme Scholz (Hrsg.), Zukunftsfragen der Entwicklungspolitik, Baden-Baden: Nomos Verl.-Ges., 73-87
- Programme Financing and Public Budgets. New Instruments and Starting-Points of Development Policy
Klingebiel, Stephan / Stefan Leiderer / Petra Schmidt (2005)
Discussion Paper 3/2005
- Budgetmanagement und Budgetfinanzierung in Subsahara-Afrika
Klingebiel, Stephan / Stefan Leiderer (2004)
in: Rolf Hofmeier / Andreas Mehler (Hrsg.), Afrika Jahrbuch 2003. Politik, Wirtschaft und Gesellschaft in Afrika südlich der Sahara, Institut für Afrika-Kunde, Wiesbaden: VS Verl. für Sozialwiss., 39-47
The Current Column of 17 December 2018
Discussion Paper 31/2018
Analysen und Stellungnahmen 13/2018