Independent Impact Evaluation of the KINERJA Program – End Line

Team Member: Palmira Permata Bachtiar, Luhur Bima, Asri Yusrina, Dinar Dwi Prasetyo
Completion Year:
2015
Area:
Aceh, Kalimantan Barat, Kalimantan Selatan, Jawa Timur
Topic:
Economic Policy, Education, Governance & Decentralization, Health

Collaborating Partners

Funding bod

This study is funded by KINERJA-USAID and implemented within a consortium with Social Impact (SI) and Research Triangle Institute (RTI).

 
 

Description & Progress

The objective of this monitoring and evaluation (Monev) study was to evaluate the impact of the KINERJA-USAID packages on public service delivery in the areas of education, health, and businessenabling environments.

 

Description

KINERJA was implemented over four-year period in four provinces (Aceh, West Kalimantan, South Sulawesi, and East Java) and 20 kabupaten (four kabupaten and one kota in each province). Within the Monev framework, SMERU was working closely with SI, and SMERU was responsible for the qualitative evaluation activities intended to provide depth information on how and why KINERJA succeeded (or did not succeed) in meeting its goals, and whether meeting these goals translated into any substantive improvement in public services.

The study began in 2011 and completed in early 2015. The SMERU baseline study covered 11 kabupaten/kota (out of 20 kabupaten/kota participating in KINERJA), then it covered 12 kabupaten/kota for the mid-term evaluation that focusing on the programmatic and managerial process of KINERJA packages, three kabupaten/kota for the study on the implementation of minimum service standards in health and education, and finally revisited the 11 baseline kabupaten/kota for the end-line study.

 

Methodology

In all of these research stages, SMERU employed qualitative methods through included in-depth interviews, FGDs, and observation

 

Research Highlight

The end-line study found that, across different KINERJA interventions, local government commitment at the district level and service delivery unit level appears to be the key determinant of KINERJA performance. External factors such as government policies at the district, provincial, and national level are also important determinants, and so is the impending elections, and personnel turnover. Another important external factor is the location; remote service delivery units suffer from lack of infrastructure, facilities, and accessibility which potentially limit the achievement of KINERJA targets. Internal factors, particularly the performance of the technical assistance, also influence the realization of KINERJA targets directly or indirectly through strengthening local government commitment.