Does accountability really improve quality? 1 Why is this research important?
3 A research approach in two stages
4 Field work: Listening to local communities
While improving the accountability of our programmes to communities is a focus of increasing importance in the NGO sector, there is lack of robust evidence demonstrating the impact that these efforts are having on the quality of programmes.
Step 1
Step 2
The research will focus on three of the HAP Standard benchmarks – sharing information, participation and handling complaints. It will assess the performance of the three components, checking they are in place and used effectively.
Then the accountability mechanism’s contribution to programme quality will be assessed using four of the OECD/DAC criteria for evaluating development assistance: relevance, effectiveness, efficiency and sustainability.
A review of available documents will seek to identify pre-existing evidence of an improvement in programme quality as a result of increased accountability. This will be supplemented by qualitative research in two case study countries (Kenya and Burma).
To address this evidence gap, an interagency Accountability Peer Learning group co-ordinated by HAP International was formed in August 2012. Under this Group, Save the Children UK (SCUK), Christian Aid (CA) and HAP International commissioned research to compare reality to the expected impact of accountability mechanisms.
2 The research question
5 An open-source methodology HAP Standard Benchmark
Step 1
Commitments
1
Competencies
2
Information
3
Participation
4
Complaints
5
Improvement
6
Well-functioning accountability mechanism assessed using HAP requirements and MoV
mechanism* contribute to the quality
Step 2
Relevance Assumptions…
Research questions
Effectiveness Assumptions…
Research questions
Efficiency Assumptions…
Research questions
Sustainability Assumptions…
Research questions
Impact
The question that will guide the research and determine the methodology is:
In what ways does an effective accountability
For each of the two agency case studies the research will take place in a number of villages where the same project is being implemented – some with accountability mechanisms perceived to be well-functioning and some where the accountability mechanisms are either perceived to be poorly-functioning or are absent.
Is the accountability mechanism effective?
What is the contribution of the accountability mechanism to programme quality?
l
The results of this study will be published in June, after field work has taken place in Kenya (Christian Aid, February) and Burma (Save the Children, March).
l
The methodology has been designed following a collaborative process with members of the HAP Accountability Peer Learning Group, and with particular support from ALNAP researchers.
The methodology will be revised based on the learning derived from field work and will be made available for organisations who wish to conduct their own research and help expand the evidence base on the impact of accountability mechanisms on programme quality. l
If you consider using this methodology for your own purposes, and need advice, please get in touch!
6 To find out more
of a humanitarian or development programme? *An effective accountability mechanism is one which provides information to affected communities, facilitates their participation in programme design and implementation, and offers a means for communities to feedback and/or complain.
Get in touch with: David Loquercio Head of Policy and External Relations HAP International DLOQUERCIO@hapinternational.org
Burcu Munyas Ghadially Accountability Adviser Save the Children UK b.munyas@savethechildren.org.uk
Juliet Parker Humanitarian Performance Adviser Christian Aid JParker@christian-aid.org
Andy Featherstone Research Consultant featherstoneandy@gmail.com