3 minute read
VII. Rating the evaluation criteria
VII. RATING THE
EVALUATION CRITERIA
The use of the five evaluation criteria is mandatory and will be assessed in all ICPEs. Box 1 below provides the main thrust of each of the evaluation criteria; what is assessed and how it will enable the assessment of programme performance. Performance parameters are interconnected across criteria and approached from a systems perspective.
Annex I explains how each of the evaluation criteria are assessed.
BOX 1. How to assess each evaluation criterion
RELEVANCE The assessment of the relevance of UNDP programme support is intended to understand the extent to which the interventions have responded to the country’s development needs and priorities (as required beyond national development strategies) and United Nations and UNDP programme mandates and filled critical gaps in the country’s progress towards the Sustainable Development Goals (SDGs).
Relevance is an important consideration across the programme cycle from design to implementation.
Relevance does not merely indicate the general importance of an intervention, but assesses whether the intervention reflects the comparative advantage of UNDP in responding to the country context and needs. It includes the pertinence of the programme strategies used, their responsiveness to the evolving context, and significance to different stakeholder groups. COHERENCE Coherence is assessed in two parts: internal and external. Both are crucial to understand the UNDP contribution, and the factors that impact it.
Internal coherence assesses the synergies and interlinkages between UNDP interventions, projects, outputs and outcomes; and how synergies are used to enhance the UNDP contribution.
External coherence considers the consistency of UNDP interventions with those of other actors in the country. It explores whether UNDP interventions are complementary, coordinated with similar interventions of other actors, and the extent to which they add value while avoiding duplication of effort. The larger objective of external coherence is that efforts are coordinated for a more comprehensive response which cannot be achieved by UNDP alone.
EFFECTIVENESS Effectiveness assesses the extent to which UNDP interventions have achieved, or are expected to achieve, their stated objectives and outcomes as outlined in the CPD across different programme areas. The assessment also identifies the unintended consequences of UNDP support, whether positive or negative. In assessing effectiveness, evaluations also analyse the most significant factors in the context where the programme is implemented and how adaptive UNDP programmes have been to the evolving context (for example, conflict dynamics).
The effectiveness assessment gives due consideration to the programming principles of UNDP, including gender equality and women's empowerment (GEWE), youth empowerment, resilient institutions and communities, development innovation, and private sector engagement.
Under this criterion, due consideration is given to the UNDP contribution to development results for different social groups. EFFICIENCY Efficiency assesses whether the UNDP interventions and resources justify the outputs and outcomes achieved. It is important to note that the evaluation does not carry out a cost-efficiency assessment, as it is not the primary focus.
The assessment focuses on the timeliness of UNDP interventions, management and operational efficiency, and these dimensions of efficiency are not mutually exclusive.
Efficiency assesses whether the UNDP timeframe was realistic or appropriate, and reasonably adjusted during the intervention, given that for many interventions external factors and changes to the programme are likely. The evaluation assesses whether efforts have been made by UNDP to overcome obstacles and mitigate delays in the intervention management as the situation evolved.
Managerial and operational efficiency assesses how resources and incentives have been used to ensure that programmes are well conducted, holding managers to account for how they have taken decisions and managed risks. SUSTAINABILITY The assessment of sustainability provides insights into the continuation or likely continuation of the net benefits of UNDP interventions in the medium to longer term. Sustainability is assessed to determine whether the outcomes of UNDP interventions will endure financially, economically, socially and environmentally. The resilience of institutions and communities underpins this assessment.
While the underlying concept of continuing benefits remains, there is a focus on whether the programme process and approach facilitate the continuity of benefits achieved. The assessment focuses on measures such as policy linkages, programmatic partnerships, enabling development financing and private sector linkages that can enhance the sustainability of the outcomes achieved.