• Most significant change analysis of participatory narrative survey data to understand to what extent perceived psychological and behavioural change was facilitated by UNDP interventions, and to identify factors affecting the UNDP performance; dedicated SenseMaker© software was used to produce quantitative data, uncover relationships and patterns embedded in youth stories and identify typical and atypical stories, which were interpreted jointly with project stakeholders
• Theory-based analysis of actual versus intended results and influencing factors • Analysis of performance against the OECD/DAC criteria To analyse the level of gender-related approaches and results, the IEO Gender Results Effectiveness Scale was employed (see figure 4). Gender marker data were used for analysis of gender programme expenditures against commitments made, and sex-disaggregated data were assessed where available. Informed by a systems approach, evidence was contrasted and patterns synthesized into key findings to report on the key evaluation questions, framed around a triangulation matrix (see annex 12). Higher-level conclusions and forward-looking recommendations were derived from this analysis.
FIGURE 4. IEO Gender Results Effectiveness Scale
Gender Negative
Gender Blind
Gender Targeted
Gender Responsive
Gender Transformative
Result had a negative outcome that aggravated or reinforced gender inequalities and limiting norms
Result gave no attention to gender, and failed to acknowledge the different needs of men, women, girls and boys, and other marginalized populations
Result focused on the number of women, men, or marginalized populations that were targeted (e.g. 50/50 representation)
Result addressed the differential needs of men, women, or marginalized populations and focused on the equitable distribution of benefits, resources, status, rights, etc. but did not address root causes of inequalities
Result contributed to changes in norms, cultural values, power structures and the roots of gender inequalities and discriminations
Source: Adapted from the Evaluation of UNDP Contribution to Gender Equality and Women’s Empowerment, IEO, UNDP, 2015
2.4 CHALLENGES AND LIMITATIONS COVID-19 and remote work. This evaluation was conducted under the challenging circumstances created by the COVID-19 pandemic. This meant that the evaluation team was unable to travel and therefore collected and analysed data remotely. Another implication of the pandemic was that SenseMaking, usually carried out as an in-person workshop, had to take place remotely via Zoom or other means, which excluded some potential participants due to low literacy skills and lack of connectivity.
CHAPTER 2. EVALUATION SCOPE AND METHODOLOGY
15
