Terms of Reference Mid-term Project Evaluation of Strong Women & Youth in Rural Entrepreneurship and Civil Society in Sri Lanka Project
About Plan International We strive to advance children’s rights and equality for girls all over the world. As an independent development and humanitarian organisation, we work alongside children, young people, our supporters and partners to tackle the root causes of the challenges facing girls and all vulnerable children. We support children’s rights from birth until they reach adulthood and enable children to prepare for and respond to crises and adversity. We drive changes in practice and policy at local, national and global levels using our reach, experience and knowledge. For over 80 years we have been building powerful partnerships for children, and we are active in over 75 countries. Plan, in Sri Lanka currently works in five districts. The districts are: Monaragala, Ampara, Anuradhapura, Batticaloa and Mullaitivu covering nearly 238 Grama Niladhari Divisions in the five Districts. At present Plan Sri Lanka works with a caseload of 20,227 sponsored families. For operational purposes the program areas are grouped into two main geographical zones as the North-central program area and Uva Programme area. Plan has also moved into the conflict affected Eastern Province and Northern Province as the organization continues to cover the most marginalized children in the country. In FY 19 Plan has planned to move to Mullaitivu district as the new sponsorship programme area. Plan Sri Lanka’s five-year strategic plan that commenced on 1st July 2016, is planned to be concluded on 30th of June 2021. PISL will work on four Strategic Programmes which will interweave outcomes of vulnerable children, girls and women on thrive, learn, lead, and decide:
Girls and boys under 5 years, (especially with disability/development delays) achieve optimum growth and development; high prevalence of undernutrition among under-fives in poor and post conflict areas will be addressed through holistic, streamlined programming for optimal growth and development.
Excluded girls and boys (especially Children with Disabilities/development delays) complete quality, inclusive compulsory education by addressing gender-based and other discriminations.
Girls and boys, including those with disabilities, are better protected from all forms of violence, particularly sexual abuse, corporal punishment and domestic violence.
Youth (female and male) and women excluded from the benefits of development have the skills and support networks to become socially and economically empowered citizens and gain access to responsive government services.
Project Background Strong Women and Youth in Rural Entrepreneurship and Civil Society in Sri Lanka Project is one of the grant projects Plan International Sri Lanka is implementing through partner (Berendina Development Services) organization. Overall goal of the project is “to make a contribution to improving economic participation as well as participation in civil society of women and youth in Sri Lanka”. It is a three-year project which commenced in December 2017 and is expected to complete by November 2020. The project is funded by the Federal Ministry of Economic Cooperation and Development Germany and cofunded by Plan International Germany. The project is being implemented in selected ten divisional secretariat areas in Batticaloa and Ampara districts.
This project aims to change (outcomes) are that 72 local CSOs (specifically, Farmer Organizations and Rural Women's Development Organizations) in Batticaloa and Ampara are pursuing gendertransformative goals and can better represent disadvantaged sections of the population when dealing with the authorities, in particular young women.
1
The geographical coverage of the project is the Eastern Province, selected 10 divisional secretariats in Ampara and Batticaloa districts.
Evaluation Focus The purpose of this mid-term project evaluation is (i) learning and (ii) improvement by assessing the merit and value of the project, arrive at conclusions and provide recommendations for future programme implementation. Firstly, PISL intends to learn from the evaluation of what worked well in achieving outputs and outcomes. Further, PISL is interested in learning of what did not go too well and what reasons can be identified. What and where are the shortcomings and possible alternative solutions. Are there any strategies, approaches, angels, and methodologies the project should have taken especially to the benefit of target beneficiaries (young women and youth)? Secondly, PISL is keen to take the learning to improve overall programming and project design. The evaluation is embedded in Plan International’s Research and Evaluation Agenda. The Agenda identifies areas of where to best focus efforts and resources in generating relevant evidence that will fill sectoral knowledge gaps and enhance influencing and programming. Within the thematic area of young women and youth entrepreneurship and gender transformation of the current project mid-term evaluation should strive to make a contribution to start filling knowledge gaps in: Plan international’s role is, to increase women and youth economic participation for equality and diversity. In addition, PISL focuses on the driving social and gender norms that influence women and youth in economic engagement. Moreover, PISL is keen to know how to increase the economic participation of women and youth
What are the main barriers to women and youth engage in economic participation? What are the most effective methods to overcome poor social norms and attitudes that effect for women and youth as barriers to enter in to economic activities?
Evaluation Criteria The following DAC criteria and other criteria should be assessed as part of the evaluation: DAC criteria
Relevance & Appropriateness - Testing underlying assumptions - Extent to which the project meets the needs of project beneficiaries, especially women and youth Efficiency - Which extent how resources/inputs (funds, expertise, time, etc.) are converted into outputs. Effectiveness - Extent to which project objectives were achieved, the reasons behind, - Assessment of the quality and value of the project - Unintended positive or negative outcomes/consequences for anybody involved or affected by the intervention, especially women and youth Sustainability - Probability of continuation of long-term benefits to young people, especially women and youth
Plan criteria
Gender & Inclusion - The extent to which the project applied gender and inclusion sensitive approaches and explicitly aimed for results that improve gender equality and equality
2
Key Evaluation Questions (KEQ) The consultant shall answer the following key evaluation questions (KEQ). However, the consultant is encouraged during the inception phase of this assignment to critically review the stipulated KEQ and make suggestions and provide feedback. It is expected that the consultant will finalize the KEQ together with the project team on the ground. Criteria Relevance Appropriateness
&
KEQ How well did the project outcomes and project strategies suit the needs and priorities of young women and youth?
Efficiency
Were the resources and inputs converted to outputs in a timely and costeffective manner? - Is Project management, coordination and monitoring appropriate? - How well does the project do to promote the enablers and counter the barriers that exist for economic participation and thriving of women and youth? - What alternative activities /approaches could be employed to increase the efficiency in reaching the objectives of the project
Effectiveness
To what extent, women & youth are better: Skilled in appropriate training Able to pursue wage or self-employment opportunities What helped and what hindered them (consider both project strategies and contextual factors)?
Impact Sustainability
To what extent do women and youth engage in economic activities? How project impact going to continue with partners/stakeholders - Addressing gender equality, and other relevant issues with partner
Gender & Inclusion
What are some of the commonly held ideas, beliefs and practices at the individual and household level that affect women and youth to: Access and participate in project activities, especially skills trainings Participate in the economic activities Did the project address any structural and or normative barriers / harness enablers for women and youth to engage in the project? Were there any specific strategies developed to target women and youth? What do different stakeholders see as main barriers to women and participation in economic activities? What do they identify as possible solutions?
Users of the Evaluation The findings of the evaluation will be shared with and used by a range of stakeholders, not only for reporting purposes but to inform future Strong Women & Youth in Rural Entrepreneurship and Civil Society in Sri Lanka Project by Plan (in Sri Lanka and elsewhere) and potentially, for advocacy and policy influencing purposes. Audience Funders of the current project (BMZ/GNO) Plan Sri Lanka
Use -
Reporting and compliance requirements.
-
This report should be a useful source of information for design of possible future grant projects Accountability to current project stakeholders and participants.
-
3
Plan International Germany (GNO)
-
Plan Global
Stakeholders/ participants in current and future Plan women and youth programmes
-
-
Reporting and compliance requirements Improve understandings of this project and shortcomings of current project steering to enable better project steering Inform possible adaptations in the project to increase effectiveness, efficiency and sustainability understand reasons for strong delay in project activities Guide future youth employment and entrepreneurship in GNO’s portfolio Improve understandings of this project to enable better project steering support by GNO to PISL Inform future research by GNO in the area of youth employment and entrepreneurship and women’s economic empowerment Contribute to knowledge and evidence related to key priorities in Plan Global’s Evaluation and Research Agenda. Inform future programming and research in Plan’s youth employment and entrepreneurship and women’s economic empowerment work globally. Inform the design of future policy and practice around youth employment and entrepreneurship and women’s economic empowerment in Sri Lanka
Methods for Data Collection and Analysis The consultant is requested to outline her/his proposed methodology in the application. The detailed methodology for the evaluation/ research will be developed with the selected consultant, Plan staff and other relevant stakeholders. But some overarching parameters have been identified, that must be incorporated in the methodology: -
Data collection must involve stakeholders who were involved in the current project and control groups who have not been involved. Stakeholders may include: Women who are not engaged economic activities (Women Rural Development Societies and Famer Organizations) Women who are engaged engage, including in non-traditional industries Women who experience multiple layers of disadvantage (e.g. women with a disability, women from rural/ remote areas) Private sector actors, including business or industry associations/ councils Relevant government representatives
-
The evaluation and research will include primary data collection (largely qualitative) and take into account project monitoring data and secondary data sources. This will allow the consultant to triangulate multiple data sources, to draw robust conclusions about the current project’s effectiveness and learning for future programming.
-
The evaluation and research should adopt a capacity-building approach on how to design and implement an evaluation for Plan Sri Lanka and Berendina Development Services staff, ensuring that the project team is involved in key steps of the evaluation/ research, including methodology design, data collection and sense-making
Deliverables The following deliverables are expected from the consultant: Deliverable Preparation and facilitation of evaluation and research design workshop Inception Report including:
Date After signing the MOU/Agreement 10th July 4
-
Finalized KEQ Methodology and Analysis Agreed timeline of activities Overall activity plan Data collection tools Ethical considerations Consent forms for any primary data collection Draft methods for data analysis Presentation for plan staff Preparation and facilitation of “sense-making� evaluation draft findings workshop Draft evaluation report Final evaluation report with executive summary Final data collection tools Cleaned data Completed consent forms
31st July 09th Aug 27th Aug 01st July 23rd July 31st July
Timeline Activity/ milestone Contract signing Preparing design workshop Drafting Inception Report including - Finalized KEQ - Methodology and Analysis - Agreed timeline of activities - Overall activity plan - Data collection tools - Ethical considerations - Consent forms for any primary data collection - Draft methods for data analysis Plan Comments Incorporate the comments and finalize the inception report Secondary information review Primary information collection Data cleaning Data analysis Sense-making workshop (including preparation) Draft report delivered Plan comments Short presentation and final report delivered
Deadline 14th Jun 17th Jun 01st July
Lead PISL Consultant Consultant
Level of effort in days 0 02 working days 10 working days
08th July 10th July
Plan Consultant
02working day
12th July 21st July 23rd July 26th July 31st July
Consultant Consultant Consultant Consultant Consultant
02 working days 07 working days 01 working day 05 working days 02 working days
09th Aug 19th Aug 27th Aug
Consultant Plan Consultant
10 working days
Total consultant
42 working days
01 working day
Budget The consultant is expected to provide a financial proposal to Plan International Sri Lanka. The financial proposal should be inclusive of VAT and taxes, travel costs to Eastern Province, and other expenses. The payment schedule is as follows: Milestone Signing of contract Design workshop and Inception Report
Amount to be paid (in %) 10 30
Expected outputs 14th Jun 10th July 5
Data collection completed and “making sense workshop” Final Evaluation Report
30
31st July
30
27th Aug
The duration of the assignment is 14th June to 27th August. The estimated level of effort is expected to be 42 full working days. Ethical and child protection statement Plan International is committed to ensuring that the rights of those participating in data collection or analysis are respected and protected, in accordance with Ethical MERL Framework and our Child and Youth Safeguarding Policy. All applicants should include details in their proposal on how they will ensure ethics and child protection in the data collection process. Specifically, the consultant(s) shall explain how appropriate, safe, non-discriminatory participation of all stakeholders will be ensured and how special attention will be paid to the needs of children and other vulnerable groups. The consultant(s) shall also explain how confidentiality and anonymity of participants will be guaranteed. Permissions The consultant will be responsible for obtaining the necessary permissions to implement the research data collection at the local level. Conflict of interest: The consultant must demonstrate the necessary independence and declare any conflict of interest and potential biases, including bias towards any of the stakeholders, target groups, types of research methodologies or approach, social, political or religious prejudice. Expected Qualifications The minimum qualifications for consultant are as follows:
Postgraduate degree in evaluation, sociology, psychology, pedagogy, social work, anthropology, international development or related field; 10 years working experience 7+ years of demonstrated working experience in leading and carrying out project evaluations in a development and humanitarian context; Proven project evaluations in Sri Lanka is a must; Strong command and skills on evaluation methods such as qualitative inquiry through interviews and focus group discussions Strong command and skills on evaluation methods such as quantitative inquiry through surveys paid with proven statistical skills Proficiency in data analysis, especially qualitative data analysis and analysis methods such as but not limited to grounded theory and qualitative content analysis Evaluations in the field of youth employment, skills development, women economic empowerment, youth empowerment, enterprise development and entrepreneurship a must Experience in working with youth, especially young women and communities is a strong advantage Fluency in English and Sinhala and Tamil is a must
Application Interested consultants or agencies should submit their proposal in English on the basis of the TOR. The technical proposal and financial offer should be submitted as soft copies (PDF) and the hard copies (must) to the address on or before 07th June 2019 Soft copies should be email to <sunitha.siyambalagoda@plan-international.org> 6
Hard copies should be sent to: Plan International Sri Lanka, No. 110, Park Road, Colombo 05 Technical part: ď&#x201A;§ Detailed response to the ToR ď&#x201A;§ Proposal covering: (i) methodology, timelines, CV, example of previous work Financial part: ď&#x201A;§ Detailed budget, including daily rates, expenses, taxes, time line etc.
Contact details Plan International Sri Lanka (PISL) will form an internal steering committee led by DCD-Programme Director with the support of M&E Unit and Plan International Germany Mr. Jonas Erhardt, Programme Specialist - Asia to manage and guide the review. The steering committee will provide operational and technical support to the review, monitor progress through discussions and presentations with the team of consultants and review the inception, draft and final reports and ensure quality throughout the process. The PISL staff will also provide support to the extent possible in accessing internal documents relevant to the review, access to beneficiaries and communities and projects that will be subject to the study. The PISL staff will be organized the orientation workshop with stakeholders to present the review methodology and inception report. Plan International Sri Lanka focal point for contacts: Overall Management Name : Sujendra Selvalingam Title : Partnership & Compliance Manager E-mail : sujendra.selvalingam@plan-international.org Technical Questions Name : Shehan Fernando Title : MER Specialist E-mail : shehan.fernando@plan-international.org Administrative Questions Name : Sunitha Siyambalagoda Title : Administrative Assistant E-mail : sunitha.siyambalagoda@plan-international.org
7