Annex A. Methodology
The findings in this case study should be read with appropriate recognition of the complex nature of behavioural change, and with the understanding that the work of BvLF, Hop! and other stakeholders was but one of a number of factors that may have contributed to any identified outcomes. Additionally, this case study reports on what factors stakeholders perceived contributed to the success of the campaigns. The research team has been able to report on the extent to which there was consensus or disagreement about the perceived contribution of the different factors and organisations, but this case study has not focused on establishing a causal connection between BvLF’s support of organisations and parental behavioural change. This would be more of an evaluative approach that engages a different study design, such as the evaluations conducted by the Center for Educational Technology, and was outside the scope of the current case study. This case study is part of a larger piece of work. The research team and BvLF selected five case studies to meet the research objective of ensuring that lessons on ‘what works’ in operating at scale were systematically captured, assessed and made available for other governments, practitioners and foundations to use. During the inception phase, the research team and BvLF developed a shared understanding of the research objective, selected the case studies and developed a plan for the case studies. The methodology plan of this case study consisted of a scoping phase, followed by data collection, data analysis (of documentary review and interview data), write‐up, content validation and finalisation phases. Data were collected up to the end of February 2021. The scoping phase aimed to determine the timeframe of the case study, provide an initial understanding of Hop!’s and other stakeholder’s work, and help identify key informants. It involved:
An initial consultation with BvLF staff to introduce the research team to the project and determine the timeframe to be captured in the case study.
The review of 18 documents about the campaigns provided by BvLF. Documents that covered the content of the campaigns and the evaluations were considered most informative and selected by the research team. These included Hop! presentations, a BvLF cluster report and the three evaluations of Magic Moments (evaluation material about Beautiful Moments was not available at the time of writing). The documents were systematically reviewed, and information was recorded using an analysis protocol organised around the project objectives. Findings from the documentary review informed the interview protocols.
A second consultation with the BvLF country representatives to identify categories of stakeholders and select key informants from identified stakeholder categories for interviews.
Categories of key informants were selected based on the criteria of relevance and their ability to verify facts. As such, Hop! staff were selected as best placed to describe the development of the campaigns, while the evaluator, campaign partners and steering committee members were selected to give the perspective of others involved in the campaign. The agreed external stakeholder categories are listed
33
