MONITORING AND EVALUATION EFFORTS FROM GMW PARTICIPATING ORGANISATIONS Countries around the world have also made efforts to capture and measure the level of reach, satisfaction and impact of GMW. Given that many of the activities were carried out digitally in 2021, organisations focused on capturing first and foremost outreach figures, such as social media outreach, 4 including tracking the number views, likes, shares. Many organisations also tracked types and numbers of materials distributed in schools and households, such as children’s board games, booklets, or other materials. In North Macedonia, for example, a social media campaign by the pension authority, MAPAS, reached between 50,000 to 300,000 daily unique Facebook users. By using a variety of media, adapted to their target audience, including community radios, the organisers of the Money Week in South Africa reached over 60 million people during the campaign. The digital environment also allowed countries to develop and implement online quizzes and satisfaction surveys that could be easily filled-in by participants after the events. For example, in Brazil a satisfaction survey link was sent following specific events. Outcomes indicated a high level of satisfaction of participants (over 98% of the participants indicating that the events either exceeded or met expectations and 99.1% said that they would refer GMW to a friend). In Portugal, the two initiatives organised by the financial supervisors during GMW (which included online debates about savings and digital channels), were subject to an evaluation process. Both students and teachers were asked to assess the classroom activities and the online debate, by answering a satisfaction survey. Preliminary results indicated that all teachers and 97% of students agreed or strongly agreed that these initiatives contributed to students’ learning; moreover, 86% of the teachers indicated that they wished to carry out other financial education initiatives in the future. Similarly, in Suriname, a virtual quiz was developed and shared with young people, consisting of questions about the different activities implemented. Satisfaction surveys were also sent to teachers in Hungary a few weeks after the completion of GMW. They indicated a satisfaction rate of 85-100% in all the areas evaluated (such as topics chosen, implementation of the lessons or engagement of pupils). Other countries opted for more in-depth measurements of the effects of GMW activities on participants’ financial knowledge. For example, the virtual GMW fair in Peru had a monitoring and evaluation component, which aimed at identifying improvements in participants’ financial knowledge after visiting the different stands and conferences of the virtual fair. The SBS developed an entry test, an exit test, and an indicator of the level of interaction of the participants in the virtual fair. Results suggested an increase in financial knowledge of participants after taking part in the GMW activities. Similarly, in Egypt, pre and post assessments were organised for all training session. Finally, in South Africa, the organising committee implemented a monitoring and evaluation exercise to evaluate critical aspects of the Week. These included evaluating the planning activities against the set objectives and an evaluation of survey responses by various participants to implemented financial education initiatives and their satisfaction levels. 5
4 See, for example, the GMW google analytics reports from Ecuador: https://globalmoneyweek.seps.gob.ec/wp-content/uploads/2021/04/report1.pdf ; https://globalmoneyweek.seps.gob.ec/wp-content/uploads/2021/04/report2.pdf 5 The comprehensive report is available here: https://mswsa.co.za
23
