End Of Grant Report (Year 1 of 3) Prepared for: Jo John & Suzanne Hoy, Suffolk CCGs Prepared by: Damien Ribbans, Operations Manager May 2019 Grant/Contract Reference: Children & Young Peoples Emotional Health and Wellbeing
Page 1 ! of !21
CONFIDENTIAL
Noise Solution CIC
NOISE SOLUTION
About Noise Solution
4
OUR APPROACH
4
THE EVIDENCE BASE
4
WHY WELL-BEING?
5
UNDERSTANDING SUCCESS
5
EXECUTIVE SUMMARY
6
OBJECTIVE
6
GOALS
6
IMPACT MEASUREMENT & REPORTING
6
YEAR 1 RESULTS
6
Referred participants
8
UIN 1269
8
UIN 1250
9
UIN 1318
10
UIN 1330
11
UIN 1343
12
UIN 1320
13
UIN 1331
14
UIN 1333
15
UIN 1507
17
UIN 1804
18
Population impact summary
NOISE SOLUTION POPULATION DATA Page 2 ! of !21
CONFIDENTIAL
19
20 Noise Solution CIC
STATISTICAL SIGNIFICANCE
21
SOCIAL RETURN ON INVESTMENT
21
Page 3 ! of !21
CONFIDENTIAL
Noise Solution CIC
ABOUT NOISE SOLUTION Noise Solution is a social enterprise which delivers 1:1 music mentoring sessions that have been independently proven to improve well-being amongst a population labelled ‘hardest to reach’. Uniquely, mentoring is enhanced through a digital platform that engages participant, family and professionals. As well as contributing to well-being impacts, the platform also captures and evaluates well-being impact both qualitatively and quantitatively. This duality of approach solves issues of rigorous impact capture often experienced by third sector organisations.
Our approach Our approach is two-pronged. We have developed a digital sharing platform (reflective for participants and families of everyday social media experiences) which has been designed specifically to engage, compliment and reinforce an individualised 10-week mentoring program currently focused on music technology and beatmaking (though we believe the options for widening the pedagogy to include other art forms or activities other than music are strong). We utilise both the benefits of personalised mentoring and a digital platform to connect and embed the impacts that the approach has by sharing participants success and encouraging external validation from those whose opinions the participant values. Additionally, all aspects of interactions within the platform are measurable and reportable within the platform. Importantly, the participants voice in the form of comments and video reflection is front and foremost driving the process, rather than being an added-on evaluation exercise post-intervention. The platform inclusively engages participants (often refusing or struggling with engagement), their families and professional keyworkers around a story of the participants success (strengths based). This digital sharing scaffolds reflection for participants and family and reinforces successes whilst also allowing us to measure the impacts on well-being. The platform builds in rigorous statistical analysis and comparison against nationally benchmarkable well-being data (SWEMWBS), developed by the NHS and Warwick and Edinburgh Universities.
The evidence base Our methodology arises from £100k investment in research and development over the last 5 years, plus a twoyear Research Masters at Cambridge University. This research looked at the evidence underpinning the psychological needs which have to be supported to increase engagement, understand and increase wellbeing, and how to measure change meaningfully. For a deeper understanding of the theoretical underpinnings of the work, Simon Glenister MEd (CEO, Noise Solution) has published about Noise Solution’s work and the evidence base. You can read more here. In 2016 The Social Investment Consultancy carried out a year-long external evaluation report, looking at our impacts. The evaluation found that Noise Solution was highly statistically significant in positively impacting on well-being amongst its population. These results have been consistently replicated since.
Page 4 ! of !21
CONFIDENTIAL
Noise Solution CIC
Why well-being? Whilst Noise Solution presents as a music project, our focus is on positively impacting on well-being. We focus on well-being because significant empirical evidence proves that if we improve well-being we get better health, social, educational and engagement outcomes. By focusing on well-being we can effect change in all of these areas, which means our approach is applicable across a wide range of people.
Understanding success Success is individual, and it is important to recognise the small achievements alongside the transformational ones. Noise Solution does not impose pre-determined agendas on participants. Instead, Noise Solution creates a window of opportunity within which other organisations and individuals around a participant can reengage with each other and acts as a catalyst for change to refocus negative trajectories into positive ones. Progression is important to us. Through the Digital Story, we are able to engage those around a participant with the participants voice at the centre. Around session five we start looking with the participant at what they would like to do post-Noise Solution. The participants preferred progression routes are fed to the supporting professionals through weekly Session Reports. Overall, Noise Solution sees about 71% completion and 88% attendance amongst its population of prolific non-attenders, phobics and the hardest to engage. All of the population data is only drawn from those who have completed as it relies on bivariate data and clearly those who don’t complete don’t provide end data. The 29% of those who don’t complete is made up of those who Noise Solution has not managed to engage with, but also those who move out of area or those who move on to other things before they have completed.
Page 5 ! of !21
CONFIDENTIAL
Noise Solution CIC
EXECUTIVE SUMMARY Objective Noise Solution took part in the East and West Suffolk Transformation Plan for Children and Young Peoples Wellbeing. Further to successfully delivering under this grant (managed by the Suffolk Community Foundation) Noise Solution was awarded a 3 year Grant Agreement (2018-2021) from the Ipswich and East Suffolk & West Suffolk Clinical Commissioning Groups.
Goals The intention of the Grant Agreement was for Noise Solution to “support and help engage children and young people in challenging circumstances and improve their wellbeing” (Grant Agreement background (A) 1st April 2018). Specifically, Noise Solution was commissioned to deliver its 1:1 music mentoring service to 10 young people a year for three years. The young people were able to be referred through Looked After Children's Services, Mental Health teams, DWP, Youth Offending, Social Services, Schools, Colleges or other reasonable agencies or organisations. Noise Solution was required to report on improvements in well-being as described below.
Impact Measurement & Reporting Noise Solution measures its impact on well-being using the Shortened Warwick Edinburgh Mental Well-Being Scale (SWEMWBS). We have included individual scores here as a guide only. The SWEMWBS data is not designed to be used as an individual diagnostic tool, but a way of measuring impact at a population level. The sample size is too small to be able to extrapolate meaning from here but when combined with our other work (delivered in exactly the same way) we see high statistical significance of well-being impacts across a population of 100 plus. The data captured from the participant at the start and end of a set of sessions, and the ‘distance travelled’ is statistically analysed on individual and population levels (any change over 2 is considered to be meaningful). Alongside these quantitative data, Noise Solution captures an equal amount of qualitative data in the form of the Digital Stories which is created by each participant as well as reflective feedback sought from the Participant and other involved third parties. This document seeks to report on the first year of this Grant Agreement, giving both quantitative and qualitative feedback.
Year 1 Results The results from the first year of this Grant Agreement reflect broadly the results seen in the rest of the Noise Solution population. We see a 10% shift from low to moderate well-being, with 80% of participants finishing at, above or within a meaningful range of the national well-being average. Qualitative feedback is also positive, with participants engaging or re-engaging with other activities and requesting further sessions with Noise Solution. Third party feedback is also positive from families and professionals alike.
Page 6 ! of !21
CONFIDENTIAL
Noise Solution CIC
These data demonstrate Noise Solutions ability to impact on well-being amongst ‘hard to reach’ populations and act as a catalyst for change after a relatively short intervention.
Page 7 ! of !21
CONFIDENTIAL
Noise Solution CIC
REFERRED PARTICIPANTS In order to maintain the confidentiality of participants referred, we have reported on individuals using a Unique Identifier Number (UIN). Names of individuals referred to Noise Solution through this Grant Agreement can be supplied, if required (assuming General Data Protection Regulation requirements are satisfied).
UIN 1269 Gender - Male Age - 15 Referred from - DWP Attendance - 100% Referrers aims - “A happier kid, with better self beliefs and less anger”. Progression - Education (Music Tech place at College). SWEMWBS Start
SWEMWBS End
+/- Change
Moderate
Moderate
- 1 Point
Embedding feelings of competency.
Digital platform showing engagement from parents. Feedback “Creating music and the sheer praise I got for it after from friends and family. Experience in a studio, fun making music that I like, praise/a sense of being good at something.” - Participant
Page 8 ! of !21
CONFIDENTIAL
Noise Solution CIC
"Hi I'd like to start by thanking you and Noise Solution for giving [PARTICIPANT] the chance to make music this last few months he's thoroughly enjoyed the experience. I'd say [PARTICIPANT]’s gained confidence not only in his music and ability but in himself in every aspect. [PARTICIPANT] is more engaged in life, especially in school life revision etc. I'm not sure if it's made much difference in decision making but I'm sure it's helped. Noise Solution is completely different to any other service we've looked for help from, I think it's been fantastic and we have a more confident kid because of it. Many thanks”. - Mum
UIN 1250 Gender - Female Age - 13 Referred from - SCC Attendance - 100% Referrers aims - “For [PARTICIPANT] to gain confidence and believe she is capable of achieving well”. Progression - Home Ed, intention to attend Open Mic nights here at the Hunter Club, to view and then participate. This is a massive thing for [PARTICIPANT]. SWEMWBS Start
SWEMWBS End
+/- Change
Moderate
Moderate
+ 3 Points
Developing positive relationships.
Deciding to attend and (maybe!) perform.
Feedback “I believe you can do anything you want if you put your heart into it”. - [PARTICIPANT].
Page 9 ! of !21
CONFIDENTIAL
Noise Solution CIC
"Different to other music activities as in music lessons she's told what to do. These sessions are more led by [PARTICIPANT] and what she wants to do.” - Mum.
UIN 1318 Gender - Female Age - 17 Referred from - Child & Adolescent Psychotherapist Attendance - 100% Referrers aims - To build [PARTICIPANT]’s self esteem and bring the focus back to her and the fact that she really matters in herself and doesn't have to look after everyone to be okay, and she is able to say no to prevent any future abuse, as very vulnerable here. Progression - Education maintained Context - after family breakdown father removed himself from contact, boyfriend left, housing lost.
SWEMWBS Start
SWEMWBS End
+/- Change
Low
Moderate
+ 1 Point
Validating success, self directed.
Developing resilience and self confidence.
Feedback “FUN, and an escape from the problems that are going on. I feel more resilient to deal the stuff that life throws at me. Coping mechanisms and strategies are great but they don't always help, using this to focus on makes all the other stuff fade away to provide a break. To be honest once I've been distracted the bad stuff doesn't
Page 10 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
come back. Being able to have fun and chill and do things that can relate to how i feel without talking about it but expressing it. i loved making my own tracks and learning the piano!” - [PARTICIPANT].
UIN 1330 Gender - Female Age - 17 Referred from - Suffolk County Council Attendance - 100% Referrers aims - [PARTICIPANT] would like recognition for her music and for people to hear her. [PARTICIPANT] would like to do something positive that she can be proud of and people will see that she can achieve good things. This will give her something to look forward to that is safe. Progression - Changed to music tech and accepted on course. Context - this young lady had previous involvement with County Lines.
SWEMWBS Start
SWEMWBS End
+/- Change
Moderate
Moderate
- 2 Points
Noise Solution acting as a catalyst for change; positive diversions from other negative activity. Feedback "Consistency. You've worked on her agenda. Inclusive. Subject matter has been focused. Confidence has improved from lots of things, Home, College, Performing, and Noise Solution together. I'd say that the E-
Page 11 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
portfolio/Blog helped swing her acceptance to college. Support in learning and activities has helped. Subject matter has helped a great deal.” - Professional. “I would really love some more sessions to keep making tracks!”. - [PARTICIPANT].
UIN 1343 Gender - Female Age - Unknown (16-18?) Referred from - NSFT Attendance - 50% Referrers aims - Give [PARTICIPANT] a path, give her something to do in her spare time - a coping strategy. Progression - Requested to do Level 3 with Noise Solution (Arts Award Gold) - can be delivered if funding is available. Context - tricky to engage due to involvement with County Lines, along with some illness-related absences. SWEMWBS Start
SWEMWBS End
+/- Change
Low
Low
+ 2 Points
Embedding confidence.
Engaging professionals.
Feedback “relaxed, less intense, more flexible” - Mum “I wasn't sure I wanted to come but it's been exciting" - [PARTICIPANT].
Page 12 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
UIN 1320 Gender - Female Age - 13 Referred from - Child & Adolescent Psychotherapist Attendance - 90% Referrers aims - Increase her trust and confidence, build self esteem and to "be seen" and validated. Progression - Further music making. Context - complex family environment with suicidal ideation from sibling (sectioned) and the participant. SWEMWBS Start
SWEMWBS End
+/- Change
Low
Low
+ 2 Points
Improving self-confidence from being unsure to sharing herself singing. Feedback “its fun and helps me work on what i love to do” - [PARTICIPANT] “Focusing on developing skills and a physical end product develops confidence and self worth. Being able to show people what you are doing and get further positive feed back is invaluable. Learning to make decisions about music helps develop decision skills that can be used in other situations.” - Dad
Page 13 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
UIN 1331 Gender - Male Age - 16 Referred from - DWP Attendance - 90% Referrers aims - To build his self confidence and self esteem. To add to his skills and talent and a career as a music producer in the music industry. Progression - Education, further music making.
SWEMWBS Start
SWEMWBS End
+/- Change
Moderate
Moderate
+ 7 Points
Embedding competency and engaging people around the individual with newly formed positive identity. Feedback “I have improved on my knowledge about production and have improved my production quality it has also inspired me to get FLStudio Producer edition so i can play with samples on it i am a lot more confident with my music” - [PARTICIPANT].
Page 14 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
UIN 1333 Gender - Female Age - 18 Referred from - Bury Interdisciplinary Team Attendance - 90% Referrers aims - [PARTICIPANT] to progress her interest in music and feel confident about doing something positive away from her family home. I hope that the confidence gained will encourage [PARTICIPANT] to consider further education options in the future. Progression - Further music making. Context - lack of engagement with any other provision prior to Noise Solution. SWEMWBS Start
SWEMWBS End
+/- Change
Low
Moderate
+ 4 Points
Making the participant the expert, and using this positive identity to build a community around them through the Noise Solution platform. Feedback “Just wanted to drop you a line about Noise Solution and [PARTICIPANT]’s participation over the last couple of months. I have to say I am so impressed with what she has been doing, and the facilities you have there at the Hunter Club. It is pretty much the only thing she has engaged with over the last couple of years, so it is amazing! It is the only thing that I don’t have any trouble getting her to participate in. She really does like being in the studio.
Page 15 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
I have seen her forays into drumming, which is so great to see her engaging in something new. I had no idea she might be interested in that! It is very hard to get her to be enthusiastic about anything, and Noise Solution has been the only thing! I would dearly love her to continue doing something like this in some way, something musical and creative, as it would be a shame to just end after a great 10-week experience. She is still really interested in music and I know she feels at home and relaxed in the studio you have. I feel she has only just started, really”. - Mum.
Page 16 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
UIN 1507 Gender - Male Age - 16 Referred from - Wellbeing Hub Attendance - 100% Referrers aims - Self esteem issues, low confidence, social anxiety, social withdrawal. Avoiding behaviours. Progression - Further music making. Context - Bullied in primary school no other significant life events. Since primary school and unmanaged bullying has gradually become more and more socially anxious and isolated. SWEMWBS Start
SWEMWBS End
+/- Change
Moderate
Moderate
+ 1 Point
Using the blog to build and rebuild relationships with other people. Feedback “[PARTICIPANT] has clearly progressed as a musician over the course of the past 10 weeks, growing increasingly competent using the software and working independently to create his own music. He has set-up his laptop with the appropriate software and virtual instruments to continue pursuing music-making as a hobby. I plan to email the music teacher at [SCHOOL] to suggest that he continue to encourage [PARTICIPANT] and find a way to include him some of the music activities at school. I also invited
Page 17 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
[PARTICIPANT] to come and use the studio during his school holidays - something he seemed interested in particularly if he could bring along a friend. - Musician
UIN 1804 Gender - Male Age - 14 Referred from - Child & Adolescent Psychotherapist Attendance - 100% Referrers aims - Improved confidence, a sense of achievement and pride, to carry through and complete a task. Progression - Further music making, Education Context - Autism has meant that [PARTICIPANT] is concerned about being different. Takes time to cope with new people and situations. Doesn’t easily show or express emotion - difficult to read SWEMWBS Start
SWEMWBS End
+/- Change
Moderate
Moderate
+ 1 Point
Challenging [PARTICIPANT] in a supportive environment.
Using skills learned to initiate strengths-based discussions.
Feedback “It is very participant led which encourages engagement in learning and builds confidence. Experimentation is encouraged which helps to learn from 'mistakes' and try new things without the anxiety of 'doing something
Page 18 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
wrong'. It was also a lot of fun and a way for [PARTICIPANT] to 'get away' from his problems for a while and become immersed in a productive activity.” Mum. “The use of the blog in the ECHP plan was instrumental in individualised learning being provided by school as they could see how successful it was. The small change in well-being can be attributed to the fact that a lot of things in the education realm went wrong drastically in this time but Noise Solution (and therapy) was attributed as the thing that kept [PARTICIPANT] afloat - with something to look forward to.” Mum.
POPULATION IMPACT SUMMARY SWEMWBS is a population analysis tool rather than an individual diagnostic. Whilst the individual SWEMWBS scores (‘Referred Participants’, above) give an individual view it is more useful to view the data at a population level. SWEMWBS (start)
SWEMWBS (End)
100
100
75
75
50
50
25
25
0
Low
Moderate
High
0
Low
Moderate
High
From the population level data we have in year one we see a 10% decrease in low well-being up to moderate well-being. We know that impacts on well-being are well evidenced to increase health, social, educational and engagement outcomes.
Page 19 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
20%
Because SWEMWBS has been used at sample sizes of 20,000+ multiple times we are able to extrapolate a ‘national well-being average’ which we can compare ourselves against. After a ten-week intervention with this
10%
population we see 70% of participants at or above the national well-being average, with an additional 10% within a
70%
meaningful range of the same.
Above
Meaningful
Below
Noise Solution Population Data The data above is a small sample, but if we compare these data to a much bigger sample using those we’ve worked with to date since our system went live we can see the following:
SWEMWBS (start)
SWEMWBS (End)
100
100
75
75
50
50
25
25
0
Low
Moderate
High
0
Low
Moderate
High
The Noise Solution population data shows a 23.59% decrease in low well-being, a 6.7% increase in moderate well-being and a 16.86% increase in high well-being (sample size n89).
Page 20 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
After a ten-week intervention with this overall Noise Solution population we see 45% of participants at or above
37%
the national well-being average, with another 18% within a meaningful range.
45%
18%
Above
Meaningful
Below
Statistical Significance The sample size for this Grant Agreement is too small to be able to make any claims around statistical significance. However, statistical analysis is automatically calculated from the entire Noise Solution population as follows: Mean Start
20.61
Mean End
P Value
23.31 p<0.0001
% Confidence
>99.99%
% Meaningful Positive Change
Statistically Significant?
52.81% Yes
Range Effect
.50 or more Large effect Data correct as at 31/10/2018
It is intended that statistical significance calculations will be carried out once the complete sample size has been reached at the end of the Grant Agreement period.
Social Return On Investment Whilst the impact data above tells a compelling story in and of itself, when it is combined with the qualitative data from the Digital Story, the participant and those around them we see significant shifts in well-being leading to improvements in engagement and social outcomes. Noise Solution is currently working with Health Economists from Costello Medical in Cambridge to understand and apply financial proxies to the wider outcomes described above. It is intended that this piece of work will complete in April 2019, and we will add in SROI calculations to this report for Year 2.
Page 21 ! of 21 !
CONFIDENTIAL
Noise Solution CIC
