At Brightside, we strive for positive and lasting impact. We need to continually develop our understanding of how and why mentoring works, so that we can build those success factors into every programme and ultimately better support confident and informed decision-making for every Brightside mentee.
Over the last 18 years, we have learned a huge amount about how to run successful mentoring programmes, including what tools and approaches support good engagement. But mentoring is an individual experience. Two mentees on the same project with the same mentor will have different conversations, a different journey and different takeaways. The outcomes we want to achieve are complex because they are about thoughts and feelings, and the complexities are highlighted in our data. In 2019/20, 95% of mentee respondents felt mentoring had helped them feel optimistic about the future, but the proportion who recorded an increase in hope between the start and end of mentoring was much lower. While we consistently see significant positive change at the overall level for human and social capital, our behavioural outcomes show less overall change due to more equal proportions of individual mentees reporting positive, negative and no change. This is despite overwhelmingly positive feedback about their mentoring experience.
One of the great things about Brightside’s mentoring is the fact that all communication is text-based, and captured via our safe and secure mentoring platform. It means that we have the content of a mentoring conversation and can link it to a mentees’ baseline and exit survey responses. We knew we could learn so much from looking at this data together, but didn’t know where to start. That’s where DataKind UK came in.
DataKind UK helps social change organisations use data science in order to have more of an impact. We had heard excellent things from our network about their DataDives – 6-8 week programmes that culminate in a weekend event where data science volunteers work on your data to help you answer a set of key questions for your organisation. In May 2021, 25+ volunteers spent a whole weekend with data pulled from around 1,500 mentoring conversations, helping us investigate the following questions:
It was a weekend full of energy, enthusiasm and insights. Read on for 5 things we learned from our DataDive and what they mean for Brightside:
While the DataDive didn’t find correlations between messaging behaviours and impact scores, there were relationships with the quality ratings mentees gave at the end of a programme. For example, information provision and signposting (measured through sharing of URLs and file attachments) was associated with higher quality scores. We already advocate these behaviours in mentor training and support materials, but evidence that this is linked with higher quality scores helps us to encourage mentors and partners to put it into practice. Other findings challenged some of our assumptions. We understand that, for mentees, thinking of questions for a mentor can be challenging and so we focus on helping mentors to ask open questions to prompt discussion. The DataDive found little to no relationship between mentor questions and mentee quality scores, but it did find one between mentee questions and quality scores. While this doesn’t mean our hypothesis about mentor questions is false, we can look to achieve positive results by equipping mentees to come up with and ask questions.
When preparing for the Dive, we focused on collating a complete data set (i.e. the messages sent and received by mentees for whom we also had both baseline and exit survey responses). However, during the Dive the volunteers noted that we were looking at a set of mentees who predominantly engaged really well and reported high quality experiences. If we had also looked at messaging content and behaviours from mentees who did not engage long enough to ‘complete’ the programme (complete an exit survey), we may have seen more variation and potentially some additional correlations. One of the main recommendations from our team of Data Ambassadors, volunteers who guided us through the DataDive project from beginning to end, was to repeat the analysis for those less engaged mentees, which may highlight behaviours – or a lack of behaviours – that increase the risk of non-completion.
The fact that the DataDive focused on mentees who ‘completed’ a programme means it can give us a guide to ‘usual’ mentee and mentor behaviour. We learned that it was unusual for a mentee to respond to a message once 14 days had passed since their last received message and then make it to the end of the programme. From this, we’ve cemented our assumptions that frequent communication is important for engagement and we can add to our existing mechanisms (such as automated engagement reminders from our app) to ensure we are focusing our support for mentees on the 14 days following a received message, where it is more likely to make a difference.
We could have written a much longer list of key takeaways from our first DataDive, but had to dedicate one learning point to the value of data science for organisations like Brightside. Some insights can be applied straight away to our day-to-day work, and others will help inform our next Impact Strategy. Seeing 25+ data experts giving up their weekend to help Brightside increase our impact on young people was inspiring. During the 8-week lead in, where we worked with our amazing Data Ambassadors on refining our questions and preparing the data, it really felt like we had 4 additional Brightsiders who understood and were invested in our mission. The DataDive has shown us the value of building relationships with organisations like DataKind UK, as well as the wealth of opportunities for learning and upskilling your team that exist in the sector through events such as the Data4Good Festival.
We are excited to continue using our DataDive insights to inform our decision-making and approach to programme design and delivery. We will be talking about our progress with partners and our wider network over the coming months, but please do get in touch if this has sparked your interest in a discussion about mentoring!
A huge thank you to the DataKind UK team, all the volunteers that attended the DataDive, and our wonderful Data Ambassadors and trouble-shooters: Marlene, Agata, Darren, Katy and Nick.
Head of Impact
If you think that DataKind UK could support your organisation with its data question(s), take a look at the free support they offer here.
Here’s what the volunteers had to say about the weekend: