Skip to content

Understanding impact and value – ripple effect mapping in practice

The director of insights and operations for Active Gloucestershire explains the benefits and challenges of using the REM method to understand the wide effects of a project over time.

5th October 2022

by Alan Inman-Ward
Director of insights and operations, Active Gloucestershire

Evaluation comes in many forms and as we move away from running events to get people physically active ourselves, towards working in the more complex environment of a whole-systems approach, evaluation has become more of a challenge.

A core feature of our strategy at Active Gloucestershire is to 'inspire, connect and enable' those in our network to improve the lives of people in the area through physical activity.

We want to connect people behind a common vision, working together to bring about change, provide opportunities and stimulate debate.

Much of this can’t be measured through our traditional methods, such as capturing numbers, plus its impact can take years to come to fruition and may not be something we witness.
 

A core feature of our strategy at Active Gloucestershire is to 'inspire, connect and enable' those in our network to improve the lives of people in the area through physical activity.

This is a key challenge when building our social movement 'we can move'.

Working with the Applied Research Collaboration (ARC) West (part of the National Institute for Health and Care Research), we developed ways to measure the growth and impact of the movement.

One method which proved to be very successful was ripple effects mapping (REM).

REM is an interactive and engaging way of understanding the wider intended and unintended impacts of a project or programme over time.

You can find out more about the mechanics of REM through our recently published paper on how REM can be used to navigate the rivers of system change, and through the Putting it into practice resource by Sport England, which includes examples of other approaches, models and tools used by places to support a whole-system approach.

Over the three years I’ve worked at Active Gloucestershire, I’ve tested a variety of ways to capture the wider impact of our work and that of our network.

Often, the cause of failure was the level of additional administration required in recording the impact. But REM involved fun, interactive workshops and created an opportunity to bring people together to discuss what had happened.

This reduced the admin elements of capturing data, and also increased the quality of the learnings through the additional insight from the discussion between the participants.

Still, this method does have a few challenges:

  • Firstly - recognising and accepting that much of the impact will be invisible to us and communicating that the findings from REM is a small snapshot of the wider impact is key.
  • Secondly - how much detail do we capture? This is an area we are still testing and is often influenced by the aims of the project being evaluated.
  • Thirdly - if REM is run with only internal staff, the wider impacts captured will be limited. The strength comes from bringing a wide range of people who are involved in or impacted by the project.

Using it in practice

At the time of writing this, we are building up to hosting our first 'we can move' network event to bring people from across the movement together, so the attendees can make new connections and pledge to incorporate physical activity in their work to make Gloucestershire a happy and healthy place to live and work. 

We are using REM to measure the success and impact of this.

The workshops we have run so far have all been internal. And whilst the wider impacts captured are currently limited, they have facilitated a safe space for our team to share their thoughts on developing the event and initial feedback from their networks.

This has helped shape and improve the planning of the event and ensure everyone has clarity on their role, whilst building up a range of consequences and outcomes we are expecting from the event.

To manage the challenge of bringing people together to capture the wider impacts, we are providing opportunities during the event to share feedback and their pledges, then following this up with a post-event survey.

A purposeful engagement strategy for our team will follow, to utilise our relationships with attendees to capture longer-term impacts.

These will allow us to map out the intended and unintended consequences from the event and visualise any change in size and strength of 'we can move'.

REM has created a lot of excitement for capturing impact, not only at Active Gloucestershire, but with our partners – both locally and nationally.

It has become a core part of our evaluation toolkit and ARC West has developed a useful suite of training videos to help other organisations use it.

I’m excited to watch it develop and demonstrate impact further as more organisations discover it and use it.
 

Sign up to our newsletter

You can find out exactly how we'll look after your personal data, but rest assured we’ll only use it to make sure you receive our newsletter, to understand how you interact with our newsletter, and to provide administrative information about our newsletter.