Fast Track Impact

This week, Mark talks through a series of good practice principles for engagement and impact, published in his recent blog post: https://www.fasttrackimpact.com/post/what-is-good-practice-engagement-and-impact. Add your own feedback and ideas here: https://docs.google.com/document/d/1J_QY7HvW89Y08p3ySfEl8zL0XmcQ9cLg2K8rm0r7mYY/edit?usp=sharing

The blog builds on a number of sources, including:

Mark’s Impact Culture book (see the bottom of this page for his impact culture toolkit): https://www.fasttrackimpact.com/impactculture

NCCPE engagement guidance: https://www.publicengagement.ac.uk/support-engagement

Mark’s “Re-thinking impact…” paper:

https://link.springer.com/article/10.1007/s11625-022-01216-w

This week, Mark explores what the recent REF2029 guidance means for impact, including a discussion of what we might be expected to write about in the new engagement and impact narrative, and an evidence-based approach to writing a 4* impact case study.

NCCPE engagement guidance:

https://www.publicengagement.ac.uk/support-engagement

My “Re-thinking impact…” paper:

https://link.springer.com/article/10.1007/s11625-022-01216-w

What made a 4* impact case study in REF214 paper:

https://www.nature.com/articles/s41599-020-0394-7

My 4* REF2021 impact case study:

https://www.dropbox.com/s/mdtbxy72uv1pvbs/Mark Reed impact case study FINAL 17 March 21 redacted (submitted).docx?dl=0

Impact templates (in the Google Sheets menu, go to File > Make a copy to save an editable version)

3i analysis template:

https://docs.google.com/spreadsheets/d/1bL28FUgd7R3nvGYjV5P7qrZkHgaqlYpZM5uJmFls-eA/edit?usp=sharing

Fast Track Impact Planning Template:

https://docs.google.com/spreadsheets/d/1iGX6HM__TPQP4KDbqVytr-1FnQBn00KX7NXEaUR9CIQ/edit?usp=sharing

This week, Mark talks to Michael Parker, Director of Operations at The Conversation, a news outlet that specialises in working with researchers, giving them editorial control on a global platform. Drawing from their work together creating the Media Impact Guide and Toolkit, Mark and Michael discuss how researchers can harness the media to get more impact from their research and provide evidence of both the reach and significance of the impacts that arise.

Read the Media Impact Guide and Toolkit: https://www.fasttrackimpact.com/media-impact-guide-and-toolkit

Find out more about The Conversation: https://theconversation.com/uk/

Sign up for next year’s Exchange conference: https://theconversation.com/uk/exchange

Eric Jensen is an expert in impact evaluation who has written a textbook on many of the most useful methods you'll need and leading two companies that specialise in impact evaluation consultancy and training alongside his academic research on environmental issues. In this interview, he provides tips to help you design a more effective survey to evaluate your impact, and explains how you can repurpose widely used impact planning tools as evaluation tools, that will help you improve your practice as much as they will give you evidence of impact.

Find out more about the Institute for Methods Innovation via his Methods for Change website: https://www.methodsforchange.org/

Learn about Qualia Analytics software to help you both collect and analyse impact evaluation data: https://www.qualiaanalytics.org/

Watch Eric training with Mark and others on the use of Theory of Change to evaluate impact:

https://www.youtube.com/watch?v=iCODib5tDK0

Read Eric's book, Doing Real Research: A Practical Guide to Social Research https://us.sagepub.com/en-us/nam/doing-real-research/book241193

This week, Mark interviews Laura Tucker (Vertigo Ventures), Tobias Schoep (GrowImpact), and Sarah Morton (Matter of Focus) about the platforms they have developed to help researchers keep track of their impacts. Find out more about each platform:

- GrowImpact: http://www.growimpact.com.au/

- OutNav from Matter of Focus: https://www.matter-of-focus.com/track-your-progress-and-impact-in-outnav/

- Impact Tracker, part of the impact ecosystem from Vertigo Ventures: https://www.vertigoventures.com/products/impacttracker-impact-software/

This week, Mark interviews Rachel Blanche from Queen Margaret University Edinburgh to find out how arts-based methods can provide depth and rigour to an impact evaluation. They discuss a range of approaches including visual, performative and narrative methods, the types of evidence these methods can generate, how these approaches can empower participants in determining what’s meaningful, and how evaluating in this way can itself generate further impacts.

Rachel shares two examples of arts-based methods used to evaluate impact in healthcare research – a theatre project capturing data on dementia care (citing this paper: http://www.meetinggroundtheatrecompany.co.uk/wp-content/uploads/2015/06/28-31JDCJF15Schneider.pdf) and a participative creative inquiry on osteoporosis (details here: https://eresearch.qmu.ac.uk/handle/20.500.12289/10487).

The paper we mention writing together about evaluating impact with arts-based (among other) methods can be accessed here: https://www.sciencedirect.com/science/article/pii/S0048733320302225?via%3Dihub

Watch the training Rachel and I ran on evaluating impact

https://www.youtube.com/watch?v=IMzT_99JDDI

And you can find out more about Rachel's work here: https://www.qmu.ac.uk/schools-and-divisions/mcpa/mcpa-staff/rachel-blanche/

Mark discusses a range mixed methods evaluation designs that can help you collect data to evidence impacts arising from industry, policy, media, and public engagement. The methods are easy to use without any specialist training or experience, and can generate useful data in some of the trickiest areas of impact evaluation.

Find out more about the "postcard to your future self" method: https://www.fasttrackimpact.com/post/2018/11/07/get-longitudinal-impact-data-with-a-postcard-to-your-future-self

Find out more about the Media Impact Guide and Toolkit: https://www.fasttrackimpact.com/media-impact-guide-and-toolkit

Read Mark's REF2021 case study in which he evidenced a range of policy impacts: https://results2021.ref.ac.uk/impact/9318b32e-3b4c-4629-9fea-6b7ede36e4e9?page=1

How do you design an impact evaluation? There is no blueprint, but in this episode, Mark gives you the tools you will need to choose an evaluation design with methods that can deliver convincing evidence while giving you win-wins for your research.

Evidencing impact paper: https://www.sciencedirect.com/science/article/pii/S0048733320302225?via%3Dihub

Decision tree: https://www.dropbox.com/s/pbupwthhgpj9yzv/Decision%20tree%20EDITED.pdf?dl=0

In this first of a series of episodes on monitoring, evaluating and evidencing impact, Mark discusses one of the biggest mistakes that people make when the evaluate their engagement instead of their impact, and provides simple tools anyone can use to keep track of their impact with minimal time and effort. He concludes by explaining the difference between monitoring and evaluation and introducing impact evaluation concepts and approaches. The episode draws on this paper about evaluating impact: https://www.sciencedirect.com/science/article/pii/S0048733320302225?via%3Dihub

This week, Mark interviews George Hope, Communications Manager at Oxford Net Zero and Greenhouse Gas Removal Hub, based at University of Oxford, about how you can reduce the risks of engaging with social media and achieve more impact online. They discuss challenges of engaging with skeptics and conspiracy theorists, and strategic tools for achieve more impact with less risks to your time, reputation and mental health.

Connect with George on LinkedIn or follow his work on Twitter via his personal account, Oxford Net Zero and the CO2RE Hub.