Episode 37: Getting creative with impact evaluation

How do you design an impact evaluation? There is no blueprint, but in this episode, Mark gives you the tools you will need to choose an evaluation design with methods that can deliver convincing evidence while giving you win-wins for your research.

Evidencing impact paper: https://www.sciencedirect.com/science/article/pii/S0048733320302225?via%3Dihub

Decision tree: https://www.dropbox.com/s/pbupwthhgpj9yzv/Decision%20tree%20EDITED.pdf?dl=0

The episode Episode 37: Getting creative with impact evaluation from the podcast Fast Track Impact has a duration of 31:15. It was first published 17 Jul 09:47. The cover art and the content belong to their respective owners.

Permalink

More episodes from Fast Track Impact

Episode 44: What is good practice engagement and impact?

This week, Mark talks through a series of good practice principles for engagement and impact, published in his recent blog post: https://www.fasttrackimpact.com/post/what-is-good-practice-engagement-and-impact. Add your own feedback and ideas here: https://docs.google.com/document/d/1J_QY7HvW89Y08p3ySfEl8zL0XmcQ9cLg2K8rm0r7mYY/edit?usp=sharing

The blog builds on a number of sources, including:

Mark’s Impact Culture book (see the bottom of this page for his impact culture toolkit): https://www.fasttrackimpact.com/impactculture

NCCPE engagement guidance: https://www.publicengagement.ac.uk/support-engagement

Mark’s “Re-thinking impact…” paper:

https://link.springer.com/article/10.1007/s11625-022-01216-w

Episode 43: Evidencing engagement and impact for REF2029

This week, Mark explores what the recent REF2029 guidance means for impact, including a discussion of what we might be expected to write about in the new engagement and impact narrative, and an evidence-based approach to writing a 4* impact case study.

NCCPE engagement guidance:

https://www.publicengagement.ac.uk/support-engagement

My “Re-thinking impact…” paper:

https://link.springer.com/article/10.1007/s11625-022-01216-w

What made a 4* impact case study in REF214 paper:

https://www.nature.com/articles/s41599-020-0394-7

My 4* REF2021 impact case study:

https://www.dropbox.com/s/mdtbxy72uv1pvbs/Mark Reed impact case study FINAL 17 March 21 redacted (submitted).docx?dl=0

Impact templates (in the Google Sheets menu, go to File > Make a copy to save an editable version)

3i analysis template:

https://docs.google.com/spreadsheets/d/1bL28FUgd7R3nvGYjV5P7qrZkHgaqlYpZM5uJmFls-eA/edit?usp=sharing

Fast Track Impact Planning Template:

https://docs.google.com/spreadsheets/d/1iGX6HM__TPQP4KDbqVytr-1FnQBn00KX7NXEaUR9CIQ/edit?usp=sharing

Episode 42: Interview with Michael Parker from The Conversation about generating and evaluating impact from media engagement

This week, Mark talks to Michael Parker, Director of Operations at The Conversation, a news outlet that specialises in working with researchers, giving them editorial control on a global platform. Drawing from their work together creating the Media Impact Guide and Toolkit, Mark and Michael discuss how researchers can harness the media to get more impact from their research and provide evidence of both the reach and significance of the impacts that arise.

Read the Media Impact Guide and Toolkit: https://www.fasttrackimpact.com/media-impact-guide-and-toolkit

Find out more about The Conversation: https://theconversation.com/uk/

Episode 41: Tips for evidencing impact with evaluation expert Eric Jensen

Eric Jensen is an expert in impact evaluation who has written a textbook on many of the most useful methods you'll need and leading two companies that specialise in impact evaluation consultancy and training alongside his academic research on environmental issues. In this interview, he provides tips to help you design a more effective survey to evaluate your impact, and explains how you can repurpose widely used impact planning tools as evaluation tools, that will help you improve your practice as much as they will give you evidence of impact.

Find out more about the Institute for Methods Innovation via his Methods for Change website: https://www.methodsforchange.org/

Learn about Qualia Analytics software to help you both collect and analyse impact evaluation data: https://www.qualiaanalytics.org/

Watch Eric training with Mark and others on the use of Theory of Change to evaluate impact:

https://www.youtube.com/watch?v=iCODib5tDK0

Read Eric's book, Doing Real Research: A Practical Guide to Social Research https://us.sagepub.com/en-us/nam/doing-real-research/book241193

Evaluation Episode 40: Can software take the pain out of impact monitoring and evaluation?

This week, Mark interviews Laura Tucker (Vertigo Ventures), Tobias Schoep (GrowImpact), and Sarah Morton (Matter of Focus) about the platforms they have developed to help researchers keep track of their impacts. Find out more about each platform:

- GrowImpact: http://www.growimpact.com.au/

- OutNav from Matter of Focus: https://www.matter-of-focus.com/track-your-progress-and-impact-in-outnav/

- Impact Tracker, part of the impact ecosystem from Vertigo Ventures: https://www.vertigoventures.com/products/impacttracker-impact-software/

Every Podcast » Fast Track Impact » Episode 37: Getting creative with impact evaluation