“Evaluation is the systematic and evidence-based assessment of a policy or intervention to understand its design, implementation, outcomes, overall effectiveness, and value.”

Let’s break down a few things from that quote:

• ‘Systematic’: You need to plan it out carefully and throughout, not just do it at the end.

• ‘evidence-based assessment’: You need gather data, not just have an opinion or view.

• ‘outcomes’: See further down

• ‘value’: This is more complicated than it seems. This [future link] blog post explores this more.

In a nutshell, it is how you learn from your work. It helps you understand what is working, what isn’t, and why, so you can improve what you do.

It is not about judgement or inspection. It is about learning and improving.

There are lots different types of evaluation (pilot evaluation, economic evaluation, impact evaluation, formative, summative…) the list is endless.

However, I want to keep this simple. If you are getting started, and you want to understand your work, you will most likely wish to conduct an Impact Evaluation (IE) or Implementation and Process Evaluation (IPE).

Impact Evaluation (IE): This focuses on what is different, as a result of the programme. Has it worked…?

Implementation and Process Evaluation (IPE): This focuses on how the programme was delivered, and why something may or may not have worked.

Both of these look at different things and in different ways, but for now just knowing the difference is an important step.

If you don’t stop to learn from your work, you risk repeating the same mistakes or missing what is actually making a difference.

Worse, you risk doing harm (and not knowing about it) when you intended to do good.

Evaluation helps you:

• Improve your programmes

• Use time and money more effectively

• Understand who benefits, and who doesn’t

• Make informed decisions about change

In widening participation and social impact work, this matters because resources are limited and the needs are real.

If you have limited resources, time, and/or money, then evaluation is more important than ever.

Myth: Evaluation is complex, time-consuming, and expensive.

Reality: Evaluation can be simple, quick, and budget-friendly, using methods that align with your resources, from quick feedback loops to more formal studies. How complex and expensive it is, is really down to you.

——————

Myth: Evaluation is mainly for accountability and proving success.

Reality: Being accountable is one purpose, but far from the only one. Evaluation drives improvement, helps you learn about your work, helps you do it better, and is your tool for ongoing growth. The context of your work is changing, and this helps you keep up.

——————

Myth: You need to be an expert to do it.

Reality: You will already have valuable skills to do this. Evaluation starts with being curious about your own work, asking ‘why’ and ‘how’. Your existing problem-solving, project management skills, and ability to communicate ideas are all more important than understanding jargon.

——————

Myth: There is one ‘right’ way to do evaluation.

Reality: Two evaluation experts could come up with two completely different ways to evaluate something, and both work well. Ultimately, the best approach is context-specific, flexible, and adapts to the organisation and ongoing work.

——————

Myth: Quantitative research (numbers, figures) is more scientific than qualitative research (words, meanings, experiences)

Reality: These methods are different and give you different things. One is not better than the other. It’s just as easy to make numbers and figures say anything you like, as well as misinterpreting someone’s experiences. Both require care.

——————

Myth: You do evaluation at the end.

Reality: My number one pet peeve! You need to plan your evaluation from the very start of your work. If you think about it after the event, it’s too late. How can you measure change if it is too late to measure where you started?!

The OfS have a key resource for evaluation, laying out what they describe as their ‘standards of evidence’: OfS resources here.

One of the biggest guides for doing evaluation in the Higher Education sector is TASO. Absolutely worth a look: TASO resources here.

Advance HE have a knowledge hub that might be worth looking for, offering tools and examples of good practice: AdvanceHE resources here.

A personal favourite for me is the Evaluation Collective. This is made up of staff across the HE sector who have to actually DO evaluation. So their knowledge is based on practical experience. Evaluation Collective resources here.