14 May, Agenda
09.45 Chair’s Opening Remarks
Charlotte Weinberg, Executive Director,
CHARITY INNOVATION CASE STUDY
10.00 What To Measure And How: The Creation Of TheHorseCourse Star
To kick-start the day, Harriet Laurie, CEO of TheHorseCourse – an equine-assisted behaviour programme delivered in prisons and other settings in the UK – will share the theory behind the creation of the inspired TheHorseCourse Star. This is the process of deciding what outcomes to measure when you are running an innovative programme. During this groundbreaking case study keynote, Harriet will also explore how TheHourseCourse embedded this process into their workflow and made the best use of it in their ongoing monitoring and evaluation.
Harriet Laurie, CEO,
QUICK-FIRE CASE STUDIES AND Q&A
10.30 Going Beyond Standardised Tools: Creative Ways Of Collecting Data To Engage Your End-Users
Data, Data, Data! Sounds so exciting right? Well yes! Collecting data from your service-users should be one of the most interesting, creative and rewarding parts of the evaluation process. With the abundance of measurement tools now available, the real question is, how can you collect data in a way that will really engage your beneficiaries, encouraging better response rates and in turn more meaningful results? These punchy case studies will explore new and innovative data collection methodologies, that go beyond the standard questionnaires and surveys.
Step away from the evaluation form!
Daniel will present more creative approaches to collecting and analysing data from your service users that will get away from the mind bendingly dull, deeply soul crushing, and profoundly unnecessary pain of the ‘evaluation form’.
Daniel Robinson, Development Researcher,
Describing the Journey of Change
Tom will share his experience developing and using data collection methods to engage service users and recognise their achievements through robust qualitative and quantitative approaches. He believes it is time to stop ticking boxes and begin to capture the individual stories and experiences of the people we work with.
Tom Currie, Impact Manager,
Leap Confronting Conflict
Extended Q&A With Case Study Speakers
Take this opportunity to pose your questions to our case study representatives
11.15 Morning Break And Networking
11.35 Measuring The Immeasurable
Informal learning contributes hugely to social inclusion yet the contribution of voluntary organisations is undervalued in the pursuit of hard outcomes. The SOUL (Soft Outcomes, Universal Learning) Research Project, initiated by Norfolk Voluntary Services working with City College Norwich, set out to identify and group soft outcomes. This session reviews the journey taken by five charities seeking to measure the immeasurable.
Sarah Jennings, ProjectFirst Manager,
TEN Group City College Norwich
QUICK-FIRE CASE STUDIES AND INTERACTIVE KNOWLEDGE-SHARE
11.50 Measuring Your Hard-To-Measure Outcomes
This session aims to tackle the challenges associated with measuring the impact of services that provide:
Support to hard to reach access groups
Support to people with complex needs
Services that are confidential or anonymous
Through three inspiring case studies from charities working in different sectors, with different beneficiaries, you will discover the key to their success when measuring and evaluating outcomes which are inherently difficult to quantify.
International Development Charity:
Barnaby Peacocke, Programme Support Director,
Sophie Laws, Assistant Director for Evaluation and Impact,
Social Welfare Charity:
Lucy Dean, Research Manager,
Rehabilitation for Addicted Prisoners Trust
12.35 Putting The Theory Into Practice: In-Depth Roundtable Discussions According To Charity Type
This is your chance to engage in in-depth discussions with like-minded peers and share innovative ideas on how to measure and evaluate your hard-to-measure outcomes. You will have the option to choose the most relevant discussion group for your charity from the following six categories:
Each group will discuss the following questions:
What outcomes are you finding a challenge to measure?
What methodologies and tools can you develop to evidence these outcomes?
How can you evaluate and report this data in a valuable way?
14.00 Tailor Your Day: Choose Workshop A, B or C
(A) The Execution And Delivery Of Randomised Controlled Trials
Randomised controlled trials (RCTs) can be an extremely effective way of telling if a social policy intervention does or doesn't work. However, in reality RCTs are tough and often very costly, so they need to be seen as part of a longer-term evaluation strategy to move an intervention from innovation to proven impact. Matt Barnard, evaluation expert at the NSPCC will take you through a real example of the successful execution of a randomised control trial and will explore:
When RCTs are appropriate for your charity and when they are not
The costs vs. the benefits: is it a worthwhile investment for your charity?
The strengths vs. the weaknesses: methodological approaches and options to overcome some of the limitations of RCTs
The scope beyond RCTs: is there a comparable alternative?
Matt Barnard, Head of Evaluation,
(B) Developing And Utilising Your Theory Of Change
During this practical session Richie Alford, Director of Research and Impact at Send a Cow will provide you with an in-depth guide to developing your theory of change, understanding how it can improve your planning and evaluation, and the key steps to becoming an impact driven organisation.
Understand how your activities lead to your target outcomes
Are you measuring the right outcomes?
What are your ‘priority outcomes’?
What do you need to design for external stakeholders vs. your own management of your impact?
Best-practice on how theory of change can inspire and support innovation and improvement in programmes
Richie Alford, Director of Research and Impact,
Send a Cow
(C) A Step-By-Step Guide To Measuring Advocacy
There are numerous challenges inherent in evaluating advocacy, policy and campaigning work. Given that advocacy is often a long-term effort which involves many actors, how can you develop an M&E approach that recognises the unique, collaborative and complex nature of advocacy work? During this informative session, CEO and Service Manager at advocacy service-providers Ceartas, take you through the key steps to overcoming these challenges.
What elements of your advocacy strategy should you be measuring?
Build your advocacy measurement toolkit:
- How do you determine what data collection tools you should be using for effective measurement?
- What new, less conventional methods have been developed for advocacy evaluation?
Best-practice on how to effectively communicate your findings
Do the typically rigorous methodologies within M&E have a place in measuring advocacy?
Gordon Thomson, CEO,
Sharon Bairden, Services Manager,
14.40 The Attribution Debate: Is There A Tendency For Charities To Overclaim Due To Donor Pressure?
This exclusive session brings together measurement and evaluation professionals from charities, with the donors, to debate the perennial issue faced by most charities today -
how do you accurately attribute positive change back to your intervention and make sure you are not overclaiming on your impact?
Hear the charity perspective: What do you refer to when asked about impact? What tools and techniques are available to help understand attribution? Can you strike a balance between responding to donor demand without making overly grandiose claims?
Hear the donor perspective: Is there an increasing pressure on charities to overclaim? What are their expectations from charities reporting their impact? Is it more realistic to look at ways to show how activity
to eventual impact vs. trying to
And most importantly...what is the way forward?
Michele Sanders, Head of Risk and Due Diligence,
Stephen Porter, Results and Evaluation Advisor,
Department for International Development
Alex Christopoulos, Insight Manager,
Antonio Capillo, International Grants M&E Manager,
Kat Harrison, Director of Research and Impact,
David Hounsell, Evidence and Impact Director,
The Children’s Society
15.30 Afternoon Break And Networking
BIG QUESTIONS LIVE PANEL
15.50 What Do Funders Want?
Hear it directly from the horse’s mouth. Pose your burning questions to our varied panel of funders and find out:
What are corporates looking for?
What funders want to see from charities reporting their outcomes
What emphasis they place on qualitative vs. quantitative data: should you focus on one more than the other?
Whether funders want to know about failed activities too
What the upcoming trends are that funders will want to incorporate into funding
The winning formula behind securing corporate partnerships
How should you approach them and pitch to them effectively
What role should metrics/tangible outcomes play here?