Capacity Building in Impact Evaluation Counterfactual and Theory Based Approaches

30/11/2017 - 01/12/2017
Location: Barcelona (ES)
Project number: 1760602

Capacity Building in Impact Evaluation Counterfactual and Theory Based Approaches

From:  900,00

This training course will increase your ability to commission, design, manage and monitor the evaluations – funded with or without EU funds – conducted by your organisation.
You will get to understand the basics of certain tools and approaches and you will be able to consider the advantages and disadvantages that justify the use of some above others. Consequently, you will have all the knowledge necessary to design briefs for (internal or external) evaluators, interact with them competently and assess the quality of their work.

This training course will increase your ability to commission, design, manage and monitor the evaluations – funded with or without EU funds – conducted by your organisation. You will get to understand the basics of certain tools and approaches and you will be able to consider the advantages and disadvantages that justify the use of some above others. Consequently, you will have all the knowledge necessary to design briefs for (internal or external) evaluators, interact with them competently and assess the quality of their work. In particular, the course should help you understand the two most prominent approaches to evaluation today: counterfactual (also known as experimental or quasi-experimental) approaches, and theory-based approaches. The seminar will demonstrate in practical terms what counterfactual approaches can and cannot do and the conditions in which they can be used. It will also show how theory-based approaches can provide a good alternative when such conditions are not met and discuss ways in which the two approaches can be combined.

How will it help you?
Does your organisation have qualified experts who are willing and able to design, manage and monitor evaluation activities? Will you be able to ensure high quality evaluation? Will evaluation results really provide evidence for decision-making and improve policies and programmes? In recent years, both contracting authorities and practitioners have been learning and growing together. The EU Member States have launched and implemented evaluation capacity-building projects and today we can say that most of them have a well-developed evaluation culture. However, many challenges remain: we must still build capacity at all levels, ensure better dissemination of evaluation results and generate buy-in for the benefits of evaluation and integrate evaluation better into the policy and programming cycle so that it is actually used.The course helps to build capacity by offering an overview of policy, programme and project evaluation. You gain a deeper understanding of two families of evaluation approaches and, through the use of practical examples, improve your skills in the design and monitoring of evaluations. As part of this, you receive coaching and advice from our experts on your own evaluation projects and challenges.

Who will benefit most?
This course is aimed at public officials from EU Member States, candidate countries, EU institutions and Agencies, Managing Authorities, auditors, consultants, staff of NGOs, and other stakeholders involved in the management of evaluation procedures for policies, programmes and projects. You could be working with or without European Funds.

THURSDAY 30 NOVEMBER 2017
 
09.00 Registration
   
09.15 Introduction to the seminar: presentation of the methodology to be followed ‘Tour de table’ – participants and experts present themselves
Gracia Vara Arribas, Expert, Project Leader, EIPA Barcelona (ES)
   
09.30 Needs assessment of the audience – evaluation on knowledge level
   
I. What is an evaluation and how to manage it
Gracia Vara Arribas
   
10.00 Strengthening the impact evaluation culture in the European Union – the lessons from the European Commission
   
10.30 Coffee break
   
II. Introduction to theory-based evaluation approaches and how to use them in practice
Bradford Rohmer, Senior Analyst, Oxford Research
   
11.00 Different evaluation approaches and their practical use
All evaluations should be systematic, objective and evidence-based. But in other respects they differ depending on the issues and problems at hand. This session gives an overview of different evaluation approaches, their key features and how and why to use them. The discussion revolves around real-life examples to show the strengths and weaknesses of various evaluation approaches and ways to design and apply them in practice.
   
13.00 Lunch break
   
14.30 Theory-based evaluation: What is it, how does it work, and how can it be used to evaluate impact?
Theory-based evaluation (TBE) is versatile but is only useful insomuch as it is tailored to the intervention in question. This session runs through the different approaches to TBE (e.g. realist evaluation, contribution analysis, qualitative comparative analysis), the circumstances they are suited to and tools used to employ them. Again, the focus is on practical examples that participants can apply as commissioners or practitioners of evaluations.
   
15.30 Practical Session 1: a practical example of a theory-based evaluation
   
17.00 End of the first day
   
20.00 Welcome dinner
   
   
FRIDAY 1 DECEMBER 2017
   
III. Introduction to counterfactual evaluation approaches and how to use them in practice
Stephen Morris, Professor of Evaluation, PERU, Manchester Metropolitan University
   
09.30 Counterfactual approaches to causation
Early on in the process of designing an evaluation you will need to consider how a counterfactual will be identified and estimated. This session will show you that once having identified a potential counterfactual you will then need to consider how you will measure counterfactual outcomes and possible collect control data from them. This will set ground for the next session of the programme.
   
10.30 Randomised Controlled Trials (RCTs) as a way of identifying counterfactuals
A randomised controlled trial is an evaluation methodology which aims to draw an objective picture of the difference that a project, programme or policy makes by comparing its effect on separate groups. There is a real need to gain a clearer understanding of who requests and uses RCTs, and this session will provide that knowledge.
   
11.30 Coffee break
   
12.00 Practical Session 2: designing an experiment
Participants design an experiment and solve problems from a Commissioner´s perspective.
   
13:00 Lunch
   
14.30 Quasi-experimental approaches
Overview of quasi-experimental methods and techniques to quantitatively evaluate the impact of an intervention. Using ample examples, the approaches covered include regression, difference-in-differences and matching. ITS and regression discontinuity will also be discussed.
   
15.30 Practical Session 3: using quasi-experimental approaches
Participants discuss the practical application of quasi-experimental approaches, also in cases where randomisation is not possible.
   
16.00 Wrapping up and closing of the seminar

Course venue
Grupotel Gran Via 678
Gran Via de les Corts Catalanes 678
ES – 08010 Barcelona
Tel. +34 93 3417000
www.grupotel.com

Fee
The fee includes documentation, two lunches, a welcome dinner and refreshments. Accommodation and travel costs are at the expense of the participants or their administration.

Discounts
EIPA offers a 10% discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?
Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Spain, Sweden, United Kingdom.

For all other participants, the regular fee applies.

Language
We offer this course with French simultaneous translation, if at least six participants indicate their interest in advance. Please enter your request under ‘additional information’ when registering.

Meals
Lunche(s) will be served at the hotel restaurant and dinner will be held at a restaurant in town. Special dietary requirements (e.g. vegetarian, diabetic) can be indicated once you receive the confirmation of the seminar

Hotel reservations
EIPA is pleased to make reservations for you at the same hotel where the seminar will take place, and where special rates apply for EIPA participants. Should you wish to make use of this possibility, please book directly via the links below. Payment is to be made directly and personally to the hotel upon checking out. Please note that if you register after the deadline, hotel reservations cannot be guaranteed.

Confirmation
Confirmation of registration will be forwarded to participants on receipt of the completed registration form.

Payment
Prior payment is a condition for participation. Please indicate the method of payment on the registration form.

Cancellation policy
For administrative reasons you will be charged €150 for cancellations received within 15 days before the activity begins. There is no charge for qualified substitute participants. EIPA reserves the right to cancel the activity up to 2 weeks before the starting date. In that case, registration fees received will be fully reimbursed. EIPA accepts no responsibility for any costs incurred (travel, accommodation, etc.). The mention of a speaker’s name in the programme does not commit EIPA. In the event that an announced speaker does not appear, EIPA will do its utmost to find a suitable replacement.

Reviews

There are no reviews yet.

Be the first to review “Capacity Building in Impact Evaluation Counterfactual and Theory Based Approaches”

Your email address will not be published. Required fields are marked *