Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027 (2-day Course)

Project number: 19302061

Rezidence Dlouhá 17, Prague (CZ)

Date & pricing

17/10/2019 - 18/10/2019
Register before: 05/10/2019

€ 1.100,00 per attendee

€ 990,00 for EIPA members*

Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027 (2-day Course)

From:  990,00

The 2-day course examines how to conduct “evaluations during the programming period”. We assume participants of the 2-day course are already familiar with Structural Funds monitoring requirements, generating good indicators and using the Performance Framework.

About this course

Member States are now conducting evaluations of their EU Structural and Cohesion Funds programmes. Are the programmes and Funds delivering Value for Money? What is monitoring data telling us and can we expect programmes to achieve their many objectives? How do we measure and understand the impacts? Which evaluation method should be used – theory-based or counter-factual?

This seminar examines these questions and others relating to the evaluation and monitoring of the Structural and Cohesion Funds in 2014-2020 and looks forward to changes for 2021-2027:

  • how to conduct “evaluations during the programming period”. Senior evaluation consultant-economists with vast programme experience will focus on the two recommended evaluation methods – theory-based and counterfactual evaluations – and the challenges for programme evaluations on the ground. We will also describe how to complete an ex post cost-benefit analysis (ex post CBA) for infrastructure and other large projects.
  • You will also learn how to manage evaluation studies, including aspects of fieldwork, and be aware of the typical live issues for your current / planned evaluations
  • We review the evaluation and monitoring requirements for 2014-2020 and describe how these will change for 2021-2027

Please note that this 2-day seminar is also part of a (two stage) 3-day seminar. Day 1 (stage 1) of the 3-day seminar examines in detail: Structural Funds monitoring requirements, generating good indicators and using the Performance Framework. For participants of the 2-day seminar only, we assume you are already familiar with this material.

Who will benefit most?

  • officials from central, regional and local government, programme officers and managers, involved with the implementation and evaluation of Structural and Cohesion Fund projects and programmes in 2014-2020
  • project managers and developers
  • economic and social partners involved in Structural Funds and evaluation activities, such as NGOs, higher education establishments, and consultants.

What you will learn in this course

At the end of the seminar, participants should have a clear understanding of all the urgent evaluation and monitoring requirements associated with current programmes. Participants should also have a quick general tool kit for undertaking impact evaluations for projects and programmes. Mini-workshops and exercises are used both to develop simulations of essential elements of evaluation and monitoring to provide a clear view of good practice in the key disciplines involved.

Participants are invited to send us their problems, issues and questions before the seminar, if they wish.  We will do our best to address the problems / answer the questions during the seminar!

Practical information

Provisional course venue
Rezidence Dlouhá 17
Dlouhá 17
110 00 Praha 1

Programme Organiser
Ms Nancy Vermeulen
Tel: +31 43 32 96 212
n.vermeulen@eipa.eu

Fee
The fee includes documentation and refreshments. Lunches, a reception or dinner are included if mentioned in the programme. Accommodation and travel costs are at the expense of the participants or their administration.

Discounts
EIPA offers a 10% discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?
Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden, United Kingdom.

For all other participants, the regular fee applies.

Meals
Lunches, the reception or dinner will be served at a restaurant in town. Special dietary requirements (e.g. vegetarian, diabetic) can be indicated once you receive the confirmation of the seminar.

Confirmation
Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment
Prior payment is a condition for participation.

Cancellation policy
For administrative reasons you will be charged €150 for cancellations received within 15 days before the activity begins. There is no charge for qualified substitute participants.

EIPA reserves the right to cancel the activity up to 2 weeks before the starting date. In that case, registration fees received will be fully reimbursed. EIPA accepts no responsibility for any costs incurred (travel, accommodation, etc.). 

Expert Robin Smail

Robin Smail

EU Structural Funds - External Expert

Iain Jenkins

Management: appraisal, monitoring and evaluation - External Expert

Vladimir Kvača

Vladimir Kvača

Policy design and evaluation - External Expert

The programme

08.45 Registration of participants
09.00 Opening of stage 2 seminar:introduction, objectives and methodology of the seminar

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands

09.10 Evaluation and measuring impact, 2014-2020 and 2021-2027

  • the purpose of evaluation – criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation questions
  • evaluation methods, techniques
  • evaluation and monitoring requirements, the Performance Framework
  • new evaluation requirements for 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.20 Exercise: evaluation questions – by sector

Robin Smail

11.00 Coffee break
11.30 Evaluation methods, issues and technical concepts

  • Evaluation objectives, scope of evaluations
  • Testing the intervention rationale and logic
  • Assessing quantitative performance: theory-based evaluations, counter-factual evaluations
  • Counter-factual evaluations: randomised control trials, difference in difference, propensity score matching
  • Assessing processes, transferring ownership
  • Theory-based evaluation: logic models, theory of change, causality

Dr Iain Jenkins, Director, EKOS Consultants, Glasgow, United Kingdom

13.00 Lunch break
14.30 Workshop: Theory-based evaluation case study

  • Logic models and theory of change
  • Determining the nature and scope of an evaluation
  • Designing evaluation questionnaires

Dr. Iain Jenkins

16.00 Coffee break
16.30 Czech programme evaluation challenges

  • State of play: Czech programmes evaluation
  • Coordination of evaluation at Partnership agreement, programme and project level
  • Evaluation Plans for Czech programmes
  • Major challenges (procurement of evaluation, data issues)
  • Case-studiy from European Social Fund Social Innovation priority axis

Dr. Vladimir Kváča, former president of the  Czech Evaluation Society, Prague

18.00 End of the day
18.30 Reception
09.15 Some hints for the choice of methods and techniques

  • Choosing methods and techniques
  • Theory-based evaluations: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case-studies

Dr. Vladimir Kváča

10.00 Workshop: Counterfactual Evaluation

  • Understanding bias
  • Sampling
  • Hidden assumptions

Dr. Vladimir Kváča

10.45 Coffee break
11.15 Quick inventory of the  Counterfactual methods

  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions

Dr. Vladimir Kváča

11.45 Conducting thematic evaluations in 2014-2020 and beyond: evaluation plans, preparing for studies, managing studies, using the results

  • Project evaluation plans, preparing for studies
  • The Call for Proposal
  • Managing evaluations, stages of evaluations
  • Issues for evaluations, using the results

Dr. Iain Jenkins

13.15 Lunch break
14.15 Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis

Robin Smail

15.15 Coffee break
15.35 Exercises with revenue-generating projects

  • Major project application forms
  • Calculating the grant for revenue-generating projects

Robin Smail

16.25 Seminar conclusions, evaluation feedback
16.30 Close of seminar
THURSDAY 17 OCTOBER 2019
08.45 Registration of participants
09.00 Opening of stage 2 seminar:introduction, objectives and methodology of the seminar
Marco Lopriore, Expert, EIPA, Maastricht, Netherlands
09.10 Evaluation and measuring impact, 2014-2020 and 2021-2027

  • the purpose of evaluation – criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation questions
  • evaluation methods, techniques
  • evaluation and monitoring requirements, the Performance Framework
  • new evaluation requirements for 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.20 Exercise: evaluation questions – by sector
Robin Smail
11.00 Coffee break
11.30 Evaluation methods, issues and technical concepts

  • Evaluation objectives, scope of evaluations
  • Testing the intervention rationale and logic
  • Assessing quantitative performance: theory-based evaluations, counter-factual evaluations
  • Counter-factual evaluations: randomised control trials, difference in difference, propensity score matching
  • Assessing processes, transferring ownership
  • Theory-based evaluation: logic models, theory of change, causality

Dr Iain Jenkins, Director, EKOS Consultants, Glasgow, United Kingdom

13.00 Lunch break
14.30 Workshop: Theory-based evaluation case study

  • Logic models and theory of change
  • Determining the nature and scope of an evaluation
  • Designing evaluation questionnaires

Dr. Iain Jenkins

16.00 Coffee break
16.30 Czech programme evaluation challenges

  • State of play: Czech programmes evaluation
  • Coordination of evaluation at Partnership agreement, programme and project level
  • Evaluation Plans for Czech programmes
  • Major challenges (procurement of evaluation, data issues)
  • Case-studiy from European Social Fund Social Innovation priority axis

Dr. Vladimir Kváča, former president of the  Czech Evaluation Society, Prague

18.00 End of the day
18.30 Reception
FRIDAY 18 OCTOBER 2019
09.15 Some hints for the choice of methods and techniques

  • Choosing methods and techniques
  • Theory-based evaluations: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case-studies

Dr. Vladimir Kváča

10.00 Workshop: Counterfactual Evaluation

  • Understanding bias
  • Sampling
  • Hidden assumptions

Dr. Vladimir Kváča

10.45 Coffee break
11.15 Quick inventory of the  Counterfactual methods

  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions

Dr. Vladimir Kváča

11.45 Conducting thematic evaluations in 2014-2020 and beyond: evaluation plans, preparing for studies, managing studies, using the results

  • Project evaluation plans, preparing for studies
  • The Call for Proposal
  • Managing evaluations, stages of evaluations
  • Issues for evaluations, using the results

Dr. Iain Jenkins

13.15 Lunch break
14.15 Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis

Robin Smail

15.15 Coffee break
15.35 Exercises with revenue-generating projects

  • Major project application forms
  • Calculating the grant for revenue-generating projects

Robin Smail

16.25 Seminar conclusions, evaluation feedback
16.30 Close of seminar

Provisional course venue
Rezidence Dlouhá 17
Dlouhá 17
110 00 Praha 1

Programme Organiser
Ms Nancy Vermeulen
Tel: +31 43 32 96 212
n.vermeulen@eipa.eu

Fee
The fee includes documentation and refreshments. Lunches, a reception or dinner are included if mentioned in the programme. Accommodation and travel costs are at the expense of the participants or their administration.

Discounts
EIPA offers a 10% discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?
Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden, United Kingdom.

For all other participants, the regular fee applies.

Meals
Lunches, the reception or dinner will be served at a restaurant in town. Special dietary requirements (e.g. vegetarian, diabetic) can be indicated once you receive the confirmation of the seminar.

Confirmation
Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment
Prior payment is a condition for participation.

Cancellation policy
For administrative reasons you will be charged €150 for cancellations received within 15 days before the activity begins. There is no charge for qualified substitute participants.

EIPA reserves the right to cancel the activity up to 2 weeks before the starting date. In that case, registration fees received will be fully reimbursed. EIPA accepts no responsibility for any costs incurred (travel, accommodation, etc.).