Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027

Project number: 2030206

Rezidence Dlouhá 17 - to be confirmed, Prague (CZ)

Request brochure

Date & pricing

21/10/2020 - 23/10/2020
Register before: 01/10/2020

€ 1.550,00 per attendee

€ 1.395,00 for EIPA members*

Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027

From:  1.395,00

The first part of this 3-day course deals with monitoring tasks, indicators and the Performance Framework. The second part examines how to conduct “evaluations during the programming period”. Senior evaluation consultant-economists with vast programme experience will focus on the two recommended evaluation methods.

Watch project leader Marco Lopriore explain how Cohesion Policy helps respond to the COVID health crisis in his recent video series.

About this seminar

Member States are now conducting evaluations of their EU Structural and Cohesion Funds projects and programmes. Have they collected the best monitoring data and do they know how to measure impacts? Which evaluation method should be used – theory-based or counter-factual? As new programmes for 2021-2027 are now being prepared and negotiated, are we clear about what the draft New Regulations say about monitoring and evaluation requirements?

This 3-day seminar has two stages:

  • Stage 1 (Day 1) deals with monitoring tasks, indicators and the Performance Framework. A Czech Ministry official will assess the practical challenges of 2014-2020 and the implications of the new requirements for 2021-2027.
  • Stage 2 (Days 2 & 3) examines how to conduct “evaluations during the programming period”. Leading evaluation consultant-economists will focus on the two recommended evaluation methods – theory-based and counterfactual evaluations – and the choices for project / programme evaluations on the ground. We will also describe how to complete an ex post cost-benefit analysis (ex post CBA) for infrastructure and other large projects.
  • You will also learn how to manage evaluation studies, including preparation of the Terms of Reference, aspects of fieldwork, and typical live issues for your current / planned evaluations.

What you will learn in this course

At the end of the seminar, participants should have:

  • a clear understanding of all the evaluation and monitoring requirements for current and future programmes; and
  • a quick general tool kit for undertaking impact evaluations for projects and programmes

Mini-workshops and exercises are used both to develop simulations of essential elements of evaluation and monitoring to provide a clear view of good practice in the key disciplines involved.

You are invited to send us your problems, issues and questions before the seminar, if you wish.  We will do our best to address the problems / answer the questions during the seminar!

Who will benefit most?

  • officials from central, regional and local government, programme officers and managers, involved with the implementation and evaluation of Structural and Cohesion Fund projects and programmes in 2014-2020 and in 2021-2027
  • project managers and developers
  • economic and social partners involved in Structural Funds and evaluation activities, such as NGOs, higher education establishments, and consultants.
Robin Smail

Robin Smail

Robin Smail Training & Consultancy
EU Structural Funds

Practical information

Course venue – to be confirmed
Rezidence Dlouhá 17
Dlouhá 17
110 00 Prague
Prague (CZ)

Programme Organiser
Ms Nancy Vermeulen
Tel: +31 43 32 96 212
n.vermeulen@eipa.eu

Fee
The fee includes documentation and refreshments, three lunches and a reception. Accommodation and travel costs are at the expense of the participants or their administration.

Discounts
EIPA offers a 10% discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?
Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden, United Kingdom.

For all other participants, the regular fee applies.

Meals
Lunches, the reception or dinner will be served at a restaurant in town. Special dietary requirements (e.g. vegetarian, diabetic) can be indicated once you receive the confirmation of the seminar.

Confirmation
Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment
Prior payment is a condition for participation.

Cancellation policy
For administrative reasons you will be charged €150 for cancellations received within 15 days before the activity begins. There is no charge for qualified substitute participants.

EIPA reserves the right to cancel the activity up to 2 weeks before the starting date. In that case, registration fees received will be fully reimbursed. EIPA accepts no responsibility for any costs incurred (travel, accommodation, etc.). 

The programme

DAY 1
Seminar Stage 1: Monitoring, indicators and the Performance Framework
08.45 Registration of participants
09.00 Opening of the seminar and meeting the participants: introduction to the objectives and methodology of the seminar
Marco Lopriore, Expert, EIPA, Maastricht, Netherlands
09.30 Monitoring and reporting project and programme progress in 2014-2020 and 2021-2027

  • Programme cycle, key monitoring tasks, data requirements and challenges
  • Indicators, intervention logic, result-orientation, understanding the impact chain
  • The Performance Framework – old and new
  • Reporting in 2014-2020 and 2021-2027: moving to real-time reporting
  • The new OP template

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.45 Coffee break
11.15 Workshop and discussion: indicators by sector

  • What are we measuring?
  • Programme-specific indicators by sector
  • Fund Regulation Annexes – common indicators

Robin Smail

12.15 Management Challenges for Member States in collecting and managing data

  • lessons learned from the first years of implementation
  • data collection, MIS, interpreting data for the AIR
  • problems for the PF, measuring progress

Ing. Helena Viktorie Barbořáková, Managing Authority, Operational Programme – Research, Development and Education, Ministry of Education, Youth and Sport, Czech Republic

13.00 Lunch break
14.30 Management Challenges for Member States in collecting and managing data (contd).

  • programme amendments
  • proposals for 2021-2027

Ing. Helena Viktorie Barbořáková

15.15 The new Performance Framework and Reporting

  • the OP template – baselines and setting targets
  • the Reporting template – measuring progress
  • setting targets for the Performance Framework

Robin Smail

15.50 Coffee break
16.15 Is ESF achieving results?

  • ESF data requirements on participants; eligibility issues
  • ESF data collection for outputs, results; common indicators, programme-specific indicators
  • Monitoring data and evidence of results in ESF; evaluation challenges
  • Prospects for ESF in 2021-2027

Marco Lopriore

17.00 Case study with Performance Framework

  • should we use unit-cost benchmarks?
  • Are the indicators adequate?
  • Benchmarks exercise

Robin Smail

17.45 End of first day
DAYS 2 & 3
Seminar Stage 2: Evaluations during the programming period
08.45 Registration of participants
09.00 Opening of stage 2 seminar: introduction, objectives and methodology of the seminar
Marco Lopriore, Expert, EIPA, Maastricht, Netherlands
09.10 Evaluation and measuring impact, 2014-2020

  • the purpose of evaluation – criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation methods, techniques
  • evaluation and monitoring requirements, 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.20 Exercise: evaluation questions – by sector
Robin Smail
10.45 Coffee break
11.15 Exercise: evaluation questions – by sector (contd).
Robin Smail
11.45 Evaluation in the context of Programme Management

  • Evaluation and its neighbourhood (discussion)
  • Evaluation types and purposes
  • Evaluation stakeholders
  • Evaluation of projects and evaluation of programmes
  • Evaluation Plans and their challenges – The Czech experience
  • Internal, external and mixed team evaluations

Dr. Vladimir Kváča, former Director-General, Ministry of Labour and Social Affairs, Prague (CZ), and former President of the Czech Evaluation Society

13.00 Lunch break
14.15 Workshop:  Managing evaluation studies, part 1:

  • the intervention to be evaluated,
  • the purpose of evaluation
  • evaluation stakeholders

Jan Hněvkovský Director, Consultancy Company GovLab.cz, Prague

14.45 Evaluation questions

  • Three kinds of evaluation questions (descriptive, normative, causal)
  • Divergent and convergent phase of questions formulation

Jan Hněvkovský

15.10 Workshop: Managing evaluation studies, part 2:

  • Asking the right questions; methods

Jan Hněvkovský

15.40 Coffee break
16.00 Choice of methods and techniques: theory-based and counter-factual evaluations

  • What limits the choice of methods?
  • Theory-based evaluations – an overview of some methods: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case studies

Vladimir Kváča

17.15 Workshop: Managing evaluation studies, part 3:

  • Theory of change /Causal mechanism
  • Testing the theory

Vladimir Kváča

18.00 End of second day
18.30 Reception
09.15 Counterfactual Evaluations

  • Understanding bias and importance of randomization
  • A quick inventory of counter-factual methods
  • Working with Difference-in-Difference; Propensity Score Matching
  • (Hidden) Assumptions
  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions

Jan Hněvkovský

10.30 Workshop: Counterfactual Evaluations

  • Choice of three levels:
    • Maths class
    • Antiviolence therapy
    • Enterprise support

Vladimír Kváča

11.10 Coffee break
11.30 Preparing for and Managing Evaluation Studies

  • Managing evaluations, stages of evaluation
  • Preparing for studies
  • The Call for Proposal, Terms of Reference
  • Selection and award criteria
  • Deliverables
  • Using the evaluation results

Vladimir Kváča

13.00 Lunch break
14.15 WORKSHOP: assessing risk in projects
14.35 Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis
  • Case study

Robin Smail

15.25 Coffee break
15.45 Exercises with revenue-generating projects

  • Major project application forms
  • Calculating the grant for revenue-generating projects

Robin Smail

16.25 Seminar conclusions, evaluation feedback
16.30 Close of seminar