Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027

Project number: 2030206

- Online Course -

Date & pricing

21/10/2020 - 27/10/2020
Register before: 16/10/2020

€ 900,00 per attendee

€ 810,00 for EIPA members*

Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027

From:  810,00

This is an online course over 4 mornings. The first day deals with monitoring tasks, indicators and the Performance Framework. Days 2-4 examine how to conduct “evaluations during the programming period”. A leading evaluation consultant-economist will focus on the two recommended evaluation methods – theory-based and counterfactual evaluations

Registration for this course is closed. Do you want to receive updates about the next editions of this course? Please subscribe to our newsletter.

About this online course

Member States are now conducting evaluations of their EU Structural and Cohesion Funds projects and programmes. Have they collected the best monitoring data and do they know how to measure impacts? Which evaluation method should be used – theory-based or counter-factual? As new programmes for 2021-2027 are now being prepared and negotiated, are we clear about what the draft New Regulations say about monitoring and evaluation requirements? How do you implement the new agreed recommended indicators for measuring co-financed Covid-19 response activities?

This is an online course over 4 mornings:

  • Day 1 deals with monitoring tasks, indicators and the Performance Framework. A Czech Ministry official will assess the lessons learnt from 2014-2020 and the implications of the new requirements for 2021-2027.
  • Days 2-4: we examine how to conduct “evaluations during the programming period”. A leading evaluation consultant-economist will focus on the two recommended evaluation methods – theory-based and counterfactual evaluations – and the choices for project / programme evaluations on the ground. We will also describe how to complete an ex post cost-benefit analysis (ex post CBA) for infrastructure and other larger

A European Commission official will describe what progress has been made on impact evaluations in 2014-2020 and explain the rationale for the proposed changes in 2021-2027.

You will also learn how to manage evaluation studies, including preparation of the Terms of Reference, aspects of fieldwork, and typical live issues for your current / planned evaluations.

Break-out groups, mini-workshops and exercises will be used to develop simulations of essential elements of evaluation and monitoring to provide a clear view of good practice in the key disciplines involved.

You are invited to send us your problems, issues and questions before the online course, if you wish. We will do our best to address the problems / answer the questions during the online course!

Who will benefit most?

  • officials from central, regional and local government, programme officers and managers, involved with the implementation and evaluation of Structural and Cohesion Fund projects and programmes
  • project managers and developers
  • economic and social partners involved in Structural Funds and evaluation activities, such as NGOs, higher education establishments, and consultants.

What you will learn in this online course

At the end of the online course, participants should have:

  • a clear understanding of all the evaluation and monitoring requirements for current and future programmes; and
  • a quick general tool kit for undertaking impact evaluations of projects and programmes
Robin Smail

Robin Smail

Robin Smail Training & Consultancy
EU Structural Funds

Practical information

Online Course
For this online course we make use of Zoom

Programme Organiser
Ms Nancy Vermeulen
Tel: +31 43 32 96 212
n.vermeulen@eipa.eu

Discounts
EIPA offers a discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?
Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden, United Kingdom.

For all other participants, the regular fee applies.

Confirmation
Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment
Prior payment is a condition for participation.

Cancellation policy
For administrative reasons you will be charged € 50 for cancellations received within 7 days before the activity begins. There is no charge for qualified substitute participants.

 EIPA reserves the right to cancel the activity up to 1 week before the starting date. In that case, registration fees received will be fully reimbursed.

I have a question

Course > I have a Question

The programme

08.30 Opening of ZOOM platform and gathering of participants
Technical check for some tasks
09.00 Opening of the online course and meeting the participants: introduction to the objectives and methodology of the online course

  • The new MFF, the new draft Regulations (2021-2027)
  • Emergency amending regulations (2014-2020)

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands

09.15 Monitoring and reporting project and programme progress in 2014-2020 and 2021-2027

  • Programme cycle, key monitoring tasks, data requirements and challenges
  • Indicators, intervention logic, result-orientation, understanding the impact chain
  • The Performance Framework – old and new
  • Reporting in 2014-2020 and 2021-2027: moving to real-time reporting

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

09.55 DISCUSSION: problems with the Performance Framework, Indicators and data collection
10.10 Monitoring and reporting project and programme progress in 2014-2020 and 2021-2027 (continued)

  • The new OP template – baselines and setting targets
  • the Reporting template – measuring progress
  • Fund Regulation Annexes – common indicators

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.30 Virtual Coffee and meeting each other: Tour de Table
11.00 Workshop break-out groups and feedback: indicators by sector

  • What are we measuring? Programme-specific indicators by sector
  • Issues for indicators

Robin Smail

11.30 Management Challenges for Monitoring and Data collection/usage

  • lessons learned: data collection, MIS, interpreting data for the AIR
  • Performance Framework challenges, measuring progress
  • programme amendments
  • preparing for 2021-2027
  • Q&A

Ing. Helena Viktorie Barbořáková, Managing Authority, Operational Programme – Research, Development and Education, Ministry of Education, Youth and Sport, Czech Republic

12.25 Short break
12.35 Is ESF achieving results?

  • ESF data requirements on participants; eligibility issues
  • ESF data collection for outputs, results; common indicators, programme-specific indicators
  • Monitoring data and evidence of results in ESF; evaluation challenges
  • Prospects for ESF in 2021-2027

Marco Lopriore

13.00 Discussion: measuring ESF results
13.20 End of first day
08.45 Gathering of participants on ZOOM platform
09.00 Review of day 1
09.10 Evaluation and measuring impact, 2014-2020

  • the purpose of evaluation – criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation methods, techniques
  • evaluation and monitoring requirements, 2021-2027

Robin Smail

10.00 Breakout groups – exercise – evaluation questions
10.30 Coffee break and meeting our Evaluation Expert
11.00 Evaluation in the context of Programme Management

  • Evaluation and its neighbourhood (discussion)
  • Evaluation types and purposes
  • Evaluation stakeholders
  • Evaluation of projects and evaluation of programmes
  • Evaluation Plans and their challenges – The Czech experience
  • Internal, external and mixed team evaluations

Dr. Vladimir Kváča, Consultant, former Director-General, Ministry of Labour and Social Affairs, Prague (CZ), and former President of the Czech Evaluation Society

12.00 Short break
12.05 Workshop: Managing evaluation studies, part 1:

  • the intervention to be evaluated,
  • the purpose of evaluation
  • evaluation stakeholders

Vladimir Kváča

12.35 Evaluation questions

  • Three kinds of evaluation questions (descriptive, normative, causal)
  • Divergent and convergent phase of questions formulation
  • Asking the right questions; methods

Vladimir Kváča

13.00 Workshop: Managing evaluation studies, part 2:

  • Asking the right questions; methods

Vladimir Kváča

13.30 End of day 2
08.45 Opening of Platform, gathering of participants
09.00 Review of days 1 & 2
09.05 Choice of methods and techniques: theory-based and counter-factual evaluations

  • What limits the choice of methods?
  • Theory-based evaluations – an overview of some methods: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case studies
  • Q&A

Vladimir Kváča

10.05 Short Break
10.10 Workshop break-out groups: Managing evaluation studies, part 3:

  • Theory of change /Causal mechanism
  • Testing the theory

Vladimir Kváča

10.50 Virtual Coffee Break
11.10 Exercises with revenue-generating projects

  • Evaluating Major Projects; Major projects application form
  • Revenue-generating projects
  • Calculating the grant for revenue-generating projects

Robin Smail

11.40 Counterfactual Evaluations

  • Understanding bias and importance of randomization
  • A quick inventory of counter-factual methods
  • Working with Difference-in-Difference; Propensity Score Matching
  • (Hidden) Assumptions
  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions
  • Q&A

Vladimír Kváča

12.45 Workshop break-out groups: Counterfactual Evaluations (Part 1 – questions)

  • Choice of three levels:
    • Maths class
    • Antiviolence therapy
    • Enterprise support

Vladimír Kváča

13.30 End of third day
09.00 Workshop break-out groups: Counterfactual Evaluations (Part 2 – answers and feedback)

  • Choice of three levels:
    • Maths class
    • Antiviolence therapy
    • Enterprise support

Vladimír Kváča

09.30 Preparing for and Managing Evaluation Studies

  • Managing evaluations, stages of evaluation
  • Preparing for studies
  • The Call for Proposal, Terms of Reference
  • Selection and award criteria

Vladimir Kváča

10.15 Short break
10.25 Break-out groups and feedback: selection criteria
10.40 Preparing for and Managing Evaluation Studies (continued)

  • Deliverables
  • Using the evaluation results

Vladimir Kváča

11.00 Virtual Coffee break – Meet the speaker from the European Commission
11.20 Impact Evaluations in 2014-2020 and proposed changes for 2021-2027

David Alba, Evaluation Unit, DG Regional and Urban Policy, European Commission

12.00 Short Break
12.05 Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis
  • Counting jobs

Robin Smail

13.05 Course conclusions, evaluation feedback
13.15 Close of the online course