Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027

Project number: 2130204

- Online Course -

Request brochure

Date & pricing

05/05/2021 - 12/05/2021
Register before: 30/04/2021

€ 1.100,00 per attendee

€ 990,00 for EIPA members*

Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027

From:  990,00

This is an online course over 5 days. Days 1 and 2 deal with monitoring tasks, indicators and the Performance Framework. Days 2-5 examine how to conduct “evaluations during the programming period”

About this online course

Member States continue to conduct evaluations of their 2014-2020 EU Structural and Cohesion Funds projects and programmes. Have they collected the best monitoring data and do they know how to measure impacts? Which evaluation method should be used – theory-based or counter-factual? As new programmes for 2021-2027 are now being agreed and implemented, are we clear about what the New Regulations say about monitoring and evaluation requirements?

This is a webinar over 5 days (mornings and afternoons):

  • Days 1 & 2 deal with monitoring tasks, indicators and the Performance Framework. A Czech Ministry official will assess the lessons learnt from 2014-2020 and the implications of the new requirements for 2021-2027.
  • Days 2-5: we examine how to conduct “evaluations during the programming period”. A leading evaluation consultant-economist will focus on the two broad recommended evaluation methods – theory-based and counterfactual evaluations – and the choices for project / programme evaluations on the ground.

We will also describe how to complete an ex post cost-benefit analysis (ex post CBA) for infrastructure and other larger projects.

A European Commission official will describe what progress has been made on impact evaluations in 2014-2020 and explain what is expected in the 2021-2027 EU Structural and Cohesion Funds programmes.

You will also learn how to manage evaluation studies, including preparation of the Terms of Reference, aspects of fieldwork, and typical live issues for your current / planned evaluations.

How will it help you?

At the end of the seminar, participants should have:

  • a clear understanding of all the evaluation and monitoring requirements for current and future programmes; and
  • a quick general tool kit for undertaking impact evaluations of projects and programmes

Break-out groups, mini-workshops, exercises and videos will be used to develop simulations of essential elements of evaluation and monitoring to provide a clear view of good practice in the key disciplines involved.

A modest element of home-learning will be included in the seminar, to take place between the teaching days: links to exciting technical videos will be provided, which participants can watch in their own time.

Target group

  • officials from central, regional and local government, programme officers and managers, involved with the implementation and evaluation of Structural and Cohesion Fund projects and programmes
  • project managers and developers
  • economic and social partners involved in Structural Funds and evaluation activities, such as NGOs, higher education establishments, and consultants.
Robin Smail

Robin Smail

Robin Smail Training & Consultancy
EU Structural Funds

Vladimir Kvača

Vladimir Kvača

Charles University, Prague
Policy design and evaluation

Helena Viktorie Barbořáková

Helena Viktorie Barbořáková

Ministry of Education, Youth and Sport, Czech Republic
Managing Authority, Operational Programme - Research, Development and Education

Practical information

Online Course
For this online course we make use of Zoom

Remote simultaneous interpretation
Remote simultaneous interpretation can be offered in Spanish, French and Italian on request. Contact the Programme Organiser for more information and conditions

Programme Organiser
Ms Nancy Vermeulen
Tel: +31 43 32 96 212
n.vermeulen@eipa.eu

Discounts
EIPA offers a discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?
Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden.

For all other participants, the regular fee applies.

Confirmation
Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment
Prior payment is a condition for participation.

Cancellation policy
For administrative reasons you will be charged € 50 for cancellations received within 7 days before the activity begins. There is no charge for qualified substitute participants.

 EIPA reserves the right to cancel the activity up to 1 week before the starting date. In that case, registration fees received will be fully reimbursed.

I have a question

Course > I have a Question

The programme

DAY 1
Monitoring, indicators and the Performance Framework
08.45 Opening of ZOOM platform and gathering of participants
09.00 Opening of the seminar and meeting the participants: introduction to the objectives and methodology of the seminar

  • CRII and CRII+ emergency amending regulations (2014-2020), REACT-EU
  • The new MFF, the new draft Regulations (2021-2027), Recovery and Resilience Fund (RRF)

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands

09.25 Meeting each other: Tour de Table
09.40 Monitoring and reporting project and programme progress in 2014-2020 and 2021-2027

  • Programme cycle, key monitoring tasks, data requirements and challenges
  • Indicators, intervention logic, result-orientation, understanding the impact chain
  • The Performance Framework – old and new
  • Reporting in 2014-2020 and 2021-2027: moving to real-time reporting

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.30 Virtual Coffee Break
10.50 Monitoring and reporting project and programme progress in 2014-2020 and 2021-2027 (continued)

  • The new OP template – baselines and setting targets
  • the Reporting template – measuring progress
  • Fund Regulation Annexes – common indicators

Robin Smail

11.10 Workshop break-out groups and feedback: indicators by sector

  • What are we measuring? Programme-specific indicators by sector
  • Issues for indicators

Robin Smail

11.50 Short break
12.00 Management Challenges for Monitoring and Data collection/usage

  • lessons learned: data collection, MIS, interpreting data for the AIR
  • Performance Framework challenges, measuring progress
  • programme amendments
  • preparing for 2021-2027

Ing. Helena Viktorie Barbořáková, Managing Authority, Operational Programme – Research, Development and Education, Ministry of Education, Youth and Sport, Czech Republic

13.00 Q&A
13.15 End of first day
DAY 2
12.45 Opening ZOOM platform
13.00 Review of day 1
13.10 Can ESF achieve the best results? What is required in 2021-2027?

  • ESF data requirements on participants; eligibility issues
  • ESF data collection for outputs, results; common indicators, programme-specific indicators
  • Monitoring data and evidence of results in ESF; evaluation challenges
  • Prospects for ESF in 2021-2027

Marco Lopriore

13.45 Short break
Evaluations during the programming period
13.50 Evaluation and measuring impact, 2014-2020

  • the purpose of evaluation – criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation methods, techniques
  • evaluation and monitoring requirements, 2021-2027

Robin Smail

14.35 Virtual Coffee break and meeting our Evaluation Expert
15.00 Breakout groups – exercise – evaluation questions
15.35 Evaluation in the context of Programme Management

  • Evaluation and its neighbourhood (discussion)
  • Evaluation types and purposes
  • Evaluation stakeholders
  • Evaluation of projects and evaluation of programmes
  • Evaluation Plans and their challenges – The Czech experience
  • Internal, external and mixed team evaluations

Dr. Vladimir Kváča, former Director-General, Ministry of Labour and Social Affairs, Prague (CZ), and former President of the Czech Evaluation Society

16.35 Short break
16.40 Workshop:  Managing evaluation studies, part 1:

  • the intervention to be evaluated,
  • the purpose of evaluation
  • evaluation stakeholders

Vladimir Kváča

17.20 End of Day 2
DAY 3
08.45 Opening of ZOOM platform
09.00 Evaluation questions

  • Three kinds of evaluation questions (descriptive, normative, causal)
  • Divergent and convergent phase of questions formulation
  • Asking the right questions; methods

Vladimir Kváča

09.30 Workshop: Managing evaluation studies, part 2:

  • Asking the right questions; methods

Vladimir Kváča

10.00 Short break and meeting our guest speaker
10.15 Impact Evaluations in 2014-2020 and proposed changes for 2021-2027

  • Member State evaluation studies 2014-2020
  • Regulation and guidance changes for the new period
  • Rationale and priorities

David Alba, Evaluation Unit, DG Regional and Urban Policy, European Commission

11.15 Short break
11.25 Choice of methods and techniques: theory-based and counter-factual evaluations

  • What limits the choice of methods?
  • Theory-based evaluations – an overview of some methods: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case studies
  • Q&A

Vladimir Kváča

12.25 Short Break
12.35 Workshop break-out groups: Managing evaluation studies, part 3:

  • Theory of change /Causal mechanism
  • Testing the theory

Vladimir Kváča

13.20 End of day 3
DAY 4
08.45 Opening of ZOOM platform
09.00 Counterfactual Evaluations

  • Understanding bias and importance of randomization
  • A quick inventory of counter-factual methods
  • Working with Difference-in-Difference; Propensity Score Matching
  • (Hidden) Assumptions
  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions
  • Q&A

Vladimír Kváča

10.00 Short break
10.10  Counterfactual Evaluations (contd.)
10.35 Workshop break-out groups: Counterfactual Evaluations

  • Choice of three levels:
    • Maths class
    • Antiviolence therapy
    • Enterprise support

Vladimír Kváča

11.05 Virtual coffee break
11.20 Workshop break-out groups: Counterfactual Evaluations

  • Feedback and discussion
11.50 Exercises with revenue-generating projects

  • Major project application forms
  • Calculating the grant for revenue-generating projects

Robin Smail

12.15 Short break
12.25 Break-out groups and feedback: the grant calculation
12.45 Review of Evaluation methods

Vladimír Kváča

13.15 End of day 4
DAY 5
Evaluation Studies; Ex post Cost-Benefit Analysis
08.45 Opening of ZOOM platform
09.00 Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)

Robin Smail

10.00 Workshop: spreadsheet and discounting
10.20 Short break
10.30 Preparing for and Managing Evaluation Studies

  • Managing evaluations, stages of evaluation
  • Preparing for studies
  • The Call for Proposal, Terms of Reference
  • Selection and award criteria

Vladimir Kváča

11.20 Virtual Coffee break
11.40 Break-out groups: Preparing for and Managing Evaluation Studies

  • Deliverables
  • Using the evaluation results

Vladimir Kváča

12.25 Ex post cost-benefit analysis, major projects (continued)

  • economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis
  • Counting jobs

Robin Smail

13.10 Seminar conclusions, evaluation feedback
13.20 Close of seminar