Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027

Project number: 2130209

- Online Course -

Date & pricing

14/10/2021 - 21/10/2021
Register before: 07/10/2021

€ 1.100,00 per attendee

€ 990,00 for EIPA members*

Evaluation and Monitoring of EU Structural and Cohesion Funds Programmes, 2014-2020 and 2021-2027

From:  990,00

This is an online course over 5 days. Days 1 and 2 deal with monitoring tasks, indicators and the Performance Framework. Days 2-5 examine how to conduct “evaluations during the programming period”

Book up until 14 August to get a 20% early bird discount

About this online course

New EU Structural and Cohesion Funds programmes for the period 2021-2027 are now being prepared, agreed and implemented. Member States are setting up monitoring systems and writing Evaluation Plans for the new period. Are Member States clear about what the New Regulations say about the new monitoring and evaluation requirements?

Programme Authorities continue to conduct evaluations of their 2014-2020 programmes and projects, as well as planning evaluations for the 2021-2027 period. Are Managing Authorities successful in collecting the best possible monitoring data and are they clear about how to measure the impact of interventions? Which evaluation methods should be used – theory-based and/or counter-factual? Should they use ex-post CBA?

This is a webinar over 5 days (mornings and afternoons):

  • Days 1 & 2 deal with monitoring tasks, indicators and the Performance Framework. A Czech Ministry official will assess the lessons learnt from 2014-2020 and the implications of the new requirements for 2021-2027.
  • Days 2-5: we examine how to conduct “evaluations during the programming period”. A leading evaluation consultant-economist will focus on the two broad recommended evaluation methods – theory-based and counterfactual evaluations – and the choices for project / programme evaluations on the ground.
  • We will also describe how to complete an ex post cost-benefit analysis (ex post CBA) for infrastructure and other larger
  • A European Commission official will describe what progress has been made on impact evaluations in 2014-2020 and explain what is expected in 2021-2027.
  • You will also learn how to manage evaluation studies, including preparation of the Terms of Reference, aspects of fieldwork, and typical live issues for your current / planned evaluations.

Course methodology

Break-out groups, mini-workshops, exercises and videos will be used to develop simulations of essential elements of evaluation and monitoring to provide a clear view of good practice in the key disciplines involved.

A modest element of home-learning will be included in the seminar, to take place between the teaching days: links to exciting technical videos will be provided, which participants can watch in their own time.


Read Marco Lopriore’s paper: ‘Recovery and Resilience Plans for the Next Generation EU: a unique opportunity that must be taken quickly, and carefully

Read paper

How will it help you?

At the end of the seminar, participants should have:

  • a clear understanding of all the evaluation and monitoring requirements for current and future programmes; and
  • a quick general tool kit for undertaking impact evaluations of projects and programmes

Who will benefit most?

  • officials from central, regional and local government, programme officers and managers, involved with the implementation and evaluation of Structural and Cohesion Fund projects and programmes
  • project managers and developers
  • economic and social partners involved in Structural Funds and evaluation activities, such as NGOs, higher education establishments, and consultants.
Robin Smail

Robin Smail

Robin Smail Training & Consultancy
EU Structural Funds

Helena Viktorie Barbořáková

Helena Viktorie Barbořáková

Ministry of Education, Youth and Sport, Czech Republic
Managing Authority, Operational Programme - Research, Development and Education

Vladimir Kvača

Vladimir Kvača

Charles University, Prague
Policy design and evaluation

Practical information

Online Course
For this online course we make use of Zoom

Remote simultaneous interpretation
Remote simultaneous interpretation can be offered in Spanish, French and Italian on request. Contact the Programme Organiser for more information and conditions

Programme Organiser
Ms Nancy Vermeulen
Tel: +31 43 32 96 212
n.vermeulen@eipa.eu

Discounts
EIPA member fee
EIPA offers a discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?
Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden.

For all other participants, the regular fee applies.

Early bird discount
Book up until 14 August to get a 20% early bird discount.

Please note that the early bird discount will be applied at a later stage, when you receive the final invoice. The early bird discount is not cumulative with other discounts or promo codes, except for the EIPA member fee.

Confirmation
Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment
Prior payment is a condition for participation.

Cancellation policy
For administrative reasons you will be charged € 50 for cancellations received within 7 days before the activity begins. There is no charge for qualified substitute participants.

 EIPA reserves the right to cancel the activity up to 1 week before the starting date. In that case, registration fees received will be fully reimbursed.

I have a question

Course > I have a Question

The programme

DAY 1
Monitoring, indicators and the Performance Framework
08.45 Opening of ZOOM platform and gathering of participants
09.00 Opening of the seminar and meeting the participants: introduction to the objectives and methodology of the seminar

  • CRII and CRII+ emergency amending regulations (2014-2020), REACT-EU
  • The new MFF, the new draft Regulations (2021-2027), Recovery and Resilience Fund (RRF)

Marco Lopriore, Expert, EIPA, Maastricht, Netherlands

09.25 Meeting each other: Tour de Table
09.40 Monitoring and reporting project and programme progress in 2014-2020 and 2021-2027

  • Programme cycle, key monitoring tasks, data requirements and challenges
  • Indicators, intervention logic, result-orientation, understanding the impact chain
  • The Performance Framework – old and new
  • Reporting in 2014-2020 and 2021-2027: moving to real-time reporting

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.30 Virtual Coffee Break
10.50 Monitoring and reporting project and programme progress in 2014-2020 and 2021-2027 (continued)

  • The new OP template – baselines and setting targets
  • the Reporting template – measuring progress
  • Fund Regulation Annexes – common indicators

Robin Smail

11.10 Workshop break-out groups and feedback: indicators by sector

  • What are we measuring? Programme-specific indicators by sector
  • Issues for indicators

Robin Smail

11.50 Short break
12.00 Management Challenges for Monitoring and Data collection/usage

  • lessons learned: data collection, MIS, interpreting data for the AIR
  • Performance Framework challenges, measuring progress
  • programme amendments
  • preparing for 2021-2027

Ing. Helena Viktorie Barbořáková, Managing Authority, Operational Programme – Research, Development and Education, Ministry of Education, Youth and Sport, Czech Republic

13.00 Q&A
13.15 End of first day
DAY 2
08.45 Opening ZOOM platform
09.00 Review of day 1
09.10 Can ESF achieve the best results? What is required in 2021-2027?

  • ESF data requirements on participants; eligibility issues
  • ESF data collection for outputs, results; common indicators, programme-specific indicators
  • Monitoring data and evidence of results in ESF; evaluation challenges
  • Prospects for ESF in 2021-2027

Marco Lopriore

09.40 Short break
Evaluations during the programming period
09.50 Evaluation and measuring impact, 2014-2020

  • the purpose of evaluation – criteria, measuring impact, Value for Money
  • evaluation cycle, evaluation methods, techniques
  • evaluation and monitoring requirements, 2021-2027

Robin Smail

10.35 Virtual Coffee break and meeting our Evaluation Expert
11.00 Breakout groups – exercise – evaluation questions
Robin Smail
11.35 Evaluation in the context of Programme Management

  • Evaluation and its neighbourhood (discussion)
  • Evaluation types and purposes
  • Evaluation stakeholders
  • Evaluation of projects and evaluation of programmes
  • Evaluation Plans and their challenges – The Czech experience
  • Internal, external and mixed team evaluations

Dr. Vladimir Kváča, former Director-General, Ministry of Labour and Social Affairs, Prague (CZ), and former President of the Czech Evaluation Society

12.35 Short break
12.40 Workshop:  Managing evaluation studies, part 1:

  • the intervention to be evaluated,
  • the purpose of evaluation
  • evaluation stakeholders

Vladimir Kváča

13.20 End of Day 2
DAY 3
12.45 Opening of ZOOM platform
13.00 Evaluation questions

  • Three kinds of evaluation questions (descriptive, normative, causal)
  • Divergent and convergent phase of questions formulation
  • Asking the right questions; methods

Vladimir Kváča

13.30 Workshop: Managing evaluation studies, part 2:

  • Asking the right questions; methods

Vladimir Kváča

14.00 Short break and meeting our guest speaker
14.15 Impact Evaluations in 2014-2020 and proposed changes for 2021-2027

  • Member State evaluation studies 2014-2020
  • Regulation and guidance changes for the new period
  • Rationale and priorities

David Alba, Evaluation Unit, DG Regional and Urban Policy, European Commission

15.15 Short break
15.25 Choice of methods and techniques: theory-based and counter-factual evaluations

  • What limits the choice of methods?
  • Theory-based evaluations – an overview of some methods: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case studies
  • Q&A

Vladimir Kváča

16.25 Short Break
16.35 Workshop break-out groups: Managing evaluation studies, part 3:

  • Theory of change /Causal mechanism
  • Testing the theory

Vladimir Kváča

17.20 End of day 3
DAY 4
12.45 Opening of ZOOM platform
13.00 Counterfactual Evaluations

  • Understanding bias and importance of randomization
  • A quick inventory of counter-factual methods
  • Working with Difference-in-Difference; Propensity Score Matching
  • (Hidden) Assumptions
  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions
  • Q&A

Vladimír Kváča

14.00 Short break
14.10 Counterfactual Evaluations (contd.)
14.35 Workshop break-out groups: Counterfactual Evaluations

  • Choice of three levels:
    • Maths class
    • Antiviolence therapy
    • Enterprise support

Vladimír Kváča

15.05 Virtual coffee break
15.20 Workshop break-out groups: Counterfactual Evaluations

  • Feedback and discussion
15.50 Exercises with revenue-generating projects

  • Major project application forms
  • Calculating the grant for revenue-generating projects

Robin Smail

16.15 Short break
16.25 Break-out groups and feedback: the grant calculation
Robin Smail
16.45 Review of Evaluation methods

Vladimír Kváča

17.15 End of third day
DAY 5
Evaluation Studies; Ex post Cost-Benefit Analysis
08.45 Opening of ZOOM platform
09.00 Ex post cost-benefit analysis, major projects, revenue-generating projects

  • Project objectives, context and rationale, market failure, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)

Robin Smail

10.00 Workshop: spreadsheet and discounting
Robin Smail
10.20 Short break
10.30 Preparing for and Managing Evaluation Studies

  • Managing evaluations, stages of evaluation
  • Preparing for studies
  • The Call for Proposal, Terms of Reference
  • Selection and award criteria

Vladimir Kváča

11.20 Virtual Coffee break
11.40 Break-out groups: Preparing for and Managing Evaluation Studies

  • Deliverables
  • Using the evaluation results

Vladimir Kváča

12.25 Ex post cost-benefit analysis, major projects (continued)

  • economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)
  • Risk assessment, sensitivity analysis
  • Counting jobs

Robin Smail

13.10 Seminar conclusions, evaluation feedback
13.20 Close of seminar