Structural and cohesion funds/ESIF

Monitoring and Evaluation of EU Structural and Cohesion Fund Programmes: Measuring Progress and Impact in 2021-2027

About 400 new Structural and Cohesion Fund programmes for the 2021-2027 period are now being implemented. Member States have set up monitoring and reporting systems and evaluation plans have been agreed on for the new period. Within this context, are you aware of what the New Regulations say about the new monitoring and evaluation requirements?

About this course

About 400 new Structural and Cohesion Fund programmes for the 2021-2027 period are now being implemented. Member States have set up monitoring and reporting systems and evaluation plans have been agreed on for the new period. Within this context, are you aware of what the New Regulations say about the new monitoring and evaluation requirements?

Many programme authorities continue to conduct evaluations of their 2014-2020 programmes and projects, as well as planning evaluations for the 2021-2027 period. Are the managing authorities collecting the best possible monitoring and evaluation data? How do we best measure project and programme progress and how do we best measure the impact of interventions? What specific evaluation methods should be used – theory-based or counterfactual? Should we be considering using ex-post CBA?

Member State Recovery and Resilience Fund plans are being implemented rapidly. How do their monitoring procedures and data needs differ from Cohesion Policy?

What you will learn:

This face-to-face course in Prague, over 3 whole days, will cover the following

  • In Days 1 & 3 we examine the contents of programme evaluation plans and how to conduct impact evaluations (and “evaluations during the programming period”). Dr Vladimir Kváča, a leading evaluation consultant-economist, will help us plan realistic evaluations – ones that are useful for evaluation stakeholders. He will consider the appropriate timing of evaluation studies and the implications for data gathering. We will review a range of evaluation methods – which fall under the broad categories of theory-based and counterfactual evaluations – and consider how the choices made for project and programme evaluations will reflect evaluation questions.
  • We will also introduce the ex post cost-benefit analysis (ex post CBA) method, which can be used for evaluating infrastructure and other large projects.
  • Finally, we will consider how best to manage evaluation studies, including preparation of the Terms of Reference, aspects of fieldwork, and typical live issues for your current/planned evaluations.
  • Day 2 will deal with the new monitoring and reporting requirements, the choice of programme indicators, data challenges and using the new Performance Framework. Helena Barbořáková, a highly experienced Czech Ministry official, will discuss the lessons learnt from 2014-2020 and the implications of the new requirements for programmes in 2021-2027.
  • We will review a selection of new Programmes and look at the Reporting template for the new Structural Fund Programmes, highlighting the special link between finance and performance, and how you will report programme progress.
  • We look at how RRF plans in Member States are being monitored and evaluated

At the end of the course, participants should have:

  • A clear understanding of all the monitoring and evaluation evaluation requirements for programmes; and
  • A general tool kit for undertaking impact evaluations for projects and programmes

Workshops and exercises will be used to develop simulations of essential elements of evaluation and monitoring to provide a clear view of good practice in the key disciplines involved.

Participants are invited to send us their problems, issues and questions before the course, if they wish.  We will do our best to address the problems / answer the questions during the course!

  • Officials from central, regional and local government, programme officers and managers involved with the implementation and evaluation of Structural / Cohesion / Just Transition Fund projects and programmes
  • Project managers and developers
  • Economic and social partners involved in Structural Funds and evaluation activities, such as NGOs, higher education establishments, and consultants.

Project number: 2430211

Course venue
Novotel Praha Wenceslas Square
38 Katerinska, 12000 PRAGUE, Czech Republic
Telephone: +420 221 104 999
Email: H3194@accor.com
Website: https://all.accor.com/hotel/3194/index.en.shtml

Senior Project Officer
Ms Rafaella Giussani
Tel: +31 43 32 96 372
r.giussani@eipa.eu

Fee
The fee includes documentation, refreshments, lunches, and a reception. Accommodation and travel costs are at the expense of the participants or their administration.

Discounts
EIPA member fee
EIPA offers a discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?
Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Romania, Spain, Sweden.

For all other participants, the regular fee applies.

Early bird discount
The early bird discount is not cumulative with other discounts or promo codes, except for the EIPA member fee.

Loyalty coupon
As a token of appreciation we offer all our participants a loyalty coupon for one of our future courses. The offer can be shared with colleagues and relevant networks. The coupon will expire one year after its release. This discount is not cumulative with other discounts, except for the EIPA member fee.

Meals
Dietary preferences can be indicated on the registration form.

Confirmation
Confirmation of registration will be forwarded to participants on receipt of the completed online registration form.

Payment
Prior payment is a condition for participation.

Cancellation policy
For administrative reasons you will be charged €150 for cancellations received within 15 days before the activity begins. There is no charge for qualified substitute participants.

EIPA reserves the right to cancel the activity up to 2 weeks before the starting date. In that case, registration fees received will be fully reimbursed. EIPA accepts no responsibility for any costs incurred (travel, accommodation, etc.).

A few days before the start of the course you will receive the log-in details for accessing the course materials. You can log in here.

Download the brochure

I have a question

Our experts

robin smail new photo 2024
Project leader

Robin Smail

Robin Smail Training & Consultancy

Programme

DAY 1
Evaluations During the Programming Period: Part 1
08.40Registration of participants
09.00Opening of the course and meeting the participants:
Introduction to the objectives and methodology of the course
Marco Lopriore, Expert, EIPA, Maastricht, the Netherlands
Robin Smail, Visiting Expert EIPA and Consultant (UK/IE)
09.10Evaluation and measuring impact, moving from 2014-20 to 2021-27

  • The purpose of evaluation – evaluation questions, criteria, measuring impact, value for money
  • Evaluation-policy cycle, evaluation methods, techniques
  • Evaluation requirements, 2021-2027

Robin Smail, Visiting Expert EIPA and Consultant (UK) (former National Expert EC, and former Senior Executive within Evaluation Division, Scottish Enterprise)

10.10Exercise: Evaluation Questions –by Sector
Robin Smail
10.45Coffee break & tour de table
11.15Evaluation in the context of Programme Management

  • Evaluation purposes in different stages of maturity of intervention
  • How do evaluation designs (not) match the evaluation purpose and stage of maturity?
  • Evaluation stakeholders
  • Evaluation of projects and evaluation of programmes
  • Priorities in the Evaluation Plans of your programmes

Dr Vladimir Kváča, former Director-General, Ministry of Labour and Social Affairs, Prague (CZ), and former President of the Czech Evaluation Society

12.15Workshop:  Managing Evaluation Studies, part 1:

  • The intervention to be evaluated,
  • The purpose of evaluation
  • Evaluation stakeholders

Vladimir Kváča

13.00Lunch break
14.15Evaluation Questions

  • Types of evaluation questions (descriptive, critical, normative, causal)
  • Divergent and convergent phase of questions formulation
  • How the evaluation questions and criteria match the evaluation design

Vladimir Kváča

14.50
  • Workshop: Managing Evaluation Studies, part 2:
    Asking the right questions; methods

Vladimir Kváča

15.30Coffee break
16.00Choice of methods and techniques: Theory-based and counter-factual evaluations

  • What is the theory within the theory-based evaluation?
  • Theory-based evaluations – an overview of some methods: process tracing, congruence analysis, qualitative comparative analysis
  • Design of case studies

Vladimir Kváča

17.15Workshop: Managing Evaluation Studies, part 3:

  • Theory of change /Causal mechanism
  • Testing the theory

Vladimir Kváča

18.00End of the first day
18.30Reception
DAY 2
Monitoring & Reporting, Indicators and the Performance Framework
09.00Participants’ Programmes and issues
09.20Monitoring and reporting project and programme progress, 2021-2027

  • Modification of the intervention logic, result-orientation, focus on specific objectives
  • Intervention categories and new climate targets
  • Key monitoring tasks and changes from 2014-20 to 2021-27
  • The new Performance Framework, common and programme-specific indicators
  • The Fund regulations, Commission working documents
  • Examples of new programmes
  • The move to real-time reporting and the new Reporting Template

Robin Smail

10.45Coffee break
11.15Workshop and discussion: indicators by sector

  • What are we measuring? Impact chain
  • Programme-specific indicators by sector

Robin Smail

12.15Management Challenges for Member States in collecting and managing data

  • Lessons learned from the previous programming period and from the first years of implementation of the current one
  • The new Performance Framework
  • Methodology for the establishment of the performance framework

Ing. Helena Viktorie Barbořáková, Managing Authority, Programme – Johannes Amos Comenius, Ministry of Education, Youth and Sport, Czech Republic

13.00Lunch break
14.15Management Challenges for Member States in collecting and managing data (cont.).

  • Mid-term review and interpreting data for reporting
  • Data collection, MIS
  • Programme amendments

Ing. Helena Viktorie Barbořáková

15.00Workshop: Using benchmarks for the Performance Framework

  • new programmes – baselines and setting targets
  • the Reporting template – measuring progress
  • using unit-cost benchmarks

Robin Smail

15.45Coffee break
16.15Measuring progress in Recovery and Resilience Facility compared to EU Cohesion

  • RRF Milestones & Targets (M&T); the 14 Common RRF Indicators
  • EC Scoreboard and delegated act on social expenditure in RRF
  • Comparing M&E of EU Cohesion and RRF
  • RRF Comparison between Member States: resources and M&T

Marco Lopriore (online)

17.00Case study with RRF

  • Are the indicators adequate? Are we measuring inputs, outputs or results?
  • Primary and secondary targets

Marco Lopriore (online)

17.30End of the second day
DAY 3
Evaluations during the programming period: part 2
09.00Counterfactual Evaluations

  • Understanding bias and importance of randomization
  • A quick inventory of counter-factual methods
  • Working with Difference-in-Difference; Propensity Score Matching
  • (Hidden) Assumptions
  • Understanding the main strategies for the identification of counterfactual and its limitations and assumptions

Dr. Vladimir Kváča

10.15Workshop: Counterfactual Evaluations

  • Choice of three levels:
    • Maths class
    • Anti-violence therapy
    • Enterprise support

Vladimír Kváča

11.00Coffee break
11.30Preparing for and Managing Evaluation Studies

  • Managing evaluations, stages of evaluation
  • Internal, external and mixed team evaluations
  • Preparing for studies
  • The Call for Proposal, Terms of Reference
  • Selection and award criteria
  • Deliverables
  • Using the evaluation results

Vladimir Kváča

12.20Break-out groups: Preparing for and Managing Evaluation Studies

  • Deliverables
  • Using the evaluation results

Vladimir Kváča

13.00Lunch break
14.10WORKSHOP: assessing risk in projects
Robin Smail
14.40Ex post cost-benefit analysis

  • Project objectives, context and rationale, theory of change
  • Demand, feasibility, options, environmental impact assessment
  • Financial and economic appraisal: calculating the costs, the benefits (NPV, IRR for major projects)

Robin Smail

15.15Coffee break
15.30Ex post cost-benefit analysis (cont.).

  • Risk assessment, sensitivity analysis
  • Measuring other impacts

Robin Smail

15.45Exercise with revenue-generating projects: how does this affect the grant?
Robin Smail
16.05Course conclusions, evaluation feedback
16.15End of the course

What former participants say

Leave a review

Review
Privacy

Monitoring and Evaluation of EU Structural and Cohesion Fund Programmes: Measuring Progress and Impact in 2021-2027

Confirmed
22 Oct 2024 - 24 Oct 2024
Prague (CZ)
Register before: 18 Oct 2024

Simultaneous interpretation can be offered. Contact the programme organizer for more information and conditions.

 1.765 per attendee
 1.500 for EIPA members
Registration closed

Discount policy

EIPA offers a discount to all civil servants working for one of EIPA’s supporting countries, and civil servants working for an EU institution, body or agency.

Who are the supporting countries?

Civil servants coming from the following EIPA supporting countries are entitled to get the reduced fee: Austria, Belgium, Bulgaria, Cyprus, Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Spain, Sweden.

For all other participants, the regular fee applies.

Early bird discount

For a limited number of training courses, EIPA offers an early bird discount.

For more information please contact us.

Subscribe to our newsletter

Register before: 18 Oct 2024
Registration closed

Quick survey

Thank you for visiting this page and your interest in this topic!

Why do you not register for this course?