Success Measurement . Main results with regards to the focus area
A general evaluation of the project results was made to verify project effectiveness (participation, completion of self-assessment processand definition/start of improvement plans) and its replicability in other organisational contexts or different Italian territorial areas.
Quantitative measures and qualitative assessments were therefore set:
- How many organisations completed the self-assessment
- How many organisations have started an improvement plan
Furthermore:
- What was the satisfaction from the process taken and how did this create the will to continue the experience
- For each self-assessment process, to what extent common improvement directions identified could become a basis to collaborate for the future.
These are the results to date:
- Of the 10 organisations involved, 5 organisations participated in the training activity held by experts from the CAF National Resource Centre (in total 8 meetings, integrated with additional telephone support and IT contacts)
- 5 organizations completed the self-assessment process, complete with all the elements required by the model. The expert support and the use of the F@cileCAF Platform allowed us to obtain a detailed picture of organisational maturity in relation to the CAF model, also thanks to the use of “Fine Tuning” Score.
- The analysis of the Self Assessment Reports, allowed the identification of common intervention/improvement area, as well as specific areas in which define shared improvement projects. Some common areas were highlighted: Communication, consultation and collaboration with stakeholders (limited /occasional involvement in the organisations’ processes)
- People skill development and assignment of tasks/objectives (weak links with strategy and operational plans)
- Citizen/customer satisfaction and internal climate surveys (lack of systematicity and real use of the results)
- Structured collection and analysis of performance results (dashboard; lack of complete picture, poor practice of benchmarking)
- According to CAF Guidelines, two organisations have formally set up an improvement plan with the common directions identified, now they are continuing their implementation. Although the initial objective was not completely reached (at least three organisations with a formal Improvement Plan), all organisations have declared that they will apply the indications emerged from the self-assessment process in their strategic planning, with the intention of resuming formal application of the model in the future.
Beyond these direct results, it was important to know the level of satisfaction for the journey made together by the organisations with the support of the Region and the national CAF Resource Center. This is essential to understanding if it can be replicated in different geographical areas or sectors and which points need to be improved in the future.
Here is the summary of the evaluation obtained from a brief questionnaire sent to the organisations at the end of the project.The answers are summarized below in qualitative terms:
- Overall satisfaction with the path taken: very high
- Satisfaction with the guidance/support received: very high
- Usefulness of the joint path: very high
- Added value received from the application of the model (in decreasing order):
- organisational analysis
- guidance for improvement
- TQM Culture
- Critical issues that emerged in the application: in decreasing order
- low participation of top management
- time availability
- low priority
- Intention to complete and/or to repeat the experience in the future: all the organizations;
These results, joined with the people participation level during the self assessment process (for example very high percent of answer to the questionnaire administered) show a high level of people engagement in the project both within the region and externally in the municipalities, and the opportunity to cooperate for improvement implementation.
There are also some other aspects to take into consideration for the success:
- The importance of involvement of top management from the beginning and along the Where this involvement was higher, the best results were obtained in terms of quality of the self-assessment/improvement process and continuity in the process
- Foster further collaboration between organisations in all phases of the process, and in particular in improvement phase(such as exchange of experiences and sharing of approaches)
- Increase support from experts (regional or from the CAF Resource Center) in training
- Enhance support and guidance to organisations throughout the whole training and improvement process
The essence of the innovation and the transferability of the solutions introduced
The idea of building a Regional Competence Centre dedicated to the dissemination of CAF arises from the role that the Region has towards the local authorities of the territory, with particular reference to certain policies such as federalism, public transport, environment, and labour. Dialogue on these policies is continuous and the Region has deemed it necessary to build a common base of skills, based on the knowledge of the principles of excellence and TQM, useful in promoting this dialogue.
The innovative nature of the project lies in the role that the Region assumes with regard to the model that strengthens the importance of programming in an integrate way and governing the organization as a whole, especially since the national reform, that introduced the IPAO, urges administrations to think in terms of supply chain and no longer in a stand-alone logic. Moreover, through the F@CILE CAF platform, a further innovative element is represented by the possibility to conduct self assessment process with the same times and the same “rules” and to identify Common Areas of improvement with the regional level support. The experience is transferable to all other Regions and also to the Provinces. Formez is developing a project in this direction. There are no results in this sense yet but the basic idea is in transferability. The Regions are facilitated in this because they have a coordinating body, represented by the Conference of the Regions and Autonomous Provinces, which promotes constant and periodic discussions.
An element of success was participating in the FormezPA project on the topic of performance evaluations and seizing the opportunity to learn about the model and use it as a tool to strengthen common skills. The sensitivity and interest of the administration’s top management to support the initiative was another important element. The possibility of using the F@CILE CAF platform of the Department of Public Function favoured the implementation of the self-evaluation process in the institutions and gave the Region the opportunity to monitor the progress.
For those who want to use our experience, we suggest immediately setting up a coordination group to oversee the activities of the municipalities; a group that must be appropriately trained on the model’s underlying themes and on its connections with all reform policies at a national level. It is similarly important, in order to fully understand the model that the same regional body that assumes the role of coordination carries out a process of self-assessment and improvement with the CAF.
The experience can be replicated in all administrations that, by role, perform a programming, coordination and financing function towards other public administrations in the territory. Its added value would also be considerable in the dissemination of the model. If the 20 Italian regions performed this role towards the local authorities in their territory, the CAF could reach a significantly greater number of administrations (potentially the 8,000 Italian municipalities).