Evaluating Quality of Training Offer in Territorial Systems

1. The evaluation of quality of the training offer within territorial systems Isfol – Area for the evaluation of policies in the field of Human Resources The evaluation of quality of the training offer at territorial levelLuisa Palomba

2. A model for evaluating the quality of the training offer ISFOL has elaborated a model representing an instrument for self-evaluation – destined to all administrations responsible of professional training and educations policies – aiming at improving the different dimensions of systems quality, having regard of mutual connections. Its application, at regular intervals within a self-diagnosis process, permits to each administration to obtain a check list of areas of sections inside the system which could be improved and have to be kept under observation in order to increase the qualitative level.

3. The definition of quality by typology of approach to training Training as a didactic activity Training as a service to a beneficiary Training as a service of public utility Training as an enterprise function Training as an economic activity Training as a policy Quality = optimising the teaching – learning process Quality = satisfying the client Quality = conforming to a standard Quality = Total Quality Management Quality = improving results and performances Quality = reaching the objectives

4. The model Approach The model: Refers to a training offer system at territorial and institutional level; Considers policies and professional education and training interventions as subjects for evaluation, as regards: - programming / planning - implementation processes; - achievements, results, impacts.

5. The model review The model takes into account: The necessary conditions for achieving Lisbon objectives; The European Recommendations as regards the creation of a reference framework for quality assurance within professional education and training systems; The approach to the evaluation of human resources development policies within the National Strategic Framework (NSF); The results of experimentations.

6. The European Strategy for Education and Training 2010 Among the 8 policy sectors identified by the European Strategy, the model contributes to evaluating: The equity within education and training systems; The efficiency within education and training systems; The employability of those who have participated in training activities

7. The approach to quality within the NSF The general objective of the first NSF Priority (improving and valorising human resources) is to “strengthen, integrate and improve the quality of education, training and labour systems, as well as their connections with the territory. It is articulated in the following specific objectives: Improving the quality of education and training offer, as well as learning results, and facilitating the recognisability of competences; Improving the implementation process governance and the integration among the education, training and labour systems, as well as their relationship with the territory

8. The characteristics of the model 4 criteria for defining the quality of the training offer have been identified; Each criteria refers to a variable number of dimensions and sub-dimensions that can be evaluated through a set of indicators; The model takes into account the declination of dimensions and sub-dimensions for specific training sectors.

9. Quality dimensions by criteria Criteria 1 – The relevance of strategic planning: strategic planning reflects a vision that is agreed among stakeholders and answers to the needs of professional profiles within the territory. Needs’ analysis as regards professional profiles and training or as regards structured mechanisms for demand revealing / analysing Implementing integrated education, training and labour programming processes.

10. Quality dimensions by criteria Criteria 2 - The equity of training as compared to the beneficiaries’ needs: consists in the capacity to identify potential beneficiaries and to offer a training respondent to individuals’ needs, by integrating education, training, labour and social inclusion policies. Diffusing information. Identifying beneficiaries that are under conditions of distress Adapting the training offer to the beneficiaries’ typology Certifying competences Targeted accompaniment actions Individual training demand and, in general, individual systems for accessing and utilising training services. Mechanisms and instruments of conciliation Integrating professional guidance, training and education.

11. Quality dimensions by criteria Criteria 3 – The relative effectiveness of training interventions and policies Asset profile of proposals presented and approved for financing Recognition of competencies Evaluating the learning process of trainees Trainees’ success rate Employees’ gross employment insertion Observing participants’ satisfaction

12. Quality dimensions by criteria Criteria 4 – Sustainability: is defined by strengthening capacity building of administrations responsible of training and labour policies Existing system actions Training of trainers activity Governance of interventions didactic dimension Policies and interventions in support of training bodies’ evaluation / self – evaluation Strengthening the governance system

13. Experimentations The model for evaluating the training offer quality has been experimented in two regions: Liguria and Toscana Regions (Province Lucca and Pistoia). Each experimentation represents a possible modality to apply / develop the same model.

14. The European Reference Framework Isfol model and the European Reference Framework have in common the overall approach to quality, because: it considers “evaluation” as an instrument to support the decision making process as well as an instrument for improving programming and implementation; it valorises “participated” evaluation; it refers to self-evaluation; it considers quality evaluation as a system evaluation of processes, products, realisations, results and impacts. Isfol – National Structure for the evaluation of ESF Area for the evaluation of policies in the field of Human Resources