280 likes | 408 Vues
Measuring Performance at the University of Pretoria South Africa. 29th Annual EAIR Forum Innsbruck 2007. Professors Antony Melck and Pieter Vermeulen University of Pretoria. OUTLINE OF THE PRESENTATION. A Performance Indicators in Perspective.
E N D
Measuring Performance at the University of PretoriaSouth Africa 29th Annual EAIR Forum Innsbruck 2007 Professors Antony Melck and Pieter Vermeulen University of Pretoria
OUTLINE OF THE PRESENTATION A Performance Indicators in Perspective B Performance Indicators in relation to an Institution’s Strategic Plan (and Faculty agreements) C Identifying the Performance Indicators
A. Definition of Performance Indicators • Performance indicators are statistical measures designed to provide empirical data on the degree to which an institution is achieving its goals. • qualitative (descriptive) or • quantitative • Often presented in the form of ratios that can be compared to internal or external targets or benchmarks
Performance Indicators in determining international rankings • International League Tables; for example: • The Shanghai Jiao Tong University’s ranking of the world’s top 500 universities • The Times Higher Education Supplement (THES) top 200 universities • The Institute of Scientific Information (ISI) Field Rankings
ISI Institutional Rankings (University of Pretoria’s indicators)
ISI Institutional Rankings (Research performance in specific scientific fields) (University of Pretoria’s position)
Reservations on using International Institutional Rankings ACADEMICS STRIKES BACK AT SPUROIUS RANKINGS • “Call by a group of US academics to boycott the most influential university ranking in the USA” (reference to the US News & World Report rankings) • “Data used for the ISI citation indexes are flawed” Reference: Article in NATURE, Vol. 447, 31 May 2007, p 514
Performance Indicators in Relation to an Institution’s Strategic Plan (and Faculty Agreements) B
Definition of benchmarks • Benchmarking refers to the use of exogenous data to make comparisons • to improve the performance and productivity of a system or institution • Possible benchmarks • SA Department of Education benchmarks • International benchmarks • Average data from set of comparable universities
Application of PIs and Benchmarks/Targets • PIs should have reference points, i.e. benchmarks/targets. • However, benchmarks need to take institutional circumstances into account, e.g. • starting points, direction of change, speed of change, culture, etc. • Benchmarks should therefore be agreed upon for each institution
Hierarchical Structure of Performance Indicators International Higher Education Community National Department of Higher Education (DoE) COUNCIL (University as a whole, summarized) RECTORATE (University as a whole) SENATE (University as a whole) DEANS/DIRECTORS (per faculty/school/group) HEADS OF DEPARTMENTS (per department) Institution’s Computer databases Department of Education databases Academic departmental self-evaluation Support Services Annual reports International Higher Education statistics
Measuring the System Input Process Output Teaching and Learning Graduates Students Research Outputs Money Research Staff Services Community Engagement Facilities
Measuring the System Input Process Output Teaching and Learning QUALITY Graduates Students Research Outputs Money Research Staff Services Community Engagement Facilities
C Identifying the Performance Indicators
Measurement using the Performance Indicators 1 Academic Excellence 2 A people centered University 8 Sustainability • 3 • Excellence in UP’s core functions • Teaching & Learning • Research • Community Engagement 7 Interfaces Vision and Mission Strategic Plan 6 Local Impact 4 Excellence in the University’s support functions 5 Transformation Quality Assurance
Measurement using the Performance Indicators 1 Academic Excellence 2 A people centered University 8 Sustainability • 3 • Excellence in UP’s core functions • Teaching & Learning • Research • Community Engagement 7 Interfaces Vision and Mission Strategic Plan 6 Local Impact 4 Excellence in the University’s support functions 5 Transformation Quality Assurance