110 likes | 231 Vues
In February 2009, Graeme Rosenberg, the REF Project Manager, led discussions on key issues arising from the 2008 Research Assessment Exercise (RAE). The meetings aimed to explore the implications of significant changes for the 2008 exercise, identify good practices for the REF assessment, and streamline processes. Key points included subject configuration, eligibility of research staff, criteria for impact assessment, and the use of bibliometrics alongside expert review for evaluating outputs. Future steps involve engaging wider communities and conducting further meetings to refine the REF strategies.
E N D
Reflecting on the 2008 RAE Expert Advisory Groups round 1 meetings February 2009 Graeme Rosenberg REF Project Manager
Reflecting on the 2008 RAE Key issues to discuss: • Implications of the key changes made for the 2008 exercise • Which key features and examples of good practice should carry forward into the REF? • What information was vital? What was less informative? What opportunities are there for streamlining the process?
Key features of the REF Expert Advisory Groups round 1 meetings February 2009 Graeme Rosenberg REF Project Manager
Key features of the REF (1) • Subject configuration – initial views • Eligibility: • All research staff or selected staff? • Credit the author or the institution? • Criteria: • How to make impact more explicit
Key features of the REF (2) • Quality profiles, capturing three main elements: • Outputs • Impact • Environment
Outputs This should remain the dominant factor in assessment: • Using bibliometrics, expert review of outputs, or a combination of these, as appropriate to each subject group • The bibliometrics pilot is looking at different models for producing citation indicators - the options remain open at this stage • We expect further development of this new tool in the lead up to a full REF exercise in 2013
Impact In October last year we initiated discussion on how to account for economic and social impact in the REF: • Influence of a body of research activity across a range of contexts (social, economic, public policy, quality of life) • Applicable across the full range of disciplines • How to evidence impact? Metrics can be useful but will need narrative and expert judgement • Research users to be involved in the design and assessment phases of REF
Next steps and future work Expert Advisory Groups round 1 meetings February 2009 Graeme Rosenberg REF Project Manager
Consulting wider communities • Share thinking and key questions • Meetings with specific groups • Contact h.chaplin@hefce.ac.uk
Related work • Bibliometrics pilot • Consultancy on approaches to assessing impact • Event for research PVCs (24 March) • PA Consulting – accountability review of the 2008 RAE • ECU review of the RAE equalities measures
Future meetings • Round two meetings (April/May): • Day 1: bibliometrics • Day 2: expert review, impact and environment • Round 3 meetings (June) • Break-out discussions – group by discipline? • Other suggestions?