140 likes | 273 Vues
This study examines how research evaluation influences publishing activities within the Contextual Research Information System (CRIS) at Aalborg University. The research context is under the broader lens of New Public Management demands for accountability in higher education. We explore the prestige of journals that researchers aim for, considering factors like collaborative efforts and funding allocations. Utilizing bibliometric indicators, we analyze how the implementation of a national research evaluation system (RES) affects publication patterns and prestige levels, while also considering the perspectives of researchers in this evolving landscape.
E N D
Research performance management in a CRIS environment Does research evaluationaffectpublishingactivity? Brian Kirkegaard Lunn (bkl@aub.aau.dk) & Poul M. Melchiorsen, Nils Thidemann, John Kruuse, Anne Lyhne Høj, Sabine Dreier, Maria A. Madsen, Anne Marya Jensen CRIS2012 Conference, Prague, June 2012
Why relevant in the CRIS environment • The New Public Management wave • Demands for accountability • CRIS systems hold relevant data e.g., on researchers’ publishingactivity
Agenda • Background and research agenda • How to measure the prestige of publications? • Does researchers publish in more prestigeous journals?
Aalborg University is... • 14,000 students • 2,000 researchers • 800 administrative and technicalstaff • With 4 faculties • The Faculty of Humanities • The Faculty of Social Sciences • The Faculty of Engineering and Science • The Faculty of Medicine
Bibliometric Research Indicator • Builds on the so-called‘Norwegian Model’ • Peer-reviewedpublished research publications • 68 research groups with representatives from eachuniversity • Authority list of publicationchannels • Publicationchannels is grouped in twolevels (normal and prestigous) • Weightsbetweenpublications types • Fractionisedcountswhen more thanoneauthor • Collaboration outsideonesownuniversity is rewarded (+25 %) • Used for allocatingfunds to Danish universities
Political motivations for the national RES Implementation of the Bibliometric Research Indicator is expected to encourage • …to increasescientificpublications • …behaviourthatcreatesincentives for publishing in the more prestigious journals • …
Research agenda • The extent to which researchers at Aalborg Universitypublish in prestigious journals, and • How publishingactivitycorrelates with implementation of a national RES
How to measure prestige • Internalyardstick • Using the BFI-model'sowncategorisation of prestigious journals (level 1 or level 2) • Externalyardsticks • Using international recognised measures of prestige • Web of Science – Journal Impact Factor (JIF) • Scopus – Source NormalisedImpact per Paper (SNIP)
The Internalyardstick • Publishing activitymeasured by Cumulative Authority List for Journals (percentages). The shadedareas show percentages in relation to the Authority List of Journals, only
Publications in WoS and Scopus • Master lists areapplied to avoidmeasuring the growth of the databases
Conclusion and future work • Results do neither support nor contradictthatinplementation of the national RES affects researchers’ publishingactivity • This said … • A few researchers expressthat the Bibliometric Research Indicatoraffectstheirbehaviour – this is to beinvestigated in cooporation with a research team at AAU • Weneed to scrutinize data further, e.g., by looking at data at the level of faculties, departments, BFI research groups or document types