310 likes | 416 Vues
This presentation by Anne Asserson from the Research Administration Department at UiB explores the Norwegian national CRIS (Current Research Information System) model for evaluating research output. It delves into the role of the FRIDA system, the Ministry's assessment model based on indicators, and how these tools aim to stimulate research and allocate resources efficiently. Key topics include the requirements for CRIS, evaluation mechanisms, quality assurance in research publications, and the significance of indicators in funding allocation. The session aims to foster better data practices and promote high-quality academic outputs.
E N D
How can you assess your organisation through a CRIS?The Norwegian national CRIS, FRIDA, and evaluation by means of research output Anne Asserson Research Administration Department,UiB
Structure of Presentation • Ministry Model for Assessing Research Output • Research Output – Publications • Requirements of a CRIS in this context • System Solution • Evaluation of Output • Ensuring Quality • Conclusion Anne Asserson Research Administration Department,UiB
Aim of Ministry for Assessment Model for assessment based on indicators to Stimulate research and Allocate resources • The best researchers (by allocating money based on publications) • The best ideas (allocating money to the competition-based financing of projects) • Allocate money to special thematic areas Anne Asserson Research Administration Department,UiB
St.prp.nr.1, UFD, pg. 115: ”Financing of Research” 2003 New efforts: to use result indicators for academic/scientific publishing as a basis to budget the research at Universities and State Colleges. The Publications from 2004 will be included in the budgets for 2006 Main issues: • Provide better data on Academic Publishing • Take in consideration different practices – thus avoiding unfortunate effect on the publication pattern. • Divide in Quality levels to avoid reduction in quality of the publications pattern and avoid volume of low publications • Develop indicators for activities within dissemination Anne Asserson Research Administration Department,UiB
Ministry of Education and Research wish to improve research results in the universities • Measure through indicators that say something of quality of results • Results will trigger resource allocation to the universities • 14% of total budget allocated based on research output indicators Anne Asserson Research Administration Department,UiB
Result Indicators that have been chosen • Doctoral theses • EU funding • National Research Council Funding • Publications • These are quality indicators; all subject to peer review Anne Asserson Research Administration Department,UiB
Institution receives an allocation from the ministry • The model is NOT recommended for use internally • The ministry stresses the need for creating internal models to reward / stimulate • Necessary to think complementarily in order to support particular subject areas Anne Asserson Research Administration Department,UiB
Structure of Presentation • Ministry Model for Assessing Research Output • Research Output – Publications • Requirements of a CRIS in this context • System Solution • Evaluation of Output • Ensuring Quality • Conclusion Anne Asserson Research Administration Department,UiB
Anne Asserson Research Administration Department,UiB
Definition of an academic Publication The Publication must: • Present new insight/knowledge • Be in a form that make it possible to validate or useful in new research • Be in a language and have a distribution that can make the publication available for the researchers of whom it may be of interest • Be in a publication channel ( journal, series, publisher, website) with routines for Peer review. Anne Asserson Research Administration Department,UiB
Publications • Peer reviewed articles • Academic monographs • Chapters / parts of anthologies • (Proceedings) • Only a few classes of publications used in assessment Anne Asserson Research Administration Department,UiB
Structure of Presentation • Ministry Model for Assessing Research Output • Research Output – Publications • Requirements of a CRIS in this context • System Solution • Evaluation of Output • Ensuring Quality • Conclusion Anne Asserson Research Administration Department,UiB
Functionality Required • Must be able to express : • Person belonging to one or more organisational unit • The output produced at one or more organisational units • from one year or a temporal interval • From one or several projects • And these in any combination Anne Asserson Research Administration Department,UiB
Functionality Required 2 • Person must be linked to publication, organisational unit and project • Reference format • Vancouver, APA etc • Person must be linkable to two or more organisational units Anne Asserson Research Administration Department,UiB
Structure of Presentation • Ministry Model for Assessing Research Output • Research Output – Publications • Requirements of a CRIS in this context • System Solution • Evaluation of Output • Ensuring Quality • Conclusion Anne Asserson Research Administration Department,UiB
Structure Required • relational model as basis with dynamic role-based temporal links between base entities • Extended with elements of publication • Journal name, ISSN, shortname, acronym, pagefrom, pageto, volume, issue Anne Asserson Research Administration Department,UiB
The Whole Thing PROJECT ORGUNIT PERSON Contact Event Prize/Award Results Publication General Facility Skills Results Patent Particular Equipment CV Service Results Product Funding Programme Classification Anne Asserson Research Administration Department,UiB
Secondary Base Entities: example:RESULT_PUBLICATION PROJECT ORGUNIT PERSON Result_Publication Can Express: (where DT-date/time) Person A (DT1 - DT2) (is author of) Publication X Orgunit O (DT1 - DT2) (is owner of IPR in) Publication X Person A (DT1 - DT2) (is employee of ) Orgunit O Person A (DT1 - DT2) (is project leader of) Project P Person A (DT1-DT2) (is member of) Orgunit M Person A (DT1-DT2) (is member of) Orgunit N Orgunit M (DT1-DT2) (is part of) Orgunit O Orgunit N (DT1-DT2) (is part of) Orgunit O Anne Asserson Research Administration Department,UiB
National system for the four universities • Funded and owned by the universities • Central database • Based on CERIF (with extensions) • 300,000 records in 2006 • In production use for 1 year Anne Asserson Research Administration Department,UiB
Structure of Presentation • Ministry Model for Assessing Research Output • Research Output – Publications • Requirements of a CRIS in this context • System Solution • Evaluation of Output • Ensuring Quality • Conclusion Anne Asserson Research Administration Department,UiB
A publications is divided in author and institutional parts within co-authoring Anne Asserson Research Administration Department,UiB
We find Academic Publications in the intersection between Publications Channel and Publication Form. Channel Eexample: scientific article in Nature orscientific monografi atAschehoug forlag Form Anne Asserson Research Administration Department,UiB
Level 1 and Level 2 • At level 2 there are specified certain publication channels within all subjects.Level 2 are expressing the desirable direction for the publication pattern. • Level 1 is the ”normal” and includes all publishing according to the definition. Anne Asserson Research Administration Department,UiB
Level 2: ca. 1/5 of the publications Level 1: ca. 4/5 of the publications Anne Asserson Research Administration Department,UiB
Guidelines for nomination at level 2 In general the publication channel must be • Considered as leading within broader scientific community • Publish the most important publications for researchers from different countries Anne Asserson Research Administration Department,UiB
Structure of Presentation • Ministry Model for Assessing Research Output • Research Output – Publications • Requirements of a CRIS in this context • System Solution • Evaluation of Output • Ensuring Quality • Conclusion Anne Asserson Research Administration Department,UiB
Quality • Import of ISI records • Problem: person and organisational unit not connected • Routines and responsibility for quality assurance • Researchers • Organisational unit • Researcher as end-user validates records Anne Asserson Research Administration Department,UiB
Bibliographical sources • ISI-indexes will cover 62 % of all journal articles. • Norart can cover further 32% of the articles by adjusting the application and by Nordic cooperation. • Bibsys could possible cover 70-80% of book publishing Anne Asserson Research Administration Department,UiB
Anne Asserson Research Administration Department,UiB
Structure of Presentation • Ministry Model for Assessing Research Output • Research Output – Publications • Requirements of a CRIS in this context • System Solution • Evaluation of Output • Ensuring Quality • Conclusion Anne Asserson Research Administration Department,UiB
Quality • Using selected publication channels, not only publication volume, gives quality • Requirements of System • Cannot be done by a library system • Requires a flexible structured CRIS Anne Asserson Research Administration Department,UiB