1 / 21

Research indicators to evaluate prestige and impact of authors and institutions

Research indicators to evaluate prestige and impact of authors and institutions. Fereshteh Didegah fdidgah@gmail.com Shahid Beheshti University Webinar February 2014. How to measure research performance?. RESEARCH PRODUCTIVITY Number of research publications RESEARCH IMPACT

hasana
Télécharger la présentation

Research indicators to evaluate prestige and impact of authors and institutions

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Research indicators to evaluate prestige and impact of authors and institutions FereshtehDidegah fdidgah@gmail.com ShahidBeheshti University Webinar February 2014

  2. How to measure research performance? • RESEARCH PRODUCTIVITY Number of research publications • RESEARCH IMPACT Number of citations to publications • ALTERNATIVE METRIC FOR RESEARCH IMPACT Number of downloads, Mendeley readership, F1000 reviews, number of tweets, …

  3. H-index

  4. H-index • H-index, introduced by Jorge Hirsch (2005), is used for author impact; • The h-index is a combined measure of productivity and impact; • An index of h for an author means that the author has received at least h citations to each of h of their publications; • Can also be applied to the productivity and impact of a group of scientists, departments or universities or countries.

  5. Measuring H-index Author (A) H-index : 5

  6. Index advantages • It was published to address the main disadvantages of other bibliometricindicators such as number of publications or number of citations. • “The h-index is much less affected by methodological papers proposing successful new techniques, methods or approximations, which can be extremely highly cited”.

  7. Index advantages • It is hard to manipulate ones own h-index, for example by self citation. It relies on how an author is performing over time.

  8. Index disadvantages • This index is bounded by the total number of publications. • The scientists with a short career are at an inherent disadvantage. “For example, had Albert Einstein died in early 1906, his h-index would be stuck at 4 or 5, despite his being widely acknowledged as one of the most important physicists, even considering only his first four or five publications to that date”.

  9. Index disadvantages • The h-index does not consider the context of citations. For example, citations in a paper are often made only to write up an introduction, otherwise having no other significance to the work, or citations made in a negative context.

  10. Index disadvantages • Two scientists may have the same h-index, say, h = 30, but one has 20 papers that have been cited more than 1000 times and the other has much less citations. Clearly scientific output of the former is more valuable. Several recipes to correct for that have been proposed, such as the g-index, but none has gained universal support.

  11. Index disadvantages • The h-index is not sensitive to highly cited publications and ignores the author’s research activity duration. • Several alternatives (e.g., g-index, a-index, m-index, h(2)-index) have been published to compensate for h-index weaknesses.

  12. H-index value • Jorge Hirsch suggests that after 20 years in research, an h-index of 20 is a sign of success; • Different disciplines have different levels! Biologists can have values up to 190.

  13. MNCS (Mean Normalized Citation Score)

  14. Institution research performance • Number of publications and citations • World’s Rankings (Shanghai, Times, ..) • H-index • MNCS

  15. MNCS(Mean Normalized Citation Score) • MNCS, or the new crown indicator, was first published and used to rank world universities by the Centre for Science and Technology Studies (CWTS) of Leiden University. • This indicator is also used to measure country impact (Waltman, et al, 2011) using numbers of publications and citations.

  16. MNCS calculation This indicator controls for the paper subject field and publication year and it is defined as follows: Where: n= The number of an institution’s or a country’s publications in each year (1 …, n publications); ci= The number of citations that publication i had received by 2011; ei= The expected number of citations to publication i based upon its subject field and publication year, using the ESI baseline table for the 22 subject fields.

  17. Calculation example Suppose: An institution has published 5 articles in 2013. Extracted from ESI MNCS = Sum / N MNCS = 3.1

  18. Leiden University World University Ranking

  19. Leiden University Ranking (WORLD – 2013)

  20. Leiden University Ranking (IRAN – 2013)

  21. Thank you for listening!

More Related