200 likes | 282 Vues
This resource addresses the challenges of measuring scholarly productivity among faculty in higher education institutions. It discusses the use of a comprehensive database to evaluate productivity and benchmark against peers. The database includes various metrics such as books, journal articles, citations, honors, and grants. Academic Analytics benefits institutions by providing valuable insights into faculty productivity and peer comparisons. Explore how this tool can enhance evaluation processes for scholarly output.
E N D
Academic Analytics:Obtaining Benchmarks for Faculty ProductivityCarol Livingstone Division of Management Informationwww.dmi.illinois.edulivngstn@illinois.edu333-3551
The Problem: How to Evaluate Scholarly Productivity • Very few good measures • G & C – dollars/numbers • College/dept collections of publication and awards data • Anecdotal evidence from faculty search and outside offer processes
The Problem: How to Evaluate Scholarly Productivity • No easy benchmarks/peer comparisons • No campus-wide database for vita info - publications and awards
Overview of Academic Analytics • AA has compiled a massive database of journal articles, books, chapters, grants, honors, awards, etc. • The scholarly output is matched by name with faculty and researchers at schools nationwide • The database can be used to quantify scholarly output at any university – by discipline – and compare it to peers
AA Database contents - Measures • Books • Honorific awards • Journal Articles • Citations • Grants
Database Scope • 9,874 PhD programs • 385 institutions, 170,000+ faculty • 172 disciplines in 11 broad fields • 22 AAU institutions actively participate, 30 others considering
Book Variables • 56,000 authored & edited books (Baker & Taylor, Library of Congress, British Library) • Books per faculty member • # Faculty who published a book • % of faculty with a book • Total number of books
JournalArticleVariables • 1 million+ articles (journals, and conference proceedings) • Articles per author • Articles per faculty member • # Faculty with an article • % of Faculty with an article • Total number of articles
Citations • 10 million + Citations (Scopus & Proquest) • Citations per author • Citations per article • Citations per faculty member • # Faculty with a citation • % of Faculty with a citation • Total number of citations
Honorific Awards • 395 awarding bodies, 2700+ award types • Awards per faculty member • # Faculty with an award • % of Faculty with an award • Total number of awards
Grants Variables • 95,000+ federal research grants • Dollars per Grant • Grant dollars per faculty member • # of Faculty with a grant • % of Faculty with a grant • Total Grant dollars • Total number of grants
Academic Analytics AAU Clients Cornell Duke Emory Iowa State Johns Hopkins MIT Ohio State SUNY - Stony Brook Texas A & M Chicago Colorado Kansas Missouri - Columbia Missouri - Kansas City North Carolina Pittsburgh USC Wisconsin - Madison Vanderbilt Wash U - St. Louis
Where we are • Summer, 2011 – 3 yr contract signed • Fall, 2011 - Steering team commissioned • 30 users have been authorized • Fall, 2009 faculty data available through web dashboard • Fall, 2010 faculty lists are being processed
Academic Analytics Output • Summary data by department or broad disciplinary area (not by faculty member) • Comparisons to selected peers • Access to entire scrubbed database • Analytical tools through a dashboard interface
Steering Committee Goals • Refine faculty selection process/criteria • Oversee rollout to college/dept staff • Evaluate tool