50 likes | 53 Vues
The Reviewing Process Marie desJardins AAAI-13 Panel Conference Reviewing Best Practices. Conference Reviewing. Program committees Selection process Different models/roles: Senior vs. area chair vs. regular members Paper assignments Keyword-based
E N D
The Reviewing ProcessMarie desJardinsAAAI-13 PanelConference Reviewing Best Practices
Conference Reviewing • Program committees • Selection process • Different models/roles: • Senior vs. area chair vs. regular members • Paper assignments • Keyword-based • Similarity-based (compare to reviewer’s published papers) • Self-selection (bidding) • Discussion and author response • Decisions Review Process and Quality
Purpose of a Review • Evaluate the paper’s scientific merit • Check the validity of the paper’s claims and evidence • Judge the paper’s relevance and significance • Provide constructive feedback to the author Review Process and Quality
AAAI-13 Review Criteria • Goal: identify “interesting but flawed” papers and make sure they are reviewed fairly • Different ways in which a paper can make a contribution • Avoid a conference full of “technically acceptable but uninteresting and incremental” papers • Quality criteria: • Technical quality • Experimental analysis • Formal analysis • Clarity/presentation • Innovation criteria: • Novelty/innovation of question / solution • Impact criteria: • Breadth of interest • Potential for impact Review Process and Quality
Good Reviews Are... • Polite • Fair • Concise • Clear • Constructive • Specific • Well documented • Represent the scientific community Review Process and Quality