20 likes | 147 Vues
In this paper, Diana Maynard from the University of Sheffield discusses the essential criteria for benchmarking textual annotation tools in the context of the Semantic Web. Key criteria include performance, scalability, usability, flexibility, and interoperability, enabling users to make informed decisions when selecting the best tools for their specific needs. The paper also explores the trade-offs between scalability versus response time and performance versus coverage, alongside the requirements of different user groups. Notable tools reviewed include Magpie, KIM, OntoMat, GATE, and MnM.
E N D
Benchmarking Textual Annotation Tools for the Semantic Web Diana Maynard University of Sheffield, UK • Motivation • Criteria for benchmarking should include not just performance but also • scalability • usability • flexibility • interoperability • in order for users to make an informed decision about the best product for their needs. Requirements Requirements for different users Results Tradeoffs: 1. Scalability vs response time 2. Performance vs coverage Suitable tools for different users Tools Magpie KIM OntoMat GATE MnM