1 / 31

Vocabulary Matching for Book Indexing Suggestion in Linked Libraries – A Prototype Implementation & Evaluation

Vocabulary Matching for Book Indexing Suggestion in Linked Libraries – A Prototype Implementation & Evaluation. Antoine Isaac , Dirk Kramer, Lourens van der Meij, Shenghui Wang, Stefan Schlobach, Johan Stapel. Problem: subject indexing. Describing subjects of books

Sharon_Dale
Télécharger la présentation

Vocabulary Matching for Book Indexing Suggestion in Linked Libraries – A Prototype Implementation & Evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Vocabulary Matching for Book IndexingSuggestion in Linked Libraries – A PrototypeImplementation & Evaluation Antoine Isaac, Dirk Kramer, Lourens van der Meij, Shenghui Wang, Stefan Schlobach, Johan Stapel

  2. Problem: subject indexing • Describing subjects of books • Using concepts from vocabularies (e.g. thesauri)

  3. Problem: re-indexing • Describing a book that has already be described • With a new vocabulary • Fitting a different context (e.g., different libraries)

  4. Why re-indexing at KB? • The Dutch National Library (KB) holds many books that are also in other Dutch public libraries • KB deposit uses Brinkman thesaurus for indexing • Public Libraries use Biblion thesaurus

  5. A wider issue • KB shares books with many other libraries • All having their own description practices

  6. Room for improvement? • Libraries devote large resources to indexing • 20 people at KB • About 20,000 books per year • Leveraging already existing descriptions for re-indexing can be beneficial for both sides

  7. Alignment and re-indexing • STITCH project • Tackling semantic interoperability in Cultural Heritage • Using ontology alignment • Mappings between concepts from different vocabularies can be used for re-indexing Basic idea: replace concepts in descriptions by conceptually equivalent concepts

  8. Goal: a re-indexing prototype • Past: preliminary experiments with KB data • Now: building a prototype and • plugging it onto the KB production system • having it evaluated by its potential users (indexers) • Prototype case: Dutch public libraries / KB Suggesting Brinkman subjects based on Biblion ones

  9. Alignment and re-indexing: requirements Subjects can be complex • Mappings between groups of concepts "Travel guides" + "Spain" → "Spain; travel guides" Concepts are used in descriptions • Mappings taking into account extensional semantics "Building engineering" → "Learning material ; building engineering"

  10. Obtaining re-indexing rules • Lexical alignments are not good enough • Probabilistic rules are calculated • Using extension of concepts: existing indexing • Simple probabilities, with adhoc adjustment "Travel guides","Spain"→"Spain; travel guides", 0.982 • Not only based on Biblion subjects • AUT – main authors of books • KAR – “characteristic” • DGP – intellectual level/target group

  11. Demo Doesn't work?

  12. User study • Quantitative aspect • How well does the tool compare to human subject indexing? • Qualitative aspect • User satisfaction • Improvement suggestion

  13. Evaluation setting • 6 indexers • 6 weeks • 284 books • Evaluation integrated in daily indexing work • Pre-evaluation briefing • Questionnaire during evaluation • Post-evaluation de-briefing & questionnaire

  14. User study results • Top ranked mappings are indeed much better • Individual book satisfaction level > 70%

  15. User study results (1) • But the general satisfaction is lower • Only two out of six would use the tool as such • Quality of suggestions • Lower-level suggestions are often not meaningful • Perception of suggestions' quality • Long lists with wrong suggestions ad the end are bad • Ranking is appreciated, but it is not enough

  16. User study results (2) Suggestions were found promising • Bridging the indexing gap between collections • Different indexing strategies "Persian language" (Biblion) vs. "Iranian language and literature" (Brinkman) Lots of suggestions for improvement • More re-indexing! • Suggesting concepts from other vocabularies • More context metadata as input

  17. Conclusions • Shows the potential of re-using data in a library network • Alignment approach fitting indexing practice • Concrete demonstration, in KB production environment • Technology transfer: KB wants to continue efforts • Flexibility: architecture ready to exploit other vocabularies • Linked data & SKOS

  18. Prototype components

  19. Linked libraries?

  20. Thank you! • Questions?

  21. Screenshots

  22. WinIBW production tool

  23. STITCH suggestion tool

  24. Original metadata

  25. Concept suggestions

  26. Comparing with human re-indexing

  27. Complement: lexical alignments

  28. Adding subjects using thesaurus access

  29. Concept suggestions

  30. Saving and back to WinIBW

  31. Screenshots • Back

More Related