1 / 13

Development of an Intelligent Part-of-Speech Tagger for the Venda Language

This paper explores the creation of an intelligent part-of-speech (POS) tagger specifically designed for the Venda language. POS tagging involves assigning labels such as Noun, Verb, and Adjective to words based on their contextual relationships. The paper discusses the development process, user requirements, and implementation tools while addressing the unique diacritics of the Venda language. A prototype tagger, utilizing initial Hidden Markov Models (HMMs), allows users to adjust tags to mitigate ambiguity, supporting usability for diverse academic fields.

asis
Télécharger la présentation

Development of an Intelligent Part-of-Speech Tagger for the Venda Language

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. APPLYING VENDA TEXT TOWARDS THE DEVELOPMENT OF AN INTELLIGENT PARTS-OF-SPEECH TAGGER BY TSHISHONGA AW 2859268 11/04/08 1

  2. Part-of-speech (POS) tagging is the process of assigning words their part of speech tag. A part of speech tag is a label i.e. Noun, Verb , Adjectives, etc. POS is done by looking at the relationship with adjacent words. A simplified form is taught to school children. The Venda language has unique diacritics. INTRODUCTION

  3. THE DEVELOPMENT PROCESS A Venda translator • A parts-of-speech tagger that allows the user to change tags to solve for ambiguity of tags. • Compute initial Hidden Markov Models(HMMs) . • Compute test data Very ambitious A generic tagger Still ambitious Best Solution

  4. R REQUIREMENT ANALYSIS User Requirements • Abney, S. Part-of-speech tagging and partial parsing. • Brill, E. A simple rule-based part-of-speech tagger. • Prez, L. C. IEEE information theory society newsletter. • Samuelsson, C., and Voutilainen, A. Comparing a linguistic and a stochastic tagger. pp. 246–253. • Shannon, C. E. A mathematical theory of communication. Research Prototype

  5. IMPLEMENTATION TOOLS

  6. PROBLEMSWITH THE PROTOTYPE

  7. USER OCCUPATION USER 1 MSc STATS USER 2 BSc Honors USER 3 BSc Microbiology USER 4 UCT MSc Sociology USABILITY TESTING

  8. USABILITY TESTING

  9. USABILITY TESTING 11/04/08 9

  10. USER’S GUIDE First Screen Second Screen File Menu Save a file Exit View Menu Word frequency Count words Edit Word model • File Menu • Open a file • Exit • View Menu • Word frequency • Count words • Edit • Clear • Help

  11. REFERENCES [1] Abney, S. Part-of-speech tagging and partial parsing. In Corpus-Based Methods in Language and Speech (Dordrecht, 1996), K. Church, S. Young, and G. Bloothooft, Eds., Kluwer Academic Publishers. [2] Brill, E. A simple rule-based part-of-speech tagger. In Proceedings of ANLP-92, 3rd Conference on Applied Natural Language Processing(Trento, IT, 1992), pp. 152–155.

  12. REFERENCES [3] Prez, L. C. Ieee information theory society newsletter. ISSN 105 53, 04 (2003), pp1–10. [4] Samuelsson, C., and Voutilainen, A. Comparing a linguistic and a stochastic tagger. In Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics (Morristown, NJ, USA, 1997), Association for Computational Linguistics, pp. 246–253. [5] Shannon, C. E. A mathematical theory of communication. The Bell System Technical (1948), pp1–12.

  13. THE DEMO • Open a file • View User manual • Tagging a file. • Search for multiple occurrences of word. • Insert a diacritic. • Copy and paste. • Save a file • Exit the system

More Related