1 / 9

Enhancing Non-Verbal Communication in Card Game Interaction Using NLP

This project explores the development of a simple embodied dialog system designed for social interactions during the Italian card game Briscola. Focusing on the selection of non-verbal behaviors such as gestures and gazes, our approach incorporates a discourse model for coreference resolution, enhancing dialogue coherence. We utilize various NLP techniques including tokenization, part-of-speech tagging, and syntax analysis. Future directions include refining the discourse model and incorporating advanced heuristics for non-verbal cues. Join us in uncovering the complexity of human-like interactions in virtual environments.

eadoin
Télécharger la présentation

Enhancing Non-Verbal Communication in Card Game Interaction Using NLP

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Simple Embodied Dialog SystemNLP Final Project Angelo Cafaro1 and Lorenzo Scagnetti2 1angelo08@ru.is Center for Analysis and Design of Intelligent Agents (CADIA)School of Computer Science, Reykjavik University – Iceland 2lorenzos10@ru.is University of Camerino – Italy

  2. Scenario and Goals • Scenario: • People playing a Card Game in a bar: • Briscola: Italian card game; • Conversation during the game: chat; • Goals Selection of Non-VerbalBehavior chatting: • Set of Gestures; • Gazes;

  3. Approach (cont.)

  4. Approach (2 – cont.) • SituationalContext: • Discourse Model with Simple coreference resolution: • New and Evoked Discourse Entities; • KnowledgeBase (objects and characters in the scene); • Steps: • Tokenization; • Pos Tagging (Penn TreeBank PoS tagset); • SyntaxAnalysis (Noun Phrases, Verb Phrases and Pr eposition Phrases); • Coreference Resolution (Markers NEW and EVOKED Discourse Entities); • Information Structure: Rhematic and Thematic Part; • Heuristics  BML Output.

  5. Approach (3) • GameEvents: • People in a particular context (card game): • Turn Begin, Card Played, Match Rounds, etc… • Video, Observations and Annotation:

  6. Demo • Joint Project with VirtualEnvironments course. • We apologize…but we still have Work in Progress!!!

  7. Future Directions • Improved Discourse Model: • Gender and Numnber: Advanced Pos Tag set; • New Heuristics; • Selection of additional non-verbalbehaviors: • Facial Expressions; • Eyebrowns; • Postures; • …

  8. Questions ? ? ?

  9. Thanks for listening!!! • AngeloCafaro1 and LorenzoScagnetti2 • 1angelo08@ru.is • Center for Analysis and Design of Intelligent Agents (CADIA)School of Computer Science, Reykjavik University – Iceland • 2lorenzos10@ru.is • University of Camerino – Italy

More Related