1 / 11

Toward an Open Source Textual Entailment Platform (Excitement Project)

The Excitement Project aims to create an open-source platform for multilingual textual entailment. Launched in January 2012, this three-year initiative, backed by 3.5M€ in funding, brings together academic and industrial partners to develop an innovative architecture for textual inference. Leveraging various entailment mechanisms and integration of external language analysis tools, the platform aspires to enhance customer interaction analytics, improve efficiency, and support the reusability of components. The project will culminate in a collaborative scientific effort showcased at the STS Workshop in NYC in March 2012.

brenna
Télécharger la présentation

Toward an Open Source Textual Entailment Platform (Excitement Project)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Toward an Open Source Textual Entailment Platform (Excitement Project) Bernardo Magnini (on behalf of the Excitement consortium) STS workshop, NYC March 12-13 2012

  2. Excitement Project • EXploring Customer Interactions through Textual EntailMENT • Started 1/1/2012; Duration 3 years, 3,5M € funding • Academic partners • Bar-Ilan University, Ramat Gan, Israel (I. Dagan) • DFKI, Saarbrücken, Germany (G. Neumann) • Fondazione Bruno Kessler, Povo, Italy (B. Magnini) • University of Heidelberg, Germany (S. Pado) • Industrial partners • NICE, Ra'anana, Israel (English analytics provider, coordinator) • German company (OMQ, German IT support company) • AlmaViva, Roma, Italy (Italian analytics provider) STS workshop, NYC March 12-13 2012

  3. Scientific objectives • Scientific goal: Develop and advance a “MOSES-style” platform for multi-lingual textual inference • A Generic Multilingual Architecture for Component-Based Textual Entailment • Algorithmic Progress in Textual Inference • An open-source multi-lingual textual entailment platform STS workshop, NYC March 12-13 2012

  4. Application to Customer interaction analytics Exploration graphs STS workshop, NYC March 12-13 2012

  5. Excitement Platform: Desiderata • Dual goal: OS Platform + Industrial Application • Open Source Platform: Generality • Easy integration of external language analysis tools • Accommodate as many entailment mechanisms as possible • Reusability of components • Convince end users to use the platform • Industrial Application: Efficiency • Flexible mapping of application tasks onto “core” entailment • Practical integration into industrial architectures STS workshop, NYC March 12-13 2012

  6. The Excitement Open Source TE Platform Linguistic Analysis Core Engine Entailment Decision Algorithm (EDA) entailment/ contradiction/ unknown Input Data Analysis Dynamic Components (Algorithms) Static Components (Resources) Pretrained entailment models Common Library Machine Learning, Search, Evaluation Data RTE and task-specific datasets

  7. Terminology • Platform: everything together • Entailment engine: configured instantiation of platform • Linguistic analysis:Linguistic analysis tool chain (tagger, NER, parser, …) • Core engine: Entailment Decision Algorithm + Components • Entailment Decision Algorithm: {H,T} -> Decision • Component:Everything (re-)usable by an EDA or another component

  8. Instantiation example:Stanford-style Entailment Parsing • EDA • First, compute word alignment • Second, compute match features • Third, weighted sum of features Dependency trees entailment/ unknown Component 3 Semanticmatch features Component 1 Word Alignment Component 2 Syntactic match features … WordNet Distr. similarity

  9. Instantiation Example:“EDITS-style” EDA(without rules) EDA Linear combination of scores Raw text entailment/ unknown 0.7 0.5 0.99 Component 1 compute all-word overlap Component 2 compute content-word overlap Component 3compute edit distance

  10. Req. 1a: Data model / file formats • “Low overhead”: CoNLL shared task format • column-based plain text format • extensible with new columns, but messy (?) • No data model • “High overhead”: UIMA CAS (Common Analysis Structure) • one graph; stand-off; support for meta-data information (Req. 1d) • data model + XML serialization (XMI) • backed by IBM and the Apache foundation • Java API; existing wrappers for a number of NLP software packages

  11. From TE to Textual Inferences Linguistic Analysis Core Engine Textual Inference Decision Algorithm Textual inference: Equivalence (similarity) Entailment Contradiction Causality Temporal relation Input Data Analysis Dynamic Components (Algorithms) Static Components (Resources) Pretrained inference models Common Library Machine Learning, Search, Evaluation Data RTE and task-specific datasets

More Related