1 / 4

Multilingual Link Detection Evaluation - 2000 Results Analysis

A summary of the TDT Link Detection Task results conducted by NIST Speech Group, focusing on multilingual text evaluation and test set composition. Insights on story pairing, selection methods, and key findings from the University of Massachusetts System.

kermit-slater
Télécharger la présentation

Multilingual Link Detection Evaluation - 2000 Results Analysis

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TDT2000 Link Detection Evaluation Results Jonathan Fiscus and George Doddington

  2. TDT Link Detection Task One Participant: University of Massachusetts System Goal: • To detect whether a pair of stories discuss the same topic. (Can be thought of as a “primitive operator” to build a variety of applications) ? NIST Speech Group

  3. 2000 Link Detection Results • A lot was learned last year: • The test set must be properly sampled • “Linked” story pairs were selected by randomly sampling all possible on-topic story pairs • “Unlinked” pairs were selected using all on-topic stories as one of the pair, and a randomly chosen story was chosen as the second • This year, the task was made multilingual • More story pairs were used Link Detection Test Set Composition

  4. Link Detection Results • Required Condition • Multilingual texts • Newswire + Broadcast News ASR, • Reference story boundaries • 10 file decision deferral Overall

More Related