1 / 8

Speech Degradation Evaluation and Classification Study

Subjective tests and results on scaled speech degradation, comparing different network traces and playout algorithms. Objective ratings provided based on sensitivity and participant feedback. Detailed scoring system for degradation categories and absolute quality. Evaluation of various loss rates and MOS scores with different TCP window sizes and algorithms.

clinton-sullivan
Télécharger la présentation

Speech Degradation Evaluation and Classification Study

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Subjective Tests Results

  2. Degradation Category Rating of Scaled Speech • Three short network traces with different jitter statistics • Six samples are simulated over each trace; Samples are given and evaluated in pairs, in the format of “reference sample – processed sample” to provide higher sensitivity • Eleven people participated the tests so far • Score for each condition is obtained by averaging 6x11 ratings

  3. DCR Results 5 Degradation is inaudible                          4 Degradation is audible but not annoying 3 Degradation is slightly annoying               2 Degradation is annoying                          1 Degradation is very annoying                 

  4. Absolute Category Rating • Four network traces with different jitter/loss statistics • Four samples are simulated over each trace using two different playout scheduling algorithms (4x2 conditions) • Score for each condition is obtained by averaging all the ratings

  5. ACR Results Quality ScoreExcellent      5 Good           4 Fair             3 Poor            2 Bad             1 Late Loss Rate (%) 8.5/2.8 5.0/0 2.6/0.3 5.1/1.1 Link Loss Rate (%) 0 8.6 0 0 Burst Loss Rate (%) 6.0/0.7 4.1/0 0.6/0 3.9/0

  6. Traces and MOS Scores

  7. Playout Algorithms and TCP Window Size Control

  8. Different Algorithms with Different TCP Window Size Window Size =4 Window Size =32 Alg. 2 Alg. 3

More Related