220 likes | 362 Vues
This document presents the framework for conducting 3D video tests using MPEG technology, led by Vittorio Baroncini from Fondazione Ugo Bordoni. It outlines test scenarios based on 2-view and 3-view configurations, including requirements for video data sets and depth maps. The proposal schedule is detailed from draft calls through to the final registration deadlines. It includes the introduction of subjective testing methods, scenarios for AVC and HEVC compatibility, and outlines the logistics for file submissions in various test categories. It also discusses display technologies utilized in testing.
E N D
“3D test activities in MPEG” Vittorio Baroncini Fondazione Ugo Bordoni Rome Italy Vittorio Baroncini VQEG - June 2011
3DV • 3 D Video for multi - view source material • Compression • Stereo views synthesis from: • 2 views • 3 views • 3D active display • Auto - stereo display Vittorio Baroncini VQEG - June 2011
Schedule 2011/01/28: Draft Call for Proposals (public) 2011/03/25: Final Call for Proposals 2011/03/25: Formal registration opens 2011/06/15: Formal registration period ends 2011/09/01: Test material @ test sites 2011/10/01: Subjective test starts 2011/11/21: Data processing and report 2011/11/26: Results to 98th MPEG meeting Vittorio Baroncini VQEG - June 2011
Video data sets Video data sets have: • Linear camera arrangement & rectified • Progressively scanned • 4:2:0 color sampling (8 bits per sample) • Depth data, Camera parameters for view synthesis and rendering are provided • Depth maps have the same pixel resolution and bit - depth as the video data • Other depth maps NOT permitted as additional input to the encoder Vittorio Baroncini VQEG - June 2011
Source video material (preliminary) Test Classes Class A:(1920x1088, progressive, 25fps)"Poznan_Street", "Poznan_Hall2", "Undo_Dancer", "GT_Fly" Class C:(1024x768, progressive, 30fps)"Kendo", "Balloons", "Lovebird1", “Newspaper" Vittorio Baroncini VQEG - June 2011
Test Scenarios and Categories Test Scenarios 2 - view: refers to the 2 - view input configuration 3 - view: refers to the 3 - view input configuration Test Categories AVC - Compatible:submissions in which the compressed data format satisfy the requirement on forward compatibility with AVC [5] HEVC - Compatible & Unconstrained:submissions in which the compressed data formats satisfy the requirement on forward compatibility with HEVC, or …submissions without any compatibility constraints Submissions • either or both of the test categories. • for each test category: all test classes and test scenarios for all rate points Vittorio Baroncini VQEG - June 2011
Coding conditions AVC - compatible Vittorio Baroncini VQEG - June 2011
Coding conditions HEVC - compatible & unconstrained Vittorio Baroncini VQEG - June 2011
Input Views Vittorio Baroncini VQEG - June 2011
Ouput data(synthesized output views from 2 view) Vittorio Baroncini VQEG - June 2011
Ouput data(synthesized output views from 3 view) Vittorio Baroncini VQEG - June 2011
Ouput data(synthesized output views from 3 view) Vittorio Baroncini VQEG - June 2011
Coded test material submission Deadline: 2011 Sept. 1 (17:00 CET) Files to be provided: • Bitstreams • Decoded and synthesized sequences • Binary decoder executable. • Checksum files Vittorio Baroncini VQEG - June 2011
Decoded and synthesized sequences • 33 views for S01-S06 • 49 views for S07-S08 • 2-view test scenario (stereo display):package the stereo pair as a single AVI file (separate YUV files must be provided) • 3-view test scenario (stereo display):(separate YUV files must be provided) one fixed stereo pair and one randomly selected stereo pair will be evaluated • fixed stereo pair: centre stereo pair • randomly selected stereo pair: (test coordinator) • selection of the stereo pair • production of the AVI file (from the provided YUV files) • 3-view test scenario (auto-stereo display):test facilities will package 28 views from the provided views Vittorio Baroncini VQEG - June 2011
Logistics 2 - view case requires for each test point Output = 6 files for each test point • 3 video files • 3 depth maps • 1 stereo AVI file 3 - view case requires for each test point Output = 21 files for each test point • 17 (views) YUV video files • 3 depth maps • 1 stereo AVI file Another stereo AVI file is derived from two synthesized files after a random selection of the centre view Vittorio Baroncini VQEG - June 2011
SRC video material 2 view: original views are available Source stereo AVI file can be produced 3 - view: views are all synthesized Source stereo AVI file cannot be produced Solution: SRC AVI files: non compressed synthesized (or original) input files Vittorio Baroncini VQEG - June 2011
Test method Stereo SRC video files available: Double Stimulus (RCR) test method Stereo SRC video files not available : Single Stimulus (ACR) test method VQEG activity shows that SS methods provide similar results compared to DS methods Time and resources Vittorio Baroncini VQEG - June 2011
Video test player Window Media Player (old version) Simple scripts Video clips with messages Shift parameters: t.b.d. Vittorio Baroncini VQEG - June 2011
Display • Stereo monitor: Hyundai 46” (passive glasses) Model: S465D • Auto-stereo monitor:Dimenco 52” (no glasses)Model: BDL5231V3D Vittorio Baroncini VQEG - June 2011
Subjects & results reliability • Pre - screening • Stereo vision check • Fatigue measurement • Possible solutions: • Involve many laboratories • Few test sessions for each laboratory • Redundant sessions Vittorio Baroncini VQEG - June 2011
Independent Laboratory Group • Three areas (Region 1, 2 and 3) • Two/three laboratories for each Region • Current support received from: • Region 1: UBC, CRC • Region 2: EPFL, ACREO, Nantes, TUM, … • Region 3: Yonsei • Volunteers welcome … Vittorio Baroncini VQEG - June 2011
So what … What MPEG offers • Become member of the ILG • Get a (modest) financial support What MPEG needs • your experience testing “best practice” • which could be the best test method? • support in logistics • test site features and availability • 3D “test oriented” player Vittorio Baroncini VQEG - June 2011