1 / 18

Results of 3D View Synthesis Experiments Using Semi-Automatic Depth Exploration Methods

This paper details the experiments conducted on 3D view synthesis utilizing semi-automatic depth estimation methods. The results indicate that semi-automatic DERS methods outperform automatic ones, though further key frames are needed for enhanced quality. Depth maps were assessed across three frames, demonstrating that half-pixel precision yields improved performance over pixel and quarter-pixel methods. Quality evaluation indicates that the synthesized view’s quality is more dependent on the image compression quality than on depth map accuracy. The findings highlight the significance of quantization parameters on the synthesized view's PSNR.

fathi
Télécharger la présentation

Results of 3D View Synthesis Experiments Using Semi-Automatic Depth Exploration Methods

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. M17051 - Newspaper sequence - Results of 3DV/FTV Exploration Experiments with depths and view synthesis. Krzysztof KlimaszewskiOlgierd StankiewiczKrzysztof Wegnerteam supervisor: Marek Domański Chair of Multimedia Telecommunications and MicroelectronicsPoznań University of Technology, Poland October, 2009, Xi’an

  2. EE1 • ‘Newspaper’ sequence • Recommended settings • Semiautomatic DERS5.0 + VSRS3.5 • Half-pixel • new manual information for key frames • Smoothing coefficient 1.0-4.0

  3. Background – wrong depth M16756 - Results of Exploration Experiments

  4. new MDM file Frame 100 Frame 200

  5. new MEM file Frame 100 Frame 200

  6. Synthesis results - comparison

  7. Best results • Half-pixel precisionis 0.3dB betterthan pixel precisionwhich is 0.2dB betterthan quarter-pixel-precision • Results aresubjectively better

  8. Depth map obtained for frame 0, 100, 200

  9. Conclussions • Semi-automatic DERS is better than automatic DERS • Still more key frames is needed to achieve better quality

  10. EE 4 • JMVM 5.0.6 • GOP length was set to 16 • Targeted bitrates 0.75, 1.5, 3, 6 Mbps for 2 view case • QP – Quantization index for views • QD – Quantization index for depth maps M16756 - Results of Exploration Experiments

  11. Quantization parameters • Selected QP and QD indexespairswhichmeettargetedbitrate

  12. Results – 750 kbps

  13. Results - PSNR

  14. Results – PSNR without outer

  15. Results – PSPNR temporal

  16. Results – PSPNR spatial

  17. Results - summary

  18. Summary • Quality of synthesized view depends more on quality of compressed/decompressed image (QP parameter) than on quality of compressed/decompressed depth (QD). • The usual approach of choosing the minimal QP does not give the best results in some cases, but the differences of quality measures are neglible. • When quality of synthesized view is calculated with original view as a reference, no quality improvement is observed when increasing bitrate from 3 Mbps to 6Mbps in terms of PSNR, PSNR (pspnr) and PSPNR. • Quality of synthesized views (PSNR as well as PSPNR) increases, when measured with reference synthesized from uncompressed data in the similar way as for 2D sequences – approximately constant increase of quality for increase of bitrate by a factor of two.

More Related