1 / 48

Cross-Layer Error Resilient Mechanism in Scalable Video Coding

Cross-Layer Error Resilient Mechanism in Scalable Video Coding. Authors: Shu-Jhen Fan Jiang, Chia -Hung Yeh and Mei-Juan Chen Presenter: Shu-Jhen Fan Jiang National Sun Yat-Sen University, and National Dong- Hua University, Taiwan. Outline. Introduction Previous work

jack
Télécharger la présentation

Cross-Layer Error Resilient Mechanism in Scalable Video Coding

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Cross-Layer Error Resilient Mechanism in Scalable Video Coding Authors: Shu-Jhen Fan Jiang, Chia-Hung Yeh and Mei-Juan Chen Presenter: Shu-Jhen Fan Jiang National Sun Yat-Sen University, and National Dong-Hua University, Taiwan

  2. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

  3. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

  4. Scalable Video Coding (SVC)

  5. Architecture of SVC

  6. Inter-Layer Prediction • Inter-layer motion prediction • Inter-layer intra prediction • Inter-layer residual prediction

  7. Inter-Layer Motion Prediction

  8. Inter-Layer Intra Prediction

  9. Inter-Layer Residual Prediction

  10. Error Concealment and Error Resilience • Error concealment • Error resilience

  11. Whole Frame Loss in Base Layer Error Concealment Algorithm – Frame Copy

  12. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

  13. Previous work • Reversible data embedding [1] • High quality • Explore the redundancy in digital content to achieve reversibility • Error resilience algorithm [2] • Adopt reversible data embedding technique in H.264 • [1] J. Tian, “Reversible data embedding using a difference expansion,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, No. 8, pp. 890 – 896, August 2003 • [2] W.-N. Lie, T. C.-I. Lin, D.-C. Tsai and G.-S. Lin, “Error resilient coding based on reversible data embedding technique for H.264/AVC,” in Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1174 – 1177, July 2005

  14. Review of Previous Work • Embedding • Extraction

  15. Review of Previous Work • Embedding process • Inter : conceal mode • Intra : index of wavelet coefficient

  16. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

  17. Cross-Layer Error Resilient Mechanism • Recover whole frame loss in base layer • Reduce the distortion of inter-layer prediction • Protect 2 coding rules in SVC • Inter-layer intra prediction • Embed the wavelet coefficient of base layer • Inter-layer motion prediction • Embed the motion vectors of base layer

  18. Inter-Layer Intra Prediction • Embedding process • 8 bits - band 0 • 1 or 4 bits - band 1 to 6

  19. Inter-Layer Motion Prediction • Encoder • Embed 6 bits for each horizontal or vertical MV • 5 bits - half pixel precision MV • 1 bit - significant bit • Embed 2 bits for each 4×4 block

  20. Flowchart of Proposed Algorithm at the Encoder Side

  21. Flowchart of Proposed Algorithm at the Decoder Side

  22. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

  23. Simulation Settings • Parameter setting in JSVM9.12

  24. Objective Comparison

  25. Objective Comparison

  26. Objective Comparison

  27. Objective Comparison

  28. Subjective Comparison PLR = 10 % Frame copy PSNR = 29.75 dB Proposed PSNR = 32.96 dB

  29. Subjective Comparison PLR = 10 % Lost frame: 154th Current frame: 154th Frame copy PSNR = 20.61 dB Proposed PSNR = 32.27 dB

  30. Subjective Comparison PLR = 10 % Frame copy PSNR = 27.01 dB Proposed PSNR = 30.40 dB

  31. Subjective Comparison PLR = 5 % Lost frame: 19th Current frame: 19th Frame copy PSNR = 20.66 dB Proposed PSNR = 29.20 dB

  32. Subjective Comparison PLR = 5 % Frame copy PSNR = 15.38 dB Proposed PSNR = 24.26 dB

  33. Subjective Comparison PLR = 5 % Lost frame: 48th Current frame: 42th Frame copy PSNR = 14.78 dB Proposed PSNR = 26.50 dB

  34. Outline • Introduction • Previous work • Cross-layer error resilient mechanism • Experimental results • Conclusions

  35. Conclusion • A new algorithm is proposed to reduce the distortion of inter-layer prediction when the whole frame is lost in lower layer • Experimental results show that a PSNR improvement is 6.76 dB in average and the maximum improvement is up to 10.28 dB when packet loss rate is equal to 20%.

  36. Thank you for your attention!

  37. Bitrate Analysis – 2-Layer

  38. Training Wavelet Coefficient Akiyo, City, Football, and Foreman Bus, Mobile, and Table

  39. Subjective Comparison – 3-Layer PLR = 5 % Lost frame: 400th, Layer 0 Current frame: 400th, Layer 2 Error free (43.72dB) Frame Copy (19.31dB) Proposed (33.01dB)

  40. Error Resilient Mechanism for Multiple Layer • Inter-layer intra prediction • Embed the index of wavelet coefficient of lower layer • Inter-layer motion prediction • Embed the MV difference between the two lower layers

  41. Objective Comparison – 3-Layer

  42. Objective Comparison – 3-Layer

  43. Subjective Comparison – 3-Layer PLR = 10 % Frame copy PSNR = 31.96 dB Proposed PSNR = 37.96 dB

  44. Subjective Comparison – 3-Layer PLR = 15 % Frame copy PSNR = 22.51 dB Proposed PSNR = 35.79 dB

  45. Flowchart of Proposed Algorithm at the Encoder Side

  46. Flowchart of Proposed Algorithm at the Decoder Side

  47. Bitrate Analysis – 3-Layer

  48. Subjective Comparison – 3-Layer PLR = 10 % Lost frame: 404th, Layer 0 Current frame: 405th, Layer 2 Error free (38.81dB) Frame Copy (19.04dB) Proposed (34.67dB)

More Related