Implementation and comparison study of H.264 and AVS china EE 5359 Multimedia Processing Spring 2012 Guidance : Prof K R

1. Implementation and comparison study of H.264 and AVS chinaEE 5359 Multimedia ProcessingSpring 2012Guidance : Prof K R Rao Pavan Kumar Reddy Gajjala 1000769393 Pavankumar.gajjala@mavs.uta.edu

2. Project Objective • The project is based on implementation and comparison of H.264 high profile with AVS CHINA (part 2) video codec in terms of MSE (Mean Square Error), PSNR (Power to Signal Noise Ratio) and SSIM (Structural Similarity Index Metric), for various video test sequences and compares their bit rates also. • The motivation behind developing this project is, with introduction of several new standards for video compression there is a need to evaluate the performances and compare them among the available video coding standards .Currently the video coding standards that are evaluated are H.264 and AVS China.

3. Overview of H.264 • H.264 or MPEG-4 part 10: AVC [4] is the next generation video codec developed by MPEG of ISO/IEC and VCEG of ITU-T, together known as the JVT (Joint Video Team). The H.264/MPEG-4 AVC standard, like previous standards, is based on motion compensated transform coding method. • H.264 also uses hybrid block based video compression techniques such as transformation for reduction of spatial correlation, quantization for bit-rate control, motion compensated prediction for reduction of temporal correlation and entropy coding for reduction in statistical correlation Fig 1.1 shows the H.264 encoder block diagram and Fig 1.2 shows the H.264 decoder block diagram.

4. Fig. 1.1: H.264 encoder block diagram [4]

5. Fig. 1.2: H.264 decoder block diagram [4]

6. H.264/AVC profiles • H.264 standard [1]is defined with a large variety of coding tools. This is done to make sure that standard caters to all classes of applications. • However, not all tools are required for a particular application. So, the coding tools are segregated into different groups called profiles. The basic profiles defined in the standard are shown in Fig. 2

7. Fig. 2: Profile structure in H.264 [4]

8. AVS China • AVS China is the compression standard of China which is also known as Audio video coding standard, developed with a target to develop same compression efficiency to H.264 but with lower computational complexity for SD(Standard Definition) and HD( High Definition)Videos. • AVS Adopts the Classical block based prediction with transform coding framework. There are several parts developed with AVS china. [8] Table .1 describes the various parts of AVS China.

9. Fig 3: H.264 Encoder block diagram with unified loop Fig 3: H.264 Encoder block diagram with unified loop filter.[2] Table 1:Various parts of AVS China. [7]

10. The AVS China part 2 is one of the earliest and most important part of the AVS standard used in applications mainly used for HD broadcasting, high density storage media, video surveillances and video on demand. • To acquire better tradeoff between coding efficiency and computational complexity advance coding tools intra and inter prediction tools, transform, quantization, entropy coding and de-blocking filter are adopted by AVS1-P2 (Part 2) [8]. • The encoder and decoder architecture of AVS China are described in fig 3.1 and fig 3.2.

11. Fig. 3.1:AVS China Encoder Block Diagram [7]

12. Fig. 3.2 : AVS China Decoder Block Diagram [7]

13. Interim results • Codec used: AVS china (RM09.12 reference software used) • Test video sequence: Akiyo_qcif.yuv Format: 4:2:0 | Width: 176 | Height: 144 | Total Frames: 300 | Frames Encoded: 50 | Average MSE: 10.21856 | Average SSIM: 0.96451 |Average PSNR: 38.03691| Encoding time: 93.38sec | Decoding time: 1.9sec |Bit rate (Kbits/sec) @ 24 Hz: 459.02 • The Original and the encoded video sequence for Akiyo_qcif are shown in Fig 4.1

14. Fig 4.1:Original Video(left) and processed video(right) using AVS china

15. Codec used: H.264(JM 11.0 reference software used) • Test video sequence: Akiyo_qcif.yuv Format: 4:2:0 | Width: 176 | Height: 144 | Total Frames: 300 | Frames Encoded: 50 | Average MSE: 8.30954| Average SSIM: 0.97295|Average PSNR: 38.93503| Encoding time: 253.88sec | Decoding time: 3.056sec |Bit rate (Kbits/sec) @ 30 Hz: 25.93 The Original and the encoded video sequence for Akiyo_qcif are shown in Fig 4.2

16. Fig 4.2:Original Video(left) and processed video(right) using H.264(high profile)

17. Conclusion: Comparing the results for the video sequence akiyo_qcif the encoding time of the AVS china is very less (nearly one third) when compared with H.264 ,although H.264 slightly outperforms AVS china in terms of MSE but overall objective quality of both the encoded videos are similar

18. ACRONYMS AND ABBREVIATIONS • AVC: Advanced Video Coding • CABAC:Context-based Adaptive Binary Arithmetic Coding • CAVLC:Context-based Adaptive Variable Length Coding • DLF:De-blocking Loop Filter • DPB:Decoded Picture Buffer • DVB:Digital Video Broadcasting • FMO:Flexible Macro block Ordering • GOP:Group of Pictures • HD:High Definition • ISO:International Standards Organization • ITU:International Telecommunication Union • JVT:Joint Video Team

19. LMSE: Least Mean Square Error • MC:Motion Compensation • MDCT:Modified Discrete Cosine Transform • ME:Motion Estimation • MPEG: Moving Picture Experts Group • PSNR: Peak Signal to Noise Ratio • RDO:Rate Distortion Optimization • SD:Standard Definition • SI:Switching I • SP:Switching P • SSIM: Structural Similarity Index Metric • VCEG:Video Coding Experts Group

20. References • [1] Kwon Soon-kak, A Tamhankar and K R Rao, “Overview of H.264/MPEG-4 part 10”, 4th EURASIP Conference on Video/Image Processing and Multimedia Communications, vol. 1, pp. 1-51, July 2003. • [2] I. E. Richardson, “The H.264 advance video compression standard”, 2nd Edition, Wiley 2010. • [3]H.264/AVC JM reference software. Website: http://iphome.hhi.de/suehring/tml/download • [4]T. Wiegand, “Overview of the H.264/AVC video coding standard”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, pp. 560-576, Jul 2003. • [5] Z. Wang et al, “Image quality assessment: from error visibility to structural similarity”, IEEE transactions on Image processing, vol. 13, pp 600-612, April 2004. • [6]X. Wang, “Recursive algorithms for linear LMSE estimators under uncertain observations”, IEEE transactions on Automatic control, vol. 29, pp 853-854, Sep 1984. • [7] L. Yu et al, “An Overview of AVS-Video: tools, performance and complexity” , Visual Communications and Image Processing 2005, Proc. of SPIE, vol. 5960, pp 21-28, July 31, 2006. • [8]X. Wang et al, “Performance comparison of AVS and H.264/AVC video coding standards”, J. Computer Science & Technology, vol.21, pp.310-314, May 2006.

21. [9]AVS China part 2 video software, password protected: ftp://124.207.250.92/. • [10]B. Tang et al, “AVS encoder performance and complexity analysis based on mobile video communication”, WRI International conference on Communications and Mobile Computing, CMC ‘09, vol. 3, pp. 102-107,Jan. 2009.