1 / 49

Understanding Multimedia Systems and Data Processing

Explore the components and functions of multimedia systems, handling both time-independent and time-dependent media streams. Learn about compression, encryption, enhancement, and recognition techniques. Discover the history of bandwidth in computer networks and the network requirements for different data streams.

sai
Télécharger la présentation

Understanding Multimedia Systems and Data Processing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Introduction Tsung-Yi Wu

  2. Introduction • What is a multimedia system? • A multimedia system supports the integrated storage, transmission and representation of the discrete media types text, graphics and image and the continuous media types audio and video on a digital computer.

  3. A Hybrid (analog/digital) Multimedia System • Early multimedia system, around 1985

  4. Digital Multimedia System • The media streams are digital. They can be processed (e.g., compressed/ decompressed,analyzed) in the computer.

  5. Time-Independent Media • Information is not related to timing of the data stream • All „classic“ media in the computer, such as: • text • graphics (line drawings, vector graphic) • image (photo, pixel graphics).

  6. Time-Independent Media • Example [Kitaoka 2003]

  7. Time-Independent Media • Illusory Motion (Ming-Te Chi et al.)

  8. Time-Independent Media • Example (Image)

  9. Time-Independent Media • Example (Image) Who is angering you?

  10. Time-Independent Media • Example (Image) Who is sad?

  11. Time-Independent Media • Hybrid Image • http://cvcl.mit.edu/publications/publications.html

  12. Time-Independent Media • Example (Graph)

  13. Time-Independent Media • Example (3D Stereogram)

  14. Time-Independent Media • 3D Stereogram • DIY • http://www.flash-gear.com/stereo/ • Why do they look 3D? • http://www.kondo3d.com/stereo/why-3d/why-3d-e.html • Paper

  15. Time-Independent Media • Why do they look 3D?

  16. Time-Independent Media • Example (3D ASCII Stereogram)

  17. Time-Independent Media • Example (3D ASCII Stereogram)

  18. Time-Independent Media • Optical Illusion • http://www.johnsadowski.com/big_spanish_castle.php

  19. Time-Dependent Media • Information is time-related, must be shown to the user at specific points in time • Continuous data streams • Data appears in regular intervals • Examples: • Video (continuous)

  20. Time-Dependent Media • Examples: • An animation (not a continuous stream, but time-dependent) • An interactive game on the Internet (not a continuous stream, but has real-time requirements) • Audio (continuous)

  21. Time-Dependent Media • Image Morphing • Morphing is a special effect in motion pictures and animations that changes (or morphs) one image into another through a seamless transition. • Morph Tools • FantaMorph • Fun Morph

  22. Time-Dependent Media • 3D Stereogram Movie in Ascii http://www.kammerl.de/ascii/AsciiStereoMovie.php • 3D Animated Stereograms • http://www.hidden-3d.com/stereogram_theory.php

  23. Multimedia System • Integrated • production, • processing, • storage, • representation, • Transmission, etc. of several time-dependent and time-independent media streams

  24. History of Bandwidth in Computer Networks

  25. Network Requirements of Different Types of Data Streams

  26. Multimedia Processing • Compression/Decompression • Encryption/Decryption • Enhancement • Transformation • Recognition • Etc.

  27. Compression • Goal • The compression of multimedia data streams saves • storage space • transmission bandwidth

  28. Compression • Lossless • If the recovered data are assured to be identical to the source • Lossless compression techniques are requisite for applications involving textual data • e.g. ZIP • Lossy • Other applications, such as those involving voice and image data, may be sufficiently flexible to allow controlled degradation in the data

  29. Compression • Lossy • Example (DCT) • Although there is some loss of quality in the reconstructed image, it is clearly recognizable, even though almost 85% of the DCT coefficients were discarded.

  30. Encryption • Example

  31. Encryption • Example

  32. Encryption • Example

  33. Encryption • Example (Decryption)

  34. K K A-B A-B K (m) m = K ( ) A-B A-B Encryption • Text/String encryption algorithm decryption algorithm ciphertext plaintext plaintext message, m K (m) A-B

  35. Enhancement • Examples

  36. Transformation • Example

  37. Transformation • Example • Original • Changed

  38. Recognition • Example

  39. Tools • Matlab I = imread('cameraman.tif'); I = im2double(I); T = dctmtx(8); B = blkproc(I,[8 8],'P1*x*P2',T,T'); mask = [1 1 1 1 0 0 0 0 1 1 1 0 0 0 0 0 1 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]; B2 = blkproc(B,[8 8],'P1.*x',mask); I2 = blkproc(B2,[8 8],'P1*x*P2',T',T); imshow(I), figure, imshow(I2)

  40. Tools • Matlab

  41. Tools • PhotoImpact

  42. Tools • Audacity

  43. FrontPage • HTML • Javascript function encode() { if(document.form2.R1[0].checked){ Result="0分"; } if(document.form2.R1[1].checked){ Result="30分"; } document.form1.S1.value=Result; } • Java

  44. Anfy • Anfy (Java™) includes 52 applets, top effects and menu for web sites and blogs. Plus screensaver.

  45. Flash MX

  46. PowerPoint • Example

  47. PowerPoint • Example

  48. PowerPoint 48

  49. App • http://processing.org/tutorials/android/

More Related