1 / 19

Multimedia

Multimedia. Need high Bandwidth Analog vs. Digital Multi-modality Real-Time MM. Major Issues. 1. Size of Data Frame 2. Need High Bandwidth 3. Digital vs. Analog Representation 4. Multi-Modality Integration/Blending 5. Soft Real-Time Constraints 6. Need Group Communication

tova
Télécharger la présentation

Multimedia

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Multimedia Need high Bandwidth Analog vs. Digital Multi-modality Real-Time MM T.Sharon-A.Frank

  2. Major Issues 1. Size of Data Frame 2. Need High Bandwidth 3. Digital vs. Analog Representation 4. Multi-Modality Integration/Blending 5. Soft Real-Time Constraints 6. Need Group Communication 7. Need Synchronization 8. Need for Standards T.Sharon-A.Frank

  3. 2. Need High Bandwidth PC RUN MICROBROOK LAN CREEK VIDEO RIVER DATA STREAM BANDWIDTH RIVER IMAGE RIVER BROADBAND RAY T.Sharon-A.Frank VOICE RIVER

  4. Channel Rates (Bits/Second) Video conferencing Graphical user interfaces Video phone Peripheral sharing Compressed video File transfer Information, e-mail, voice mail Inquiry Remote file system Fax Telemetry Alarm, pager Voice CD TV HDTV 1Kbps 1Mbps 1Gbps T.Sharon-A.Frank

  5. Applications Requirements CD Audio Entertainment Video 105 1 Day Teleconferencing Session Duration 104 Information Retrieval 1 Hr 103 102 High SpeedData 1 Min 101 102 104 106 108 1010 T.Sharon-A.Frank Channel Rate 1 KB/s 1 MB/s 1 GB/s

  6. Increasing Throughput Requirements B-ISDN SMDS X.25 PACKET SWITCHING FRAME RELAY SWITCHED T-SERIES ISDN DIAL- UP Increasing Burstiness DEDICATED PRIVATE LINE 64K 1.5M 45M 150M 600M T.Sharon-A.Frank Bandwidth

  7. LAN/WAN fit for MM? Slow Fast LAN/WAN MM Need Fiber Optics, Broadband,High-Speed Networks (HSN) T.Sharon-A.Frank

  8. Solutions Use Lossy Compression Show/See Flash! Use High Speed Networks (HSNs) T.Sharon-A.Frank

  9. 3. Digital vs. Analog Representation “Quantized”Sound Wave Analog Sound Wave Digital Sample Original Sound Digital Sampling Digital Playback T.Sharon-A.Frank

  10. Digital Signals • Only certain signal values are valid: • Relatively immune to corruption by noise. • Do not degrade when copied or transmitted over network. • Some information lost. • Undersampling • Samples 'too far apart' so cannot accurately reconstruct original signal.

  11. Solutions Use Special Hardware (AD/DA) Use Standards T.Sharon-A.Frank

  12. 4. Multi-Modality Integration/Blending T.Sharon-A.Frank

  13. Multimedia Input Put that there! Eye Tracker Speech Recognizer Data Glove T.Sharon-A.Frank

  14. Multimedia Output Data Maps Video Graphs There are three types of Soviet fighters: the MIG-27 Flogger-D that travels 490 miles per hour, the MIG-29 Fulcrum that... Natural Language Tables T.Sharon-A.Frank

  15. Modality Blending Mode 1 Mode 2 Mode 3 Mode n ... Syntax Semantics Pragmatics Application T.Sharon-A.Frank

  16. Multimedia-Multimodal Interface Mode 1 Mode 2 Mode 3 Mode n ... Syntax Semantics Pragmatics Application T.Sharon-A.Frank

  17. 5. Soft Real-Time Constraints T.Sharon-A.Frank

  18. Hardware/Software Pipeline Transmitting Video Frame ScheduleDigitize Digitize ScheduleCompress Compression 16.5ms 33ms 16.5ms 20ms Transmit InitiateTransmit NetworkDriver Transmission 20ms 1ms 16.5ms ??Depends on network load Software Hardware T.Sharon-A.Frank

  19. Solutions Use Standards Use Quality of Service (QoS) T.Sharon-A.Frank

More Related