1 / 16

Decentralized Media Streaming

Decentralized Media Streaming. Jack Y. B. Lee Department of Information Engineering The Chinese University of Hong Kong. 1. Motivation. Current Media Streaming Systems Client-Server Architecture. 2. Challenges. Media Server Scalability Server Replication Parallel Server Architectures

kezia
Télécharger la présentation

Decentralized Media Streaming

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Decentralized Media Streaming Jack Y. B. Lee Department of Information Engineering The Chinese University of Hong Kong

  2. 1. Motivation • Current Media Streaming Systems • Client-Server Architecture AoE Talk - Decentralized Media Streaming

  3. 2. Challenges • Media Server Scalability • Server Replication • Parallel Server Architectures • Media Proxy • Content Distribution Networks • Network Bandwidth Scalability • Distributed Media Proxies and Caches • Content Distribution Networks • Multicast Media Streaming AoE Talk - Decentralized Media Streaming

  4. 3. Decentralized Architectures • Advances in the PC Industry • GHz Processors • 100’s GB Hard Drive • Broadband Internet Access • Why not eliminate the server all together? • Data are stored to end-user hosts • Hosts co-operatively serve one another • Benefits • No server -> lower cost • Inherently scalable • Localize network traffic • User driven; does not need a central service provider AoE Talk - Decentralized Media Streaming

  5. 4. Server-less Media Streaming • Goals • No central server, completely decentralized architecture • Scalable • Reliable • Invisible • Self-manageable • Self-adaptable • Deployable on the current Internet AoE Talk - Decentralized Media Streaming

  6. 5. Scalability and Reliability • Distributed Data Storage • Replication • Host-level Striping • Fault Tolerance • Node failures are the norm rather than the exception • Requires capacity and data Redundancy AoE Talk - Decentralized Media Streaming

  7. 6. Invisibility • Interference with Host • CPU Utilization • Negligible CPU utilization. • No observable increase in CPU utilization when scaling up to more nodes. AoE Talk - Decentralized Media Streaming

  8. 6. Invisibility • Interference with Host • Disk I/O Interference • Media streaming under 44MB/s interfering disk I/O process: • Mean transmission rate not affected. • Variance does increase but not significantly. AoE Talk - Decentralized Media Streaming

  9. 7. Self-Manageability • Dynamic System Reconfiguration • Data Reorganization (adding a new node) • Distribute data storage and workload • Example - Growing from 4 to 5 nodes: n0 n1 n2 n3 n0 n1 n2 n3 n3 0 1 2 3 0 1 2 3 4 4 5 6 7 5 6 7 8 9 node n4 joins 8 9 10 11 10 11 12 13 14 12 13 14 15 15 16 17 18 19 16 17 18 19 AoE Talk - Decentralized Media Streaming

  10. 7. Self-Manageability • Dynamic System Reconfiguration • Data Reorganization (adding a new node) • Row-Permutated Data Reorganization n0 n1 n2 n3 n0 n1 n2 n3 n4 0 1 3 2 4 0 1 3 2 4 9 8 7 5 6 7 5 6 node n4 joins 8 10 9 11 13 10 14 11 12 13 12 14 15 16 17 19 15 18 16 17 19 18 AoE Talk - Decentralized Media Streaming

  11. 7. Self-Manageability • Dynamic System Reconfiguration • Redundant Data Update (adding a new node) AoE Talk - Decentralized Media Streaming

  12. 7. Self-Manageability • Dynamic System Reconfiguration • Redundant Data Update (adding a new node) AoE Talk - Decentralized Media Streaming

  13. 7. Self-Manageability • Open Problems • Data re-organization and redundant data update when removing a node? • Batched update after adding/removing n nodes? • Scheduling of data movement during reorganization. • Load balance. • Interplay between streaming and reorganization. • Reorganization for other data placement policies? • Etc, etc. AoE Talk - Decentralized Media Streaming

  14. 8. Self-Adaptability • Heterogeneity • Node and Network Heterogeneity • Different storage, streaming, and memory capacities. • Different delays between nodes. • Dynamic Adaptation • Node and Network Availability • Short-term streaming bandwidth variations. • Network congestions. AoE Talk - Decentralized Media Streaming

  15. 9. Practicality • System Prototyping • Software prototype running on Windows • Installs as a system service, transparent to end users. • Supports streaming of MPEG1 video, soon MPEG4 as well. • Can sustain node failures using erasure correcting codes. AoE Talk - Decentralized Media Streaming

  16. Related Publications • Jack Y. B. Lee and W. T. Leung, “Design and Analysis of a Fault-Tolerant Mechanism for a Server-Less Video-On-Demand System,” Proc. 2002 International Conference on Parallel and Distributed Systems, Taiwan, Dec 17-20, 2002, pp.489-494. • Jack Y. B. Lee and W. T. Leung, “Study of a Server-less Architecture for Video-on-Demand Applications,” Proc. IEEE International Conference on Multimedia and Expo., Lausanne, Switzerland, 26-29 August 2002, pp.233-236. • T. K. Ho and Jack Y. B. Lee, “A Row-Permutated Data Reorganization Algorithm for Server-less Video-on-Demand Systems,” Proc. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2003), Tokyo, Japan, May 12-15, 2003, pp.44-51. • T. K. Ho and Jack Y. B. Lee, “A Novel Redundant Data Update Algorithm for Fault-Tolerant Server-less Video-on-Demand Systems,” Proc. 2003 High Performance & Large Scale Computing (HP&LSC) Conference, Nottingham, UK, June 9-11, 2003, pp.378-384. • T. K. Ho and Jack Y. B. Lee, “A Transpositional Redundant Data Update Algorithm for Growing Server-less Video Streaming Systems,” Proc. IEEE Third International Conference on Peer-to-Peer Computing, 1-3 Sep 2003, Linköping, Sweden. • C. Y. Chan and Jack Y. B. Lee, “On Transmission Scheduling in a Server-less Video-on-Demand System,” Proc. International Conference on Parallel and Distributed Computing, Klagenfurt, Austria, August 26-29, 2003. AoE Talk - Decentralized Media Streaming

More Related