1 / 65

Network Sharing Issues

Network Sharing Issues. Lecture 15 Aditya Akella. Is this the biggest problem in cloud resource allocation? Why? Why not? How does the problem differ wrt allocating other resources? FairCloud : Sharing the Network in Cloud Computing, Sigcomm 2012 What are the assumptions? Drawbacks?.

armine
Télécharger la présentation

Network Sharing Issues

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Network Sharing Issues Lecture 15 Aditya Akella

  2. Is this the biggest problem in cloud resource allocation? Why? Why not? • How does the problem differ wrt allocating other resources? • FairCloud: Sharing the Network in Cloud Computing, Sigcomm 2012 • What are the assumptions? Drawbacks?

  3. Motivation Network?

  4. Context Networks are more difficult to share than other resources X

  5. Context • Several proposals that share network differently, e.g.: • proportional to #source VMs (Seawall [NSDI11]) • statically reserve bandwidth (Oktopus [Sigcomm12]) • … • Provide specific types of sharing policies • Characterize solution space and relate policies to each other?

  6. FairCloud Paper • Framework for understanding network sharing in cloud computing • Goals, tradeoffs, properties • Solutions for sharing the network • Existing policies in this framework • New policies representing different points in the design space

  7. Goals • Minimum Bandwidth Guarantees • Provides predictable performance • Example: file transfer finishes within time limit Bmin A1 A2 Timemax = Size / Bmin

  8. Goals • Minimum Bandwidth Guarantees • High Utilization • Do not leave useful resources unutilized • Requires both work-conservation and proper incentives A B B B Both tenants active Non work-conserving Work-conserving

  9. Goals • Minimum Bandwidth Guarantees • High Utilization • Network Proportionality • As with other services, network should be shared proportional to payment • Currently, tenants pay a flat rate per VM  network share should be proportional to #VMs (assuming identical VMs)

  10. Goals • Minimum Bandwidth Guarantees • High Utilization • Network Proportionality • Example: A has 2 VMs, B has 3 VMs BwA BwB BwA 2 B3 A1 = BwB 3 B1 When exact sharing is not possible use max-min A2 B2

  11. Goals • Minimum Bandwidth Guarantees • High Utilization • Network Proportionality Not all goals are achievable simultaneously!

  12. Tradeoffs High Utilization Min Guarantee Network Proportionality Not all goals are achievable simultaneously!

  13. Tradeoffs Min Guarantee Network Proportionality

  14. Tradeoffs Min Guarantee Network Proportionality Minimum Guarantee A B Access Link L Capacity C BwA= 1/2 C BwB = 1/2 C BwA BwB Network Proportionality BwA= 2/13 C BwB = 11/13 C BwA ≈ C/NT  0 #VMs in the network 10 VMs

  15. Tradeoffs High Utilization Network Proportionality

  16. Tradeoffs High Utilization Network Proportionality A1 A2 L A4 A3 B2 B1 B3 B4

  17. Tradeoffs High Utilization Network Proportionality Network Proportionality BwA= 1/2 C BwB = 1/2 C A1 A2 L A4 A3 B2 B1 B3 B4

  18. Tradeoffs High Utilization Network Proportionality Uncongested path P A1 A2 L A4 A3 B2 B1 B3 B4

  19. Tradeoffs High Utilization Network Proportionality Network Proportionality Uncongested path L P L BwA+BwA=BwB P L L BwB BwA< A1 A2 L A4 A3 Tenants can be disincentivized to use free resources B2 B1 If A values A1A2 or A3A4 more than A1A3 B3 B4

  20. Tradeoffs High Utilization Network Proportionality Congestion Proportionality Uncongested path P Network proportionality applied only for flows traversing congested links shared by multiple tenants A1 A2 L A4 A3 B2 B1 B3 B4

  21. Tradeoffs High Utilization Network Proportionality Congestion Proportionality Uncongested path P A1 A2 Congestion Proportionality L L L A4 A3 BwB BwA= B2 B1 B3 B4

  22. Tradeoffs High Utilization Network Proportionality Congestion Proportionality Still conflicts with high utilization

  23. Tradeoffs High Utilization Network Proportionality Congestion Proportionality C1 = C2 = C L1 A1 A2 B2 B1 L2 A4 A3 B3 B4

  24. Tradeoffs High Utilization Network Proportionality Congestion Proportionality C1 = C2 = C Congestion Proportionality L1 A1 A2 L1 L1 BwB BwA= L2 L2 B2 B1 BwB BwA= L2 A4 A3 B3 B4

  25. Tradeoffs High Utilization Network Proportionality Congestion Proportionality C1 = C2 = C L1 A1 A2 B2 B1 L2 A4 A3 Demand drops to B3 B4 ε

  26. Tradeoffs High Utilization Network Proportionality Tenants incentivized to not fully utilize resources Congestion Proportionality C1 = C2 = C L1 ε A1 A2 B2 C - ε B1 L2 C - ε A4 A3 B3 B4 ε

  27. Tradeoffs High Utilization Network Proportionality Tenants incentivized to not fully utilize resources Congestion Proportionality C1 = C2 = C L1 ε A1 A2 B2 C - ε B1 L2 C - 2ε A4 A3 Uncongested B3 B4 ε

  28. Tradeoffs High Utilization Network Proportionality Tenants incentivized to not fully utilize resources Congestion Proportionality C1 = C2 = C L1 A1 A2 C/2 B2 B1 C/2 L2 C - 2ε A4 A3 Uncongested B3 B4 ε

  29. Tradeoffs High Utilization Network Proportionality Congestion Proportionality Link Proportionality L1 A1 A2 Proportionality applied to each link independently B2 B1 L2 A4 A3 B3 B4

  30. Tradeoffs High Utilization Network Proportionality Congestion Proportionality Link Proportionality L1 A1 A2 Full incentives for high utilization B2 B1 L2 A4 A3 B3 B4

  31. Goals and Tradeoffs High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality

  32. Guiding Properties High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Break down goals into lower-level necessary properties

  33. Properties High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Work Conservation

  34. Work Conservation • Bottleneck links are fully utilized • Static reservations do not have this property

  35. Properties High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Utilization Incentives Work Conservation

  36. Utilization Incentives • Tenants are not incentivized to lie about demand to leave links underutilized • Network and congestion proportionality do not have this property • Allocating links independently provides this property

  37. Properties High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Comm-Pattern Independence Utilization Incentives Work Conservation

  38. Communication-pattern Independence • Allocation does not depend on communication pattern • Per flow allocation does not have this property • (per flow = give equal shares to each flow) Same Bw

  39. Properties High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Comm-Pattern Independence Utilization Incentives Symmetry Work Conservation

  40. Symmetry • Swapping demand directions preserves allocation • Per source allocation lacks this property • (per source = give equal shares to each source) Same Bw Same Bw

  41. Goals, Tradeoffs, Properties High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Comm-Pattern Independence Utilization Incentives Symmetry Work Conservation

  42. Outline • Framework for understanding network sharing in cloud computing • Goals, tradeoffs, properties • Solutions for sharing the network • Existing policies in this framework • New policies representing different points in the design space

  43. Per Flow (e.g. today) High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Comm-Pattern Independence Utilization Incentives Symmetry Work Conservation

  44. Per Source (e.g., Seawall [NSDI’11]) High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Comm-Pattern Independence Utilization Incentives Symmetry Work Conservation

  45. Static Reservation (e.g., Oktopus [Sigcomm’11]) High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Comm-Pattern Independence Utilization Incentives Symmetry Work Conservation

  46. New Allocation Policies 3 new allocation policies that take different stands on tradeoffs

  47. Proportional Sharing at Link-level (PS-L) High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Comm-Pattern Independence Utilization Incentives Symmetry Work Conservation

  48. Proportional Sharing at Link-level (PS-L) • Per tenant WFQ where weight = # tenant’s VMs on link WQA= #VMs A on L A BwA #VMs A on L = BwB #VMs B on L B Can easily be extended to use heterogeneous VMs (by using VM weights)

  49. Proportional Sharing at Network-level (PS-N) High Utilization Min Guarantee Network Proportionality Congestion Proportionality Link Proportionality Comm-Pattern Independence Utilization Incentives Symmetry Work Conservation

  50. Proportional Sharing at Network-level (PS-N) • Congestion proportionality in severely restricted context • Per source-destination WFQ, total tenant weight = # VMs

More Related