1 / 77

A QoS approach for Multimedia Consumer Terminals - A case for Conditionally Guaranteed Budgets -

A QoS approach for Multimedia Consumer Terminals - A case for Conditionally Guaranteed Budgets -. Reinder J. Bril. 23-11-2004. Multimedia Consumer Terminals and QoS. Multimedia Consumer Terminals audio/video: perception is key high volume electronics: cost-constrained

stella
Télécharger la présentation

A QoS approach for Multimedia Consumer Terminals - A case for Conditionally Guaranteed Budgets -

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking A QoS approach forMultimedia Consumer Terminals- A case for Conditionally Guaranteed Budgets - Reinder J. Bril 23-11-2004

  2. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Multimedia Consumer Terminals and QoS • Multimedia Consumer Terminals • audio/video: perception is key • high volume electronics: cost-constrained • requires average-case resource allocation • High quality audio and video: • have real-time requirements • Quality of Service (QoS) • “collective effort of service performances that determine the degree of satisfaction of the user of that service”(International Telecommunications Union)

  3. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking University of Madrid (dit/UPM) University of Illinois at Urbana- Champaign (UIUC) University of Mannheim University of St. Petersburg Multi-disciplinary QoS approach V-QoS Quality of Service Resource Management (QoS-RM) Scalable Video Algorithms (SVA) ITEA/Europa, ITEA/Robocop, OZONE, …

  4. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Conditionally Guaranteed Budgets • Conclusion

  5. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • Media processing from dedicated HW to SW • Platforms are resource constraint • High quality video has real time requirements • A QoS approach • Conditionally Guaranteed Budgets • Conclusion

  6. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Adaptive applications • Budget-based resource manager • Control hierarchy • Conditionally Guaranteed Budgets • Conclusion

  7. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Conditionally Guaranteed Budgets • Resource allocation conflict • Extension of QoS approach • Analysis • Conclusion

  8. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Cable modem DVB Tuner IEEE 1394 interface RF Tuner CVBS interface YC interface VGA DVD CDx front end Multimedia Consumer Terminals Focus: Receivers in broad-cast environments High-quality video applications

  9. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Traditional High-End TV Architecture Traditional TV sets andSet-Top Boxes: • Fixed algorithms for fixed HW architectures • Upgrade for new services and applications is problematic • Systems are not flexible

  10. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Digital video platform Expectations: • Upgradeable for new servicesand applications • Fast time-to-market for new features • Enabling approach for product families

  11. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking SW-Modules Algorithm 4 Algorithm 4 Algorithm 3 High- end Algorithm 3 Mid- range Algorithm 2 Algorithm 2 Low- end Algorithm 1 Algorithm 1 max min HW Architectures vs. SW Applications Product Families Resources

  12. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Algorithm 4 Algorithm 3 Algorithm 2 Low- end Algorithm 1 Algorithm 1 Flexibility Mode 2 Mode 3 Mode 1

  13. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Algorithm 3 Algorithm 3 Low- end Algorithm 1 Scalability Alg. 4 Alg. 1 Mode 2 Mode 1

  14. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Algorithm 3 Algorithm 3 Algorithm 3 Low- end Algorithm 1 Smooth mode transition Alg. 4 Alg. 1 Alg. 1 Transitory Final Initial

  15. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking traditional systems traditional systems Quality Cost scalable approach scalable approach target limit target limit Functionality Functionality Platform constraints

  16. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Platform constraints • Cost-effectiveness requirement • High volume: low bill of material • Low power • Software solutions are relatively expensive(mm2 silicon / power) • Average case and worst-case are far apart

  17. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Fluctuating resource requirements load worst-case structural load running average temporal load time

  18. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Fluctuating resource requirements • Temporal load changes (very frequent) • from I frame to B frame • more or less motion • transient high peaks • Structural load changes (less frequent) • scene change • from movie to camera • from news to commercial

  19. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Platform constraints • Cost-effectiveness requirement • High volume: low bill of material • Low power • Software solutions are relatively expensive(mm2 silicon / power) • Average case and worst-case are far apart • Conclusion:Aim for average-case resource allocation

  20. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking up-scaled High quality video TV companies invest heavily in video enhancement,e.g. temporal up-scaling Input stream: 24 Hz (movie) original Rendered stream: 60 Hz (TV screen)

  21. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking up-scaled displayed High quality video TV companies invest heavily in video enhancement,e.g. temporal up-scaling Input stream: 24 Hz (movie) original • Deadline miss leads to “wrong” picture. • Deadline misses tend to come in bursts (heavy load). • Valuable work may be lost.

  22. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking up-scaled displayed High quality video TV companies invest heavily in video enhancement,e.g. temporal up-scaling Input stream: 24 Hz (movie) original QoS trade-off (at run-time): Lesser picture quality often better than temporal incorrectness.

  23. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking High quality video • QoS = degree of user satisfaction • User satisfaction has to do with perception: • Lesser picture quality often better than temporal incorrectness. • Quality fluctuations are perceived as non-quality. • With a scene change, the brain needs some time to re-focus. • Most people focus on one thing at a time (user focus) • User focus normally is at • the center of a window, • the window that received the latest (remote) command. • Only video specialists can make the necessary trade-offs.

  24. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Multimedia Consumer Terminals - Summary • Media processing from dedicated HW to SW • Flexibility & scalability • Fast time-to-market • Product families • Platform constraints • Aim for average-case resource allocation • High quality video • Has real-time requirements; • is about perception -> QoS; • real-time is a QoS parameter; • QoS is primarily an application-domain issue.

  25. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Adaptive applications • Budget-based resource manager • Control hierarchy • Conditionally Guaranteed Budgets • Conclusion

  26. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking DVD main pip disk mode 1: main mode 2: main + pip mode 3: main + pip + disk User applications Input Output Media processing Modes In mode 3, main+pip+diskcan not run at highest quality.

  27. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking DVD main: scalable digitizer: non-scalable pip: scalable mixer : non-scalable disk: non-scalable hierarchical task Application execution model (prototype) audio rend audio dec. read dmux dec. sharp enh. mixer digit scaler hw scaler enc. writer enc. buffer enc. task Both mainandpipare scalable. data transfer dec scalable task connection to HW IO

  28. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Quality Resource needs Scalable Algorithm

  29. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking s1 s2 Detail Filter Amplitude Control Noise Measurement QL0 QL1 QL2 QL3 Example: Sharpness Enhancement Filter AC NM No No No 1D No No 2D No No 2D Yes Yes

  30. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking QL0 QL2 QL4 Resource range for SVA examples QL0 QL1 QL4

  31. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking CPU timeapp. 2 budget 2 CPU timeapp. 1 budget 1 time Budget-based resource manager • Temporal isolation: • Reserved, guaranteed, and enforced budgets • e.g. 20% of the CPU time every 20 ms; • Applications run on a “virtual platform”;

  32. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Dynamic load (reminder) • Temporal load changes (very frequent) • from I frame to B frame • more or less motion • transient high peaks • Structural load changes (less frequent) • scene change • from movie to camera • from news to commercial • Mode change (infrequent) • functional change • external trigger

  33. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Control hierarchy • Dynamic load at different time-scales: • Temporal load changes; • Structural load changes; • Mode change. • Layers of control, e.g. • local quality control of applications; • global system utility control.

  34. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Optimizes system utility, sets quality levels + allocates resources Global system utility control Adaptive applications Local quality control Provide quality levels + estimated resource req. … SVAs Provides guaranteed resource budgets Resource manager Co-operative QoS approach

  35. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Conditionally Guaranteed Budgets • Why: Resource allocation conflict • How: Extension of QoS approach • Analysis • Conclusion

  36. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking structural load running average temporal load Resource requirements (reminder) load time

  37. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking structural load running average temporal load Resource allocation: worst-case load Not cost-effective time

  38. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Instantaneous budget increase structural load running average Not yet feasible temporal load Resource allocation: close to average load time

  39. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Instable output quality structural load running average Not acceptable forimportant applications temporal load Resource allocation: close to average load time

  40. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking “wasted” structural load running average Not cost-effective temporal load Resource allocation: close to average load time

  41. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Resource allocation conflict Structural load increase +close-to-average resource allocation yields • either instable output quality not acceptable for important applications • or “wasted” resources not cost-effective

  42. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking B Instantaneous budget increase structural load running average Anticipated increase temporal load Conditionally guaranteed budgets: Why? load B time

  43. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking CGB Conditionally guaranteed budgets: How? Basic approach (MIA and LIA): • Two modes of quality settings + allocation: Normal mode(low load for MIA) Anticipated mode(high load for MIA) MIA QMIA, BMIA QMIA, BMIA+BMIA LIA QLIA,N, BLIA+BLIA QLIA,A, BLIA

  44. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Inform MIA, LIA, and RM about both modes Global system utility control modes Adaptive applications MIA LIA Normal mode Anticipated mode Normal mode Anticipated mode Resource manager (RM) Normal mode Anticipated mode Conditionally guaranteed budgets: How?

  45. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Global system utility control Adaptive applications MIA LIA Normal mode Anticipated mode Normal mode Anticipated mode Resource manager (RM) Normal mode Anticipated mode Conditionally guaranteed budgets: How? Running in normal mode

  46. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Global system utility control Adaptive applications MIA LIA Normalmode Anticipated mode Normal mode Anticipated mode Resource manager (RM) Normal mode Anticipated mode Conditionally guaranteed budgets: How? MIA detects load increase, claims BMIA, and switches mode Claim BMIA Mode transition

  47. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Conditionally guaranteed budgets: How? Global system utility control Adaptive applications MIA LIA Normal mode Anticipated mode Normal mode Anticipated mode Inform LIA RM switches mode instantaneously, andinforms LIA Resource manager (RM) Normal mode Anticipated mode Mode transition

  48. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Conditionally guaranteed budgets: How? Global system utility control Adaptive applications MIA LIA LIA switches mode Normal mode Anticipated mode Normal mode Anticipated mode Resource manager (RM) Normal mode Anticipated mode Running in anticipated mode

  49. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Conditionally guaranteed budgets: How? • Summary basic approach: • Assumption: • Anticipation of resource needs and modes; • Allocation phase: • Informing MIA, LIA, and RM about modes; • Delegation of mode changes to MIA; • Execution phase: • Release and claim of resources by MIA; • Instantaneous mode change by RM.

  50. Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Conditionally guaranteed budgets: How? • How to change budgets instantaneously ? • In-the-place-of resource consumption • LIA consumes BLIA exactly whenMIA would have consumed BMIA

More Related