1 / 18

Enhancing Total Order in Content-Based Publish/Subscribe Systems through Pairwise Segmentation

This paper presents a novel approach to achieving total order semantics in content-based publish/subscribe systems, emphasizing a two-phase solution that minimizes overhead and conflict resolution. The method integrates pairwise total order (PTO) utilizing FIFO links and a common broker, effectively addressing the challenges of subscriber decoupling and ensuring event stream consistency. Performance evaluations demonstrate significant improvements over traditional group communication systems, highlighting scalability and low conflict rates. Future work aims to extend the solution for cyclic topologies and enhance routing efficiency.

lucita
Télécharger la présentation

Enhancing Total Order in Content-Based Publish/Subscribe Systems through Pairwise Segmentation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Total Order in Content-based Publish/Subscribe Systems ICDCS 2012, June 19th 2012 Kaiwen Zhang Joint work with: Vinod Muthusamy, Hans-Arno Jacobsen University of Toronto http://www.padres.msrg.utoronto.ca

  2. Outline Background: publish/subscribe Total order semantics Related work: sequencers Natural pairwise total order Our two-phase solution Performance evaluation Comparison with Group communication systems

  3. Advertisement-Based Pub/Sub 3 subscriber publisher name = `IBM’ price > $20 name = `IBM’ price = $40 subscriber name = `IBM’ price > $30 Advertisement path Subscription path Publication path broker match & forward name = ‘IBM’

  4. Pairwise Total Order (PTO)for Pub/Sub

  5. Application Scenarios Little work on total order in pub/sub so far Subscriber decoupling Minimize overhead External communication between peers Comparing event streams Consistency Online games (non-commutative operations) Monitoring (stream ordering) Fairness Stock quote (detecting event patterns)

  6. Drawbacks of Sequencers Sequencer networks [Lumezanu 2006] Topic-based Global knowledge Sequencing overhead applied to all pubs and subs

  7. Per-Publisher Ordering using FIFO Links Per-Publisher TO Maintaining order per publisher (i.e. FIFO order) Per-Publisher TO is maintained using FIFO links between overlay neighbours Requires unique paths to each sub!

  8. Natural Pairwise TO (N-PTO) Using FIFO links, a common broker for all publisher/subscriber pairs provides N-PTO. Consider that broker as a “super-publisher” Per-publisher TO is then enforced from that broker on Consider P1 and P2 as internal to the publisher B0

  9. Our Solution Uses FIFO links N-PTO provided by a common broker Two phases: Conflict detection Identify pairs of disjoint publisher/subscriber paths Resolution Defer delivery only to affected subscribers Lightweight solution for content-based P/S Uses local ads/subs broker knowledge (next-hops)

  10. No Conflict P2 doesn't match S4 No conflict S1-S3 have different next hop from P2: B3 is a common broker S1-S3 share same next-hop as P2 No conflicts detected at B1

  11. Conflict Resolution S4 forwarded immediately Defer delivery to S1, wait for ack Conflict for S3, defer until ack S1 has a different next-hop from S2-3 and P2: Their paths are disjoint! Detects that P2 and S2 have different next-hops: Send ack back

  12. Properties of the Solution System model: Acyclic topology FIFO links Advertisement-based Solution is safe under crash failures Theorem: “Pairwise total order is impossible in publish/subscribe systems under the presence of failures.” Optimizations: Progressive delivery Faster detection

  13. Evaluation Implementation using PADRES in Java Modular; requires only few changes to the core Workload Overlapping subscriptions; stress test High conflict rates: 25-100% Topology 24 to 96 brokers 800 subscribers, 240 publishers

  14. Low Detection Overhead Overall, still small impact to non-conflict subs Overhead increases with less conflict

  15. Scalability over Baseline Our solution Central sequencer No total order Throughput saturated for central sequencer

  16. Performance over Spread (Group Communication Systems) Spread w/ TO (token algorithm) Our solution Outperformed after a certain size Overhead due to TO Spread w/o ord.

  17. Conclusions & Future Work Lightweight solution for content-based p/s Local broker knowledge Contained resolution overhead Extension for cyclic topologies Adjust routing paths Pub/sub clustering and client mobility Maximize natural ordering

  18. Thank you!

More Related