1 / 54

HyperQueries: Dynamic Distributed Query Processing on the Internet

This work explores HyperQueries, a novel framework for dynamic and distributed query processing on the Internet, particularly in the context of E-marketplaces. It addresses challenges associated with traditional data warehousing techniques, such as security, privacy, and coherence issues. By utilizing hyperlinks as virtual attributes, HyperQueries enable efficient data retrieval from multiple suppliers, promoting the scalability of query execution. The paper discusses optimization issues, execution strategies, and related work, concluding with the implications of HyperQueries in enhancing the performance of online data retrieval systems.

kalei
Télécharger la présentation

HyperQueries: Dynamic Distributed Query Processing on the Internet

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HyperQueries:Dynamic Distributed Query Processing on the Internet Alfons Kemper Christian Wiesner Universität Passau

  2. Outline • Motivation • Hyperlinks & HyperQueries • Execution of HyperQueries • Optimization Issues • Related Work • Conclusions

  3. Replication Motivation: E-Market Places (1) Data Warehouse • Traditional techniques • Replicate data in a central data warehouse • Severe problems • Security and privacy violations • Coherence problems • Schema integration problems • Fixed query operators

  4. Registration Query Processing Motivation: E-Market Places (2) • HyperQuery framework • Market place is intermediary • Distribute query processing along allocation schema of data • Objects & queries flow through the WWW • Scalability HQ Market Place

  5. Client Market Place Supplier 2 Supplier 3 Supplier 4 Supplier 1 Hierarchical Flow of Objects select p.ProductDescription, c.Supplier, c.Price from NeededProducts p, Catalog@MarketPlace c where p.ProductDescription=c.ProductDescription order by p.ProductDescription expires Friday, Sep 14, 2001 11:30:00 AM CET

  6. Client Market Place Supplier 2 Supplier 3 Supplier 4 Supplier 1 Broadcast-like Flow of Objects select p.ProductDescription, c.Supplier, c.Price from NeededProducts p, Catalog@MarketPlace c where p.ProductDescription=c.ProductDescription order by p.ProductDescription expires Friday, Sep 14, 2001 11:30:00 AM CET

  7. Hyperlinks • Embed hyperlinks as virtual attributes in databases • Hyperlinks refer to HyperQueries

  8. Hyperlinks - Example virtual attribute hq HyperQuery Protocol supplier1.com DNS Electrical/Price HyperQuery ID ?ProdID=CB1232 Object-Specific Parameters !Currency=USD Global Parameter .

  9. select h.*, p.Price as Price from HyperQueryInputStream h, Products p where h.ProdID = p.ProdID HyperQueries • Sub-plans at remote hosts • Virtual table HyperQueryInputStream • SQL Dialect Electrical/Price@Supplier1.com: select h.*, p.Price as Price from HyperQueryInputStream h, Products p where h.ProdID = p.ProdID

  10. Nesting Sequencing Inner  send recv Dispatch Dispatch Templates for Sub-Plans

  11. Example select p.ProductDescription, c.Supplier, c.Price from NeededProducts p, Catalog@MarketPlace c where p.ProductDescription=c.ProductDescription order by p.ProductDescription expires Friday, Sep 14, 2001 11:30:00 AM CET • Query • NeededProducts@Client:

  12. HyperQuery Execution

  13. Supplier 1 HyperQuery Execution  ["Battery, 12V 32A", "Supplier 1", "hq://supplier1.com/Electrical/Price?ProdID=CB1232", 500]

  14. Supplier 1 HyperQuery Execution 

  15. Supplier 1 HyperQuery Execution 

  16. Supplier 1 HyperQuery Execution 

  17. Supplier 1 Supplier 1 HyperQuery Execution 

  18. HyperQuery Execution  Supplier 1 ["Battery, 12V 55A", "Supplier 1", "hq://supplier1.com/Electrical/Price?ProdID=CB1255", 750]

  19. Supplier 1 HyperQuery Execution 

  20. Supplier 1 HyperQuery Execution 

  21. Supplier 1 HyperQuery Execution 

  22. Supplier 1 Supplier 2 HyperQuery Execution  ["Tires 175/65TR14", "Supplier 2", "hq://supplier2.com/Price?ProdKey=175_65TR14", 1000]

  23. Supplier 1 Supplier 2 HyperQuery Execution 

  24. Supplier 1 Supplier 2 HyperQuery Execution 

  25. Supplier 1 Supplier 2 HyperQuery Execution 

  26. Supplier 1 Supplier 2 Supplier 3 Currency=USD HyperQuery Execution  ["Spark Plug VX","Supplier 3","hq://supplier3.com/PriceForUSA!Currency=USD?ID=1234", 8000]

  27. Supplier 1 Supplier 2 Supplier 3 HyperQuery Execution 

  28. Supplier 1 Supplier 2 Supplier 3 HyperQuery Execution 

  29. Supplier 1 Supplier 2 Supplier 3 HyperQuery Execution 

  30. Real HyperQuery Execution

  31. Supplier 1 Real HyperQuery Execution 

  32. Supplier 1 Real HyperQuery Execution 

  33. Supplier 1 Real HyperQuery Execution 

  34. Supplier 1 Real HyperQuery Execution 

  35. Supplier 1 Real HyperQuery Execution 

  36. Supplier 1 Supplier 2 Real HyperQuery Execution 

  37. Supplier 1 Supplier 2 Real HyperQuery Execution 

  38. Supplier 1 Supplier 2 Supplier 3 Currency=USD Real HyperQuery Execution 

  39. Supplier 1 Supplier 2 Supplier 3 Currency=USD Real HyperQuery Execution 

  40. Supplier 1 Supplier 2 Supplier 3 Real HyperQuery Execution 

  41. Origin of Data • SQL database queries • Relational representation • Extensibility • Applications • Legacy systems • ERP systems (e.g., SAP R/3) • Human interaction

  42. Bulk Optimization: Bulk Bypassing • Strip off bulky attributes • Bypass Sub-plans • Re-merge • Reduce network traffic  Supplier 1 Supplier 2

  43.  Supplier 1 Supplier 2 Supplier 2 Supplier 1   Supplier 1 Supplier 2 Supplier 1 Supplier 1 Supplier 2 Supplier 2 Price Availability Availability & Price Optimization: Multiple Virtual Attributes • Parallelizise requests Price Availablity

  44. Optimization: Caching  Supplier 1 Supplier 2

  45. Optimization: Caching  Supplier 1 Supplier 2

  46. Optimization: Caching  Supplier 1 Supplier 2

  47. Optimization: Caching  Supplier 1 Supplier 2

  48. Optimization: Caching  Supplier 1 Supplier 2

  49. Optimization: Caching  Supplier 1 Supplier 2

  50. Optimization: Caching  Supplier 1 Supplier 2

More Related