SlideServe
Menu
Préférences
© SlideServe · v2026

Caching Mechanisms for Efficient Query Resolution in Distributed Information Retrieval Systems

paniz avatar
6 diapositives · 182 Views · Oct 23, 2014

This paper by Hemali Majithia explores a caching mechanism designed to enhance the performance of agent-based distributed information retrieval (DIR) systems. By caching new queries and their results, the solution minimizes redundant searches, improving both speed and resource utilization. The two-level caching system employs strategies such as Least Recently Used (LRU) and Least Frequently Used (LFU) algorithms, alongside a similarity metric for efficient query handling. By leveraging previous query results, the system can significantly reduce round trip time and improve retrieval efficiency.

Caching Mechanisms for Efficient Query Resolution in Distributed Information Retrieval Systems - slide 1
01 / 6Caching Mechanisms for Efficient Query Resolution in Distributed Information Retrieval Systems
1 / 17

Télécharger la présentation

Caching Mechanisms for Efficient Query Resolution in Distributed Information Retrieval Systems
Une image / un lien ci-dessous est fourni (tel quel) pour télécharger la présentation

Politique de téléchargement : le contenu du site vous est fourni TEL QUEL pour votre information et votre usage personnel ; il ne peut être vendu, concédé sous licence ni partagé sur d’autres sites sans l’accord de son auteur.Le contenu vous est fourni TEL QUEL, pour votre information et votre usage personnel uniquement. Téléchargez la présentation en cliquant sur ce lien. Lors du téléchargement, si vous ne parvenez pas à télécharger une présentation, l’éditeur a peut-être supprimé le fichier de son serveur.Pendant le téléchargement, si vous ne parvenez pas à obtenir une présentation, le fichier a peut-être été supprimé par l’éditeur.

F I N

Plus de contenu associé

Transcription de la présentation
  1. Query Caching in Agent-based Distributed Information Retrieval Hemali Majithia Hemali Majithia - CADIP, UMBC

  2. Problem Definition • DIR (IR) systems access their collections to perform searches and answer queries • Query resolution on large corpora is expensive in terms of time and resources • Similar queries produce similar results • Repetitive and redundant searching of the collections • Resource Wastage and Inefficiency • Solution – “ CACHING QUERIES ” Hemali Majithia - CADIP, UMBC

  3. Solution • Caching Mechanism • Cache new queries along with the results • Answer future similar queries using the cached queries • New Query • Query which has not been answered before • Similar Query • Query which is identical or similar to the queries existing in the cache • Emphasis • If similar queries exist, you can retrieve the results for those queries from the previous searched queries rather than exact match • Retrieval  linear time  collection size Hemali Majithia - CADIP, UMBC

  4. Caching Mechanism • Two level Caching Mechanism • First level  Exact Match • Second level  Inverted Index of the queries • Caching Algorithm • Least Recent Used (LRU) • Least Frequent Used (LFU) • Lowest Relative Value (LRV) • Similarity Metric • Cosine Similarity Hemali Majithia - CADIP, UMBC

  5. Secondary Cache Secondary Cache 9.. Update cache 5. Miss 3. MISS 4. Query forwarded 10. Results returned 8. HIT 2. Lookup 11. Response 7. Lookup 1. User query 6. Query forwarded to best C2 Primary cache Primary cache Primary cache Primary cache Primary cache Primary cache Caching in CARROT–II Node I Node II Query Agent C2 Agent C2 Agent C2 Agent C2 Agent C2 Agent C2 Agent Hemali Majithia - CADIP, UMBC

  6. Metrics for Evaluation of Caching Mechanism • Efficiency • Round Trip Time (RTT) = Total time to answer queries fired at the system • Hit Rate = For each agent cache and total hit rate • Cost of caching = The over head caused by caching (assuming that the HIT rate is 0) • Effectiveness • Precision =fraction of retrieved documents that are relevant • Recall =fraction of relevant documents that are retrieved Hemali Majithia - CADIP, UMBC