A fault-tolerant cache service for web search engines

Carlos Gómez-Pantoja, Veronica Gil-Costa, Dolores Rexachs, Mauricio Marin, Emilio Luque

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Large Web search engines are constructed as a collection of services that are deployed on dedicated clusters of distributed-memory processors. In particular, efficient user query throughput heavily relies on using result cache services devoted to maintaining the answers to most frequent queries. Load balancing and fault tolerance are critical to this service. This paper proposes the design of a result cache service based on consistent hashing and a strategy for enabling fault tolerance. Performance evaluation is performed by using actual queries from a commercial search engine. The results show that the proposed cache service outperforms baseline approaches, decreases the average query response time, increases query throughput and efficiently recovers performance after processor failures.

Original languageEnglish
Title of host publicationProceedings of the 2012 10th IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2012
Pages427-434
Number of pages8
DOIs
Publication statusPublished - 15 Oct 2012
Event2012 10th IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2012 - Madrid, Spain
Duration: 10 Jul 201213 Jul 2012

Conference

Conference2012 10th IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2012
Country/TerritorySpain
CityMadrid
Period10/07/1213/07/12

Keywords

  • Caching Services
  • Fault-Tolerance
  • Load Balancing
  • Web Search Engine

ASJC Scopus subject areas

  • Computer Science Applications
  • Software

Fingerprint

Dive into the research topics of 'A fault-tolerant cache service for web search engines'. Together they form a unique fingerprint.

Cite this