Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol

Li Fan, Pei Cao and Jussara Almeida
Computer Sciences Department
University of Wisconsin-Madison

Andrei Z. Broder
Systems Research Center
Digital Equipment Corporation


cao@cs.wisc.edu


Currently the paper can be referenced as "Technical Report 1361, Computer Sciences Department, University of Wisconsin-Madison."

Please send email to cao@cs.wisc.edu for a copy of the paper.

Abstract

The sharing of caches among Web proxies is an important technique to reduce Web traffic and alleviate network bottlenecks. Nevertheless it is not widely deployed due to the overhead of existing protocols. In this paper we demonstrate the benefits of cache sharing, measure the overhead of the existing protocols, and propose a new protocol called ``Summary Cache''. In this new protocol, each proxy keeps a summary of the cache directory of each participating proxy, and checks these summaries for potential hits before sending any queries. Two factors contribute to our protocol's low overhead: the summaries are updated only periodically, and the directory representations are very economical, as low as 8 bits per entry. Using trace-driven simulations and a prototype implementation, we show that, compared to existing protocols such as the Internet Cache Protocol (ICP), Summary Cache reduces the number of inter-cache protocol messages by a factor of 40 to 65}, reduces the bandwidth consumption by over 50%, eliminates 75% and 95% of the protocol CPU overhead, all while maintain ing almost the same cache hit ratio as ICP. Hence Summary Cache scales to a large number of proxies.