Welcome to the ADMT Publication Server

Scalable data dissemination using hybrid methods

DocUID: 2008-016 Full Text: PDF

Author: Wenhui Zhang, Vincenzo Liberatore, Jonathan Beaver, Panos K. Chrysanthis, Kirk Pruhs

Abstract: Web server scalability can be greatly enhanced via hybrid data dissemination methods that use both unicast and multicast. Hybrid data dissemination is particularly promising due to the development of effective end-to-end multicast methods and tools. Hybrid data dissemination critically relies on document selection which determines the data transfer method that is most appropriate for each data item. In this paper, we study document selection with a special focus on actual end-point implementations and Internet network conditions. We individuate special challenges such as scalable and robust popularity estimation, appropriate classification of hot and cold documents, and unpopular large documents. We propose solutions to these problems, integrate them in MBDD (middleware support multicast-based data dissemination) and evaluate them on PlanetLab with collected traces. Results show that the multicast server can effectively adapt to dynamic environments and is substantially more scalable than traditional Web servers. Our work is a significant contribution to building practical hybrid data dissemination services.

Keywords: nternet, middleware, multicast communication, web servers

Published In: Proc. of IEEE International Symposium on Parallel and Distributed Processing

ISBN: 978-1-4244-1693-6

Pages: pp. 1-12

Place Published: Miami, Florida

Year Published: 2008

Project: Others Subject Area: Data Dissemination

Publication Type: Conference Paper

Sponsor: NSF ANI-0123705

Citation:Text Latex BibTex XML Wenhui Zhang, Vincenzo Liberatore, Jonathan Beaver, Panos K. Chrysanthis, and Kirk Pruhs. Scalable data dissemination using hybrid methods, Proc. of IEEE International Symposium on Parallel and Distributed Processing (IPDPS'08), pp. 1-12, 978-1-4244-1693-6, Miami, Florida, April 2008.