Welcome to the ADMT Publication Server

Avoiding class warfare: Managing Continuous Queries with Differentiated Classes of Service

DocUID: 2016-004

Author: Thao N. Pham, Panos K. Chrysanthis, Alexandros Labrinidis

Abstract: Data stream management systems (DSMSs) offer the most effective solution for processing data streams by efficiently executing continuous queries (CQs) over the incoming data. CQs inherently have different levels of criticality and hence different levels of expected quality of service (QoS) and quality of data (QoD). Adhering to such expected QoS/QoD metrics is even more important in cases of multi-tenant data stream management services. In this work, we propose DILoS, a framework that, through priority-based scheduling and load shedding, supports differentiated QoS and QoD for multiple classes of CQs. Unlike existing works that consider scheduling and load shedding separately, DILoS is a novel unified framework that exploits the synergy between scheduling and load shedding. We also propose ALoMa, a general, adaptive load manager that DILoS is built upon. By its design, ALoMa performs better than the state-of-the-art alternatives in three dimensions: (1) it automatically tunes the headroom factor, (2) it honors the delay target, (3) it is applicable to complex query networks with shared operators. We implemented DILoS and ALoMa in our real DSMS prototype system (AQSIOS) and evaluate their performance for a variety of real and synthetic workloads. Our experimental evaluation of ALoMa verified its clear superiority over the state-of-the-art approaches. Our experimental evaluation of the DILoS framework showed that it (a) allows the scheduler and load shedder to consistently honor CQs’ priorities, (b) significantly increases system capacity utilization by exploiting batch processing, and (c) enables operator sharing among query classes of different priorities while avoiding priority inversion, i.e., a lower-priority class never blocks a higher priority one.

Keywords: Data stream management system, Continuous query, Multi-tenant, Load shedding, Scheduling

Published In: VLDB Journal

Volume: 25Number: 2Pages: 197-221

Year Published: 2016

Note: 11/12/2015 published on-line

DOI: 10.1007/s00778-015-0411-4

Project: AQSIOS,   STREAMS Subject Area: Data Streams

Publication Type: Journal Paper

Sponsor: NSF OIA-1028162, NSF CAREER IIS-0746696, NSF IIS-0534531, EMC/ Greenplum

Citation:Text Latex BibTex XML Thao N. Pham, Panos K. Chrysanthis, and Alexandros Labrinidis. Avoiding class warfare: Managing Continuous Queries with Differentiated Classes of Service. VLDB Journal. 25(2):197-221. 2016. DOI: 10.1007/s00778-015-0411-4. (Note: 11/12/2015 published on-line).