Preemptive Rate-based Operator Scheduling in a Data Stream Management System
DocUID: 2005-012 Full Text:
PDF Author: Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis
Abstract: Data Stream Management Systems are being developed to process continuous queries over multiple data streams. These continuous queries are typically used for monitoring purposes where the detection of an event might trigger a sequence of actions or the execution of a set of specified tasks. Such events are identified by tuples produced by a query and hence, it is important to produce the available portions of a query result as early as possible. A core element for improving the interactive performance of a continuous query is the operator scheduler. An operator scheduler is particularly important when the processing requirements and the productivity of different streams are highly skewed. The need for an operator scheduler becomes even more crucial when tuples from different streams arrive asynchronously. To meet these needs, we are proposing a Preemptive Rate-based scheduling policy that handles the asynchronous nature of tuple arrival and the heterogeneity in the query plan. Experimental results show the significant improvements provided by our proposed policy.
Published In: Proc. of the Third ACS/IEEE International Conference on Computer Systems and Applications
Pages: p. 46
Place Published: Cairo, Egypt
Year Published: 2005
Project: AQSIOS Subject Area: Data Streams
Publication Type: Conference Paper
Sponsor: NSF ITR ANI-0325353