Institutional Repository
Technical University of Crete
EN  |  EL

Search

Browse

My Space

Sketch-based querying of distributed sliding-window data streams

Papapetrou Odysseas, Garofalakis Minos, Deligiannakis Antonios

Simple record


URIhttp://purl.tuc.gr/dl/dias/73B079AE-B219-4669-99D7-C156B1AFB8C3-
Identifierhttp://vldb.org/pvldb/vol5/p992_odysseaspapapetrou_vldb2012.pdf-
Identifierhttps://doi.org/10.14778/2336664.2336672-
Languageen-
Extent12 pagesen
TitleSketch-based querying of distributed sliding-window data streamsen
CreatorPapapetrou Odysseasen
CreatorΠαπαπετρου Οδυσσεαςel
CreatorGarofalakis Minosen
CreatorΓαροφαλακης Μινωςel
CreatorDeligiannakis Antoniosen
CreatorΔεληγιαννακης Αντωνιοςel
PublisherAssociation for Computing Machineryen
Content SummaryWhile traditional data-management systems focus on evaluating single, adhoc queries over static data sets in a centralized setting, several emerging applications require (possibly, continuous) answers to queries on dynamic data that is widely distributed and constantly updated. Furthermore, such query answers often need to discount data that is “stale”, and operate solely on a sliding window of recent data arrivals (e.g., data updates occurring over the last 24 hours). Such distributed data streaming applications mandate novel algorithmic solutions that are both time- and space-efficient (to manage high-speed data streams), and also communication-efficient (to deal with physical data distribution). In this paper, we consider the problem of complex query answering over distributed, high-dimensional data streams in the sliding-window model. We introduce a novel sketching technique (termed ECM-sketch) that allows effective summarization of streaming data over both time-based and count-based sliding windows with probabilistic accuracy guarantees. Our sketch structure enables point as well as inner-product queries, and can be employed to address a broad range of problems, such as maintaining frequency statistics, finding heavy hitters, and computing quantiles in the sliding-window model. Focusing on distributed environments, we demonstrate how ECM-sketches of individual, local streams can be composed to generate a (low-error) ECM-sketch summary of the order-preserving aggregation of all streams; furthermore, we show how ECM-sketches can be exploited for continuous monitoring of sliding-window queries over distributed streams. Our extensive experimental study with two real-life data sets validates our theoretical claims and verifies the effectiveness of our techniques. To the best of our knowledge, ours is the first work to address efficient, guaranteed-error complex query answering over distributed data streams in the sliding-window model. en
Type of ItemΠλήρης Δημοσίευση σε Συνέδριοel
Type of ItemConference Full Paperen
Licensehttp://creativecommons.org/licenses/by/4.0/en
Date of Item2015-11-30-
Date of Publication2012-
SubjectInformation systemsen
SubjectData managementen
Bibliographic CitationO. Papapetrou, M. Garofalakis and A. Deligiannakis, "Sketch-based querying of distributed sliding-window data streams", in 2012 VLDB Endowment, vol. 5, no. 10, pp. 992-1003. doi: 10.14778/2336664.2336672 en

Services

Statistics