Institutional Repository
Technical University of Crete
EN  |  EL

Search

Browse

My Space

Sketching distributed sliding-window data streams

Papapetrou Odysseas, Garofalakis Minos, Deligiannakis Antonios

Simple record


URIhttp://purl.tuc.gr/dl/dias/1277150C-846A-4DE8-9E05-B85FB9BB2AD7-
Identifierhttp://link.springer.com/article/10.1007/s00778-015-0380-7-
Identifierhttps://doi.org/10.1007/s00778-015-0380-7-
Languageen-
Extent25 pagesen
TitleSketching distributed sliding-window data streamsen
CreatorPapapetrou Odysseasen
CreatorΠαπαπετρου Οδυσσεαςel
CreatorGarofalakis Minosen
CreatorΓαροφαλακης Μινωςel
CreatorDeligiannakis Antoniosen
CreatorΔεληγιαννακης Αντωνιοςel
PublisherSpringer Verlagen
Content SummaryWhile traditional data management systems focus on evaluating single, ad hoc queries over static data sets in a centralized setting, several emerging applications require (possibly, continuous) answers to queries on dynamic data that is widely distributed and constantly updated. Furthermore, such query answers often need to discount data that is “stale” and operate solely on a sliding window of recent data arrivals (e.g., data updates occurring over the last 24 h). Such distributed data streaming applications mandate novel algorithmic solutions that are both time and space efficient (to manage high-speed data streams) and also communication efficient (to deal with physical data distribution). In this paper, we consider the problem of complex query answering over distributed, high-dimensional data streams in the sliding-window model. We introduce a novel sketching technique (termed ECM-sketch) that allows effective summarization of streaming data over both time-based and count-based sliding windows with probabilistic accuracy guarantees. Our sketch structure enables point, as well as inner product, queries and can be employed to address a broad range of problems, such as maintaining frequency statistics, finding heavy hitters, and computing quantiles in the sliding-window model. Focusing on distributed environments, we demonstrate how ECM-sketches of individual, local streams can be composed to generate a (low-error) ECM-sketch summary of the order-preserving merging of all streams; furthermore, we show how ECM-sketches can be exploited for continuous monitoring of sliding-window queries over distributed streams. Our extensive experimental study with two real-life data sets validates our theoretical claims and verifies the effectiveness of our techniques. To the best of our knowledge, ours is the first work to address efficient, guaranteed-error complex query answering over distributed data streams in the sliding-window model.en
Type of ItemPeer-Reviewed Journal Publicationen
Type of ItemΔημοσίευση σε Περιοδικό με Κριτέςel
Licensehttp://creativecommons.org/licenses/by/4.0/en
Date of Item2015-11-17-
Date of Publication2015-
SubjectSketches en
SubjectContinuous queriesen
SubjectDistributed monitoringen
Bibliographic CitationO. Papapetrou, M. Garofalakis, and A. Deligiannakis, "Sketching distributed sliding-window data streams", VLDB J., vol. 24, no. 3, pp. 345-368, Jun. 2015. doi:10.1007/s00778-015-0380-7en

Services

Statistics