Logo image
Maintaining Moving Sums over Data Streams
Thesis

Maintaining Moving Sums over Data Streams

Tzu-Chiang Wu
Masters, 國立清華大學, 資訊系統與應用研究所
2004

Abstract

資料串流 移動和 滑動視窗 data stream moving sum sliding window
Given a data stream of numerical data elements generated from multiple sources, we consider the problem of maintaining the sum of the elements for each data source over a sliding window of the data stream. The difficulties of the problem come from two parts. One is the number of data sources and the other is the number of elements in the sliding window. For massive data sources, we need a significant number of counters to maintain the sum for each data source, while for a large number of data elements in the sliding window, we need a huge space to keep all of them. We propose two methods, which shares the counters efficiently and merge the data elements systematically so that we are able to estimate the sums using a concise data structure. Two parameters, epsilon and delta, are needed to construct the data structure. Epsilon controls the bounds of the estimate and delta represents the confidence level that the estimate is within the bounds. The estimates of both methods are proven to be bounded within a factor of □ at 1-delta probability. A qualitative analysis of these two methods is presented to contrast these two methods, and the experimental results further show the performance of these two methods.

Metrics

1 Record Views

Details

Logo image