File(s) under permanent embargo

Discovering frequent sets from data streams with CPU constraint

conference contribution
posted on 2007-01-01, 00:00 authored by X Dang, W K Ng, Kok-Leong Ong, V Lee
Data streams are usually generated in an online fashion characterized by huge volume, rapid unpredictable rates, and fast changing data characteristics. It has been hence recognized that mining over streaming data requires the problem of limited computational resources to be adequately addressed. Since the arrival rate of data streams can significantly increase and exceed the CPU capacity, the machinery must adapt to this change to guarantee the timeliness of the results. We present an online algorithm to approximate a set of frequent patterns from a sliding window over the underlying data stream - given apriori CPU capacity. The algorithm automatically detects overload situations and can adaptively shed unprocessed data to guarantee the timely results. We theoretically prove, using probabilistic and deterministic techniques, that the error on the output results is bounded within a pre-specified threshold. The empirical results on various datasets also confirmed the feasiblity of our proposal.

History

Event

Australasian Data Mining Conference (6th : 2007 : Gold Coast, Queensland)

Pagination

117 - 124

Publisher

Australian Computer Society

Location

Gold Coast, Queensland

Place of publication

Sydney, N.S.W.

Start date

2007-12-03

End date

2007-12-04

ISBN-13

9781920682514

ISBN-10

1920682511

Language

eng

Publication classification

E1 Full written paper - refereed

Copyright notice

2007 Australian Computer Society, Inc.

Editor/Contributor(s)

P Christen, P Kennedy, J Li, I Kolyshkina, G Williams

Title of proceedings

Data mining and analytics 2007 : proceedings of the sixth Australasian Data Mining Conference (AusDM2007), Gold Coast, Australia, 3-4 December, 2007