Discovering frequent sets from data streams with CPU constraint
Dang, Xuan Hong, Ng, Wee-Keong, Ong, Kok-Leong and Lee, Vincent C. S. 2007, Discovering frequent sets from data streams with CPU constraint, in Data mining and analytics 2007 : proceedings of the sixth Australasian Data Mining Conference (AusDM2007), Gold Coast, Australia, 3-4 December, 2007, Australian Computer Society, Sydney, N.S.W., pp. 117-124.
Attached Files
(Some files may be inaccessible until you login with your Deakin Research Online credentials)
Name
Description
MIMEType
Size
Downloads
Title
Discovering frequent sets from data streams with CPU constraint
Data streams are usually generated in an online fashion characterized by huge volume, rapid unpredictable rates, and fast changing data characteristics. It has been hence recognized that mining over streaming data requires the problem of limited computational resources to be adequately addressed. Since the arrival rate of data streams can significantly increase and exceed the CPU capacity, the machinery must adapt to this change to guarantee the timeliness of the results. We present an online algorithm to approximate a set of frequent patterns from a sliding window over the underlying data stream - given apriori CPU capacity. The algorithm automatically detects overload situations and can adaptively shed unprocessed data to guarantee the timely results. We theoretically prove, using probabilistic and deterministic techniques, that the error on the output results is bounded within a pre-specified threshold. The empirical results on various datasets also confirmed the feasiblity of our proposal.
ISBN
9781920682514 1920682511
Language
eng
Field of Research
080604 Database Management
Socio Economic Objective
970108 Expanding Knowledge in the Information and Computing Sciences