Deakin University
Browse

File(s) under permanent embargo

Estimation of Locally Relevant Subspace in High-dimensional Data

conference contribution
posted on 2020-02-04, 00:00 authored by Srikanth ThudumuSrikanth Thudumu, P Branch, J Jin, J Singh
High-dimensional data is becoming more and more available due to the advent of big data and IoT. Having more dimensions makes data analysis cumbersome increasing the sparsity of data points due to the problem called "curse of dimensionality". To address this problem, global dimensionality reduction techniques are used; however, these techniques are ineffective in revealing hidden outliers from the high-dimensional space. This is due to the behaviour of outliers being hidden in the subspace where they belong; hence, a locally relevant subspace is needed to reveal the hidden outliers. In this paper, we present a technique that identifies a locally relevant subspace and associated low-dimensional subspaces by deriving a final correlation score. To verify the effectiveness of the technique in determining the generalised locally relevant subspace, we evaluate the results with a benchmark data set. Our comparative analysis shows that the technique derived the locally relevant subspace that consists of relevant dimensions presented in benchmark data set.

History

ISBN-13

9781450376976

Publication classification

E2 Full written paper - non-refereed / Abstract reviewed

Title of proceedings

ACM International Conference Proceeding Series

Usage metrics

    Research Publications

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC