Deakin University
Browse

Improving the Effectiveness and Efficiency of Stochastic Neighbour Embedding with Isolation Kernel

Download (3.59 MB)
journal contribution
posted on 2021-01-01, 00:00 authored by Ye ZhuYe Zhu, Kai Ming Ting
This paper presents a new insight into improving the performance of Stochastic Neighbour Embedding (t-SNE) by using Isolation kernel instead of Gaussian kernel. Isolation kernel outperforms Gaussian kernel in two aspects. First, the use of Isolation kernel in t-SNE overcomes the drawback of misrepresenting some structures in the data, which often occurs when Gaussian kernel is applied in t-SNE. This is because Gaussian kernel determines each local bandwidth based on one local point only, while Isolation kernel is derived directly from the data based on space partitioning. Second, the use of Isolation kernel yields a more efficient similarity computation because data-dependent Isolation kernel has only one parameter that needs to be tuned. In contrast, the use of data-independent Gaussian kernel increases the computational cost by determining n bandwidths for a dataset of n points. As the root cause of these deficiencies in t-SNE is Gaussian kernel, we show that simply replacing Gaussian kernel with Isolation kernel in t-SNE significantly improves the quality of the final visualisation output (without creating misrepresented structures) and removes one key obstacle that prevents t-SNE from processing large datasets. Moreover, Isolation kernel enables t-SNE to deal with large-scale datasets in less runtime without trading off accuracy, unlike existing methods in speeding up t-SNE.

History

Journal

Journal of Artificial Intelligence Research

Volume

71

Pagination

667-695

Location

Palo Alto, Calif.

Open access

  • Yes

ISSN

1076-9757

eISSN

1076-9757

Language

eng

Publication classification

C1 Refereed article in a scholarly journal

Publisher

A A A I Press

Usage metrics

    Research Publications

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC