Deakin University
Browse

Online learning for vector autoregressive moving-average time series prediction

Version 2 2024-06-03, 18:09
Version 1 2019-06-27, 09:55
journal contribution
posted on 2024-06-03, 18:09 authored by H Yang, Z Pan, Q Tao, J Qiu
© 2018 Multivariate time series analysis considers simultaneously multiple time series, which is much more complicated than the univariate time series analysis in general. VARMA (vector autoregressive moving-average) is one of the most mainstream multivariate time series model for time series prediction. However, the parameters of VARMA are often estimated in a batch manner in traditional multivariate statistical analysis and the noise terms are assumed Gaussian. In addition, the batch methods cannot perform satisfactorily in real-time prediction and the noise terms are unknown to us in real world. In this paper, we propose a novel online time series prediction framework for VARMA. We prove that VAR (vector autoregressive) can be used to mimic the underlying VARMA model under the online settings. Under this framework, we develop two effective algorithms VARMA-OGD and VARMA-ONS for this prediction problem assuming that the noise terms are generated stochastically and independently. The VARMA-OGD algorithm is based on the OGD (online gradient descent) algorithm, which is valid for general convex loss function. While the VARMA-ONS algorithm adopting the ONS (online newton step) algorithm is only valid for exp-concave loss function. Theoretical analysis shows that the regret bounds against the best VARMA prediction in hindsight of the proposed algorithms are sublinear of the number of samples. Furthermore, our experimental results further validate the effectiveness and robustness of our algorithms.

History

Journal

Neurocomputing

Volume

315

Pagination

9-17

Location

Amsterdam, The Netherlands

ISSN

0925-2312

eISSN

1872-8286

Language

eng

Publication classification

C1 Refereed article in a scholarly journal

Copyright notice

2018, Elsevier B.V.

Publisher

Elsevier

Usage metrics

    Research Publications

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC