Deakin University

File(s) under permanent embargo

Topic transition detection using hierarchical hidden Markov and semi-Markov models

conference contribution
posted on 2005-01-01, 00:00 authored by Quoc-Dinh Phung, Thi Duong, Svetha VenkateshSvetha Venkatesh, H Bui
In this paper we introduce a probabilistic framework to exploit hierarchy, structure sharing and duration information for topic transition detection in videos. Our probabilistic detection framework is a combination of a shot classification step and a detection phase using hierarchical probabilistic models. We consider two models in this paper: the extended Hierarchical Hidden Markov Model (HHMM) and the Coxian Switching Hidden semi-Markov Model (S-HSMM) because they allow the natural decomposition of semantics in videos, including shared structures, to be modeled directly, and thus enabling efficient inference and reducing the sample complexity in learning. Additionally, the S-HSMM allows the duration information to be incorporated, consequently the modeling of long-term dependencies in videos is enriched through both hierarchical and duration modeling. Furthermore, the use of the Coxian distribution in the S-HSMM makes it tractable to deal with long sequences in video. Our experimentation of the proposed framework on twelve educational and training videos shows that both models outperform the baseline cases (flat HMM and HSMM) and performances reported in earlier work in topic detection. The superior performance of the S-HSMM over the HHMM verifies our belief that duration information is an important factor in video content modeling.



ACM International Conference on Multimedia (13th : 2005 : Singapore, Singapore)


11 - 20


Association for Computing Machinery


Singapore, Singapore

Place of publication

New York, N. Y.

Start date


End date






Publication classification

E1.1 Full written paper - refereed

Copyright notice

2005, ACM

Title of proceedings

MM'05 : Proceedings of the 13th ACM International Conference on Multimedia

Usage metrics

    Research Publications


    No categories selected