venkatesh-towardautomatic-2002.pdf (345.45 kB)
Toward automatic extraction of expressive elements from motion pictures : tempo
journal contribution
posted on 2002-01-01, 00:00 authored by B Adams, C Dorai, Svetha VenkateshSvetha VenkateshThis paper addresses the challenge of bridging the semantic gap that exists between the simplicity of features that can be currently computed in automated content indexing systems and the richness of semantics in user queries posed for media search and retrieval. It proposes a unique computational approach to extraction of expressive elements of motion pictures for deriving high-level semantics of stories portrayed, thus enabling rich video annotation and interpretation. This approach, motivated and directed by the existing cinematic conventions known as film grammar, as a first step toward demonstrating its effectiveness, uses the attributes of motion and shot length to define and compute a novel measure of tempo of a movie. Tempo flow plots are defined and derived for a number of full-length movies and edge analysis is performed leading to the extraction of dramatic story sections and events signaled by their unique tempo. The results confirm tempo as a useful high-level semantic construct in its own right and a promising component of others such as rhythm, tone or mood of a film. In addition to the development of this computable tempo measure, a study is conducted as to the usefulness of biasing it toward either of its constituents, namely, motion or shot length. Finally, a refinement is made to the shot length normalizing mechanism, driven by the peculiar characteristics of shot length distribution exhibited by movies. Results of these additional studies, and possible applications and limitations are discussed.
History
Journal
IEEE transactions on multimediaVolume
4Issue
4Pagination
472 - 481Publisher
IEEELocation
Piscataway, N. J.Publisher DOI
ISSN
1520-9210eISSN
1941-0077Language
engNotes
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.Publication classification
C1.1 Refereed article in a scholarly journalCopyright notice
2002, IEEEUsage metrics
Categories
No categories selectedKeywords
content-based search and annotationdramatic sectionseventsexpressive elementsfilm grammarfilm pacegenresmoodotion picturessemantic gapstylessubjective timetempovideo archiveScience & TechnologyTechnologyComputer Science, Information SystemsComputer Science, Software EngineeringTelecommunicationsComputer Sciencemotion pictures
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC