You are not logged in.

Mechanisms for multimodality : taking fiction to another dimension

Glass, Kevin, Bangay, Shaun and Alcock, Bruce 2007, Mechanisms for multimodality : taking fiction to another dimension, in Afrigraph '07 : proceedings of the 5th international conference on computer graphics, virtual reality, visualisation and interaction in Africa, Association for Computing Machinery, New York, N.Y., pp. 135-144, doi: 10.1145/1294685.1294708.

Attached Files
Name Description MIMEType Size Downloads

Title Mechanisms for multimodality : taking fiction to another dimension
Author(s) Glass, Kevin
Bangay, Shaun
Alcock, Bruce
Conference name International conference on computer graphics, virtual reality, visualisation and interaction in Africa (5th : 2007 : Grahamstown, South Africa)
Conference location Grahamstown, South Africa
Conference dates 29-31 Oct. 2007
Title of proceedings Afrigraph '07 : proceedings of the 5th international conference on computer graphics, virtual reality, visualisation and interaction in Africa
Editor(s) Spencer, Stephen N.
Publication date 2007
Conference series International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa
Start page 135
End page 144
Publisher Association for Computing Machinery
Place of publication New York, N.Y.
Keyword(s) multimodality
text-to-scene conversion
constraint solving
Summary We present methods for automatically constructing representations of fiction books in a range of modalities: audibly, graphically and as 3D virtual environments. The correspondence between the sequential ordering of events against the order of events presented in the text is used to correctly resolve the dynamic interactions for each representation. Synthesised audio created from the fiction text is used to calibrate the base time-line against which the other forms of media are correctly aligned. The audio stream is based on speech synthesis using the text of the book, and is enhanced using distinct voices for the different characters in a book. Sound effects are included automatically. The graphical representation represents the text (as subtitles), identifies active characters and provides visual feedback of the content of the story. Dynamic virtual environments conform to the constraints implied by the story, and are used as a source of further visual content. These representations are all aligned to a common time-line, and combined using sequencing facilities to provide a multimodal version of the original text.
ISBN 9781595939067
Language eng
DOI 10.1145/1294685.1294708
Field of Research 080111 Virtual Reality and Related Simulation
Socio Economic Objective 890299 Computer Software and Services not elsewhere classified
HERDC Research category E1.1 Full written paper - refereed
Copyright notice ©2007, Association for Computing Machinery
Persistent URL http://hdl.handle.net/10536/DRO/DU:30039196

Document type: Conference Paper
Collection: School of Information Technology
Connect to link resolver
 
Unless expressly stated otherwise, the copyright for items in DRO is owned by the author, with all rights reserved.

Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 0 times in TR Web of Science
Scopus Citation Count Cited 0 times in Scopus
Google Scholar Search Google Scholar
Access Statistics: 187 Abstract Views, 1 File Downloads  -  Detailed Statistics
Created: Mon, 24 Oct 2011, 11:42:50 EST

Every reasonable effort has been made to ensure that permission has been obtained for items included in DRO. If you believe that your rights have been infringed by this repository, please contact drosupport@deakin.edu.au.