Virtual Cinematography for Interactive Storytelling

Interactive storytelling systems are applications that aim to tell stories and allow the users to interact with the system in order to change the future story events. In respect to the visual representation of the stories, there are several challenges related to the manner how the scenes should be shown to the public. Many of these challenges that today are faced in the development of interactive storytelling systems have been treated before by several filmmakers. Over the years the cinema has evolved and established various principles and rules to be adopted during the creation of a film. However, unlike movies, where every scene is carefully planned before it was filmed, and if a problem occurs it is simply filmed again, in interactive storytelling this freedom does not exist; usually the storyline of the narrative results from the real-time interaction between the viewers and the virtual actors. The dramatization of stories, whose sequence of events is unknown, depends on a robust dramatization system, which adapts itself appropriately to any type of scene. This project explores the use autonomous agents inspired on cinematography to dramatize interactive narratives.

Status:

Contributions:
  • We propose a dramatization architecture composed by a set of autonomous agents inspired on cinematography.
  • We present cinematography director that selects in real time the best camera shots for the dramatization scenes in storytelling environments.
  • We propose two autonomous agents (director of photography and a music director) to create and manipulate the audio and visual aspects of the dramatization of a story to express emotions.
Publications:
  • Edirlei Soares de Lima. Um Modelo De Dramatização Baseado Em Agentes Cinematográficos Autônomos Para Storytelling Interativo. Dissertação de Mestrado. Universidade Federal de Santa Maria (UFSM), Santa Maria, Brazil, 2010. [PDF]

  • Edirlei Soares de Lima; Cesar T. Pozzer; Bruno Feijó; Angelo E. M. Ciarlini; Antonio L. Furtado. Director of Photography and Music Director for Interactive Storytelling. Proceedings of the IX Brazilian Symposium on Computer Games and Digital Entertainment (SBGames 2010), Florianopolis, Brazil, November 2010, pp. 129-137. ISBN: 978-0-7695-4359-8 [PDF] [DOI]

  • Edirlei Soares de Lima; Cesar T. Pozzer; Marcos C. d’Ornellas; Angelo E. M. Ciarlini; Bruno Feijó; Antonio L. Furtado. Virtual Cinematography Director for Interactive Storytelling. Proceedings of the International Conference on Advances in Computer Entertainment Technology (ACE 2009), Athens, Greece, October 2009, pp. 263-270. ISBN: 978-1-60558-864-3 [PDF] [DOI]

  • Edirlei Soares de Lima; Cesar T. Pozzer; Marcos C. d’Ornellas; Angelo E. M. Ciarlini; Bruno Feijó; Antonio L. Furtado. Support Vector Machines for Cinematography Real-Time Camera Control in Storytelling Environments. Proceedings of the VIII Brazilian Symposium on Computer Games and Digital Entertainment (SBGames 2009), Rio de Janeiro, Brazil, October 2009, pp. 44-51. ISBN: 978-0-7695-3963-8. [PDF] [DOI]

Media: