Paper and Pencil Interactive Storytelling

In this project, we explore the use of an augmented reality visualization interface combined with a sketch-based interaction interface. We present a storytelling system able to dramatize interactive narratives in augmented reality over a conventional sheet of paper. The system allows users to freely interact with virtual characters by sketching objects on the paper. The system recognizes the hand-drawn sketches and converts the drawings into virtual objects in the 3D story world.

Status:

Contributions:
  • We propose a sketch-based interaction method for interactive storytelling.
  • We present a storytelling system able to dramatize interactive narratives in augmented reality over a conventional sheet of paper.
  • The use of hand drawings as a form of interaction improves user satisfaction and experience and the system's usability.
Publications:
  • Thiago Cler Franco; Edirlei Soares de Lima. Paper and Pencil Interactive Storytelling Based on Generic Hand-drawn Sketches. Proceedings of the XVI Brazilian Symposium on Computer Games and Digital Entertainment (SBGames 2017), Curitiba, Brazil, p. 594-597, 2017. [PDF]

  • Edirlei Soares de Lima; Bruno Feijó; Simone D.J. Barbosa; Antonio L. Furtado; Angelo E. M. Ciarlini; Cesar T. Pozzer. Draw Your Own Story: Paper and Pencil Interactive Storytelling. Entertainment Computing, v. 5, p. 33-41, 2014. [DOI] [PDF]

  • Edirlei Soares de Lima; Bruno Feijó; Simone D.J. Barbosa; Antonio L. Furtado; Angelo E. M. Ciarlini; Cesar T. Pozzer. Draw Your Own Story: Paper and Pencil Interactive Storytelling. Proceedings of the 10th International Conference on Entertainment Computing (ICEC 2011), Vancouver, Canada, October 2011, pp. 1-12. ISBN: 978-3-642-24499-5. [PDF] [DOI]

Media: