Automatic generation of visual story for fairy tales with digital narrative

Issue title: Intelligent Interaction, Reasoning and Applications

Guest editors: Chao-Lin Liu, Mitsunori Matsushita, Yasufumi Takama, Min-Yuh Day and Vincent Shin-Mu Tseng

Article type: Research Article

Authors: Li, Cheng-Te^{a; *} | Huang, Chieh-Jen^b | Shan, Man-Kwan^b

Affiliations: [a] Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan | [b] Department of Computer Science, National Chengchi University, Taipei, Taiwan

Correspondence: [*] Corresponding author. E-mail: ctli@citi.sinica.edu.tw.

Abstract: Pictures can realize the impressions of texts for readers, especially for fairy tales. If we can present the fairy stories in the form of visual pictures, children will not only be more willing to concentrate their attention on but also easily perceive the underlying messages. This work aims to present the fairy tales by transforming the texts to the visual form of pictures. To achieve such goal, we develop a system, VizStory, which consists of three steps. First, we investigate the narrative structure of the story to segment the whole story. Second, we select representative keywords for each segment. Third, through Web image search, we find suitable pictures to compose the visualization. Experimental results with a set of human study show VizStory can present the narrative of stories with 75% accuracy.

Keywords: Fairy tales, digital narrative, image retrieval, story telling, visual story

DOI: 10.3233/WEB-150314

Journal: Web Intelligence, vol. 13, no. 2, pp. 115-122, 2015