Searching for just a few words should be enough to get started. If you need to make more complex queries, use the tips below to guide you.
Issue title: IJCAI-ECAI-18 Demonstration Track
Guest editors: Paul Weng
Article type: Research Article
Authors: Meo, Timothy J. | Kim, Chris; * | Raghavan, Aswin | Tozzo, Alex | Salter, David A. | Tamrakar, Amir | Amer, Mohamed R.; **
Affiliations: SRI International, 201 Washington Rd, Princeton, NJ 08540, USA
Correspondence: [**] Corresponding author. E-mail: mohamed.amer@sri.com.
Note: [*] The author is currently a student at University of Ontario Institute of Technology and this work was done while he was an intern at SRI International.
Abstract: We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Our system operates in two main modes, common sense grounding (annotation) and conversation. The Aesop system senses the human state and input using a natural language parser and human gesture monitoring for natural interactions. The interface consists of a 3D animation software and a web controller to interact with the internal state of the system. For knowledge representation, we formulate novel knowledge graphs which enable spatio-temporal event representation. Aesop thus enables 3D spatial and temporal reasoning which are both essential for storytelling. Finally, the system utilizes a dialog manager to track the conversation state and manage goals. Aesop provides a rich platform that enables research in language, gestures, vision, and planning in the context of storytelling.
Keywords: Visual storytelling, common sense grounding, natural language, knowledge representation, dialogue, language and vision, conversational AI, communication
DOI: 10.3233/AIC-180605
Journal: AI Communications, vol. 32, no. 1, pp. 59-76, 2019
IOS Press, Inc.
6751 Tepper Drive
Clifton, VA 20124
USA
Tel: +1 703 830 6300
Fax: +1 703 830 2300
sales@iospress.com
For editorial issues, like the status of your submitted paper or proposals, write to editorial@iospress.nl
IOS Press
Nieuwe Hemweg 6B
1013 BG Amsterdam
The Netherlands
Tel: +31 20 688 3355
Fax: +31 20 687 0091
info@iospress.nl
For editorial issues, permissions, book requests, submissions and proceedings, contact the Amsterdam office info@iospress.nl
Inspirees International (China Office)
Ciyunsi Beili 207(CapitaLand), Bld 1, 7-901
100025, Beijing
China
Free service line: 400 661 8717
Fax: +86 10 8446 7947
china@iospress.cn
For editorial issues, like the status of your submitted paper or proposals, write to editorial@iospress.nl
如果您在出版方面需要帮助或有任何建, 件至: editorial@iospress.nl