Fusion and fission engine for an assistant robot using an ontology knowledge base

Article type: Research Article

Authors: Djaid, Nadia Touileb^{a; b; *} | Dourlens, Sébastien^b | Saadia, Nadia^a | Ramdane-Cherif, Amar^b

Affiliations: [a] LRPE Laboratory, Université des Sciences et de la Technologie Houari Boumediene, Algiers, Algeria | [b] LISV Laboratory, Université de Versailles-Saint-Quentin-en-Yvelines, Paris, France

Correspondence: [*] Corresponding author. E-mail: nadia.touileb.djaid@gmail.com.

Abstract: This paper presents our proposed multimodal system that is composed of fusion and fission engines that take into account the contextual information of the user. The fusion engine combines various input modalities to determine the overall context of a given situation. It yields the situation that needs action. This action is subdivided into smaller tasks that are sent to actuators, gadgets and other output modalities for implementation. The process is handled by the fission engine. Our goal is to build a system that helps people with disabilities interact with their ambient intelligent environment using their natural communication skills, such as speech and gesture. Both the fusion and fission engines rely on ontology which is the knowledge base of our system while taking into consideration contextual semantic information. The system design is validated through case simulation using formal specifications using colored Petri nets. This work is our contribution to the ongoing research on robotic application to render services to the handicapped and the elderly.

Keywords: Assistance robot, multimodal systems, ontology, fusion engine, fission engine

DOI: 10.3233/AIS-170458

Journal: Journal of Ambient Intelligence and Smart Environments, vol. 9, no. 6, pp. 757-781, 2017