Learning of plan execution policies for indoor navigation

Issue title: Joint German/Austrian Conference on Artificial Intelligence (KI‐2001) Vienna, Austria, 19–21 September 2001

Article type: Research Article

Authors: Belker, Thorsten | Beetz, Michael | Cremers, Armin B.

Affiliations: Department of Computer Science III, University of Bonn, Germany E‐mail: {belker,abc}@cs.uni‐bonn.de | Department of Computer Science IX, Munich University of Technology, Germany E‐mail: beetzm@in.tum.de

Abstract: Most state‐of‐the‐art navigation systems for autonomous service robots decompose navigation into global navigation planning and local (reactive) navigation. While the methods for navigation planning and local navigation themselves are well understood, the plan execution problem, the problem of how to generate and parameterize local navigation actions from a given navigation plan, is largely unsolved. This article describes how a robot can autonomously learn to execute navigation plans. We investigate how the robot can acquire causal models of the actions executable by the local navigation system and we develop a decision theoretic action selection function which uses the models learned to execute a given navigation plan. Finally, we show, both in simulation and on a RWI B21 mobile robot, that the learned action selection function improves the robot's navigation performance compared to standard plan execution techniques.

Keywords: Robot learning, robot navigation, plan execution

Journal: AI Communications, vol. 15, no. 1, pp. 3-16, 2002