Semantic referee: A neural-symbolic framework for enhancing geospatial semantic segmentation

Issue title: Special Issue on Semantic Deep Learning

Guest editors: Dagmar Gromann, Luis Espinosa Anke and Thierry Declerck

Article type: Research Article

Authors: Alirezaie, Marjan^{a; *} | Längkvist, Martin^a | Sioutis, Michael^b | Loutfi, Amy^a

Affiliations: [a] Center for Applied Autonomous Sensor Systems, Orebro University, Örebro, Sweden | [b] Department of Computer Science, Aalto University, Espoo, Finland

Correspondence: [*] Corresponding author. E-mail: Marjan.Alirezaie@oru.se.

Abstract: Understanding why machine learning algorithms may fail is usually the task of the human expert that uses domain knowledge and contextual information to discover systematic shortcomings in either the data or the algorithm. In this paper, we propose a semantic referee, which is able to extract qualitative features of the errors emerging from deep machine learning frameworks and suggest corrections. The semantic referee relies on ontological reasoning about spatial knowledge in order to characterize errors in terms of their spatial relations with the environment. Using semantics, the reasoner interacts with the learning algorithm as a supervisor. In this paper, the proposed method of the interaction between a neural network classifier and a semantic referee shows how to improve the performance of semantic segmentation for satellite imagery data.

Keywords: Deep neural network, semantic referee, ontological and spatial reasoning, semantic segmentation, ontocity, geo data

DOI: 10.3233/SW-190362

Journal: Semantic Web, vol. 10, no. 5, pp. 863-880, 2019