Research on image matching algorithm improvement using semantic segmentation

Article type: Research Article

Authors: Chen, Yongbin | He, Hanwu^* | Wang, Guitang | Chen, Heen | Zhu, Teng

Affiliations: Guangdong University of Technology, Guangzhou, Guangdong, China

Correspondence: [*] Corresponding author: Hanwu He, Guangdong University of Technology, Guangzhou, Guangdong, China. E-mail: hwhe@gdut.edu.cn.

Abstract: Image matching plays an important role in Augmented Reality, Simultaneous Localization and Map ping (SLAM), and unmanned. The key issue of image matching is the accuracy of feature matching between adjacent images. Due to the complicated environment, matching between images through geometry feature runs into bottlenecks. In this paper, we focus on improving the accuracy of feature matching by incorporating instance-aware semantic segmentation into Oriented FAST and Rotated BRIEF (ORB) feature matching, which is broadly utilized in image registration and Visual SLAM. We segment the objects between the adjacent images on pixel level and qualify the features matching procedure using the semantic information. Experiment results show that our novel proposed method increases the accuracy of feature matching.

Keywords: Image matching, semantic segmentation, ORB

DOI: 10.3233/JCM-193891

Journal: Journal of Computational Methods in Sciences and Engineering, vol. 20, no. 2, pp. 553-562, 2020