Cross-form efficient attention pyramidal network for semantic image segmentation

Article type: Research Article

Authors: Maurya, Anamika^{; *} | Chand, Satish

Affiliations: School of Computer and Systems Sciences, Jawaharlal Nehru University, New Delhi 110067, India

Correspondence: [*] Corresponding author. E-mail: anamika.maurya04@gmail.com.

Abstract: Although convolutional neural networks (CNNs) are leading the way in semantic segmentation, standard methods still have some flaws. First, there is feature redundancy and less discriminating feature representations. Second, the number of effective multi-scale features is limited. In this paper, we aim to solve these constraints with the proposed network that utilizes two effective pre-trained models as an encoder. We develop a cross-form attention pyramid that acquires semantically rich multi-scale information from local and global priors. A spatial-wise attention module is introduced to further enhance the segmentation findings. It highlights more discriminating regions of low-level features to focus on significant location information. We demonstrate the efficacy of the proposed network on three datasets, including IDD Lite, PASCAL VOC 2012, and CamVid. Our model achieves a mIoU score of 70.7% on the IDD Lite, 83.98% on the PASCAL VOC 2012, and 73.8% on the CamVid dataset.

Keywords: Attention mechanism, convolutional neural networks, cross-form spatial pyramid, multi-scale features, semantic segmentation

DOI: 10.3233/AIC-210266

Journal: AI Communications, vol. 35, no. 3, pp. 225-242, 2022