Multimodal screening for dyslexia using anatomical and functional MRI data

Article type: Research Article

Authors: LR, Harismithaa^* | Sadasivam, G. Sudha

Affiliations: Department of Computer Science and Engineering, PSG College of Technology, Coimbatore, India

Correspondence: [*] Corresponding author: Harismithaa LR, Department of Computer Science and Engineering, PSG College of Technology, Coimbatore, India. E-mail: harismithaa24@gmail.com.

Abstract: Dyslexia is a disability in language and phonetics, with difficulties in learning and reasoning, affecting around 20% of the worldwide population. Detecting dyslexia at an early stage is vital to provide appropriate remedial teaching aid to improve the learning skills of the affected. The key objective of this study is to identify dyslexia based on Anatomical and Functional MRI data. Convolutional Neural Networks and Time Distributed Convolutional Long-Short Term Memory Neural networks are proposed for screening the neuroimaging data. A multimodal fusion technique is proposed to provide a final combined classification based on the anatomical and functional data. Experimental results demonstrate the performance of the multimodal approach over individual modes of MRI data. The result analysis shows that image segmentation has a significant contribution towards improving classifier performance.

Keywords: Convolutional neural networks, dyslexia, long-short term memory, multimodal fusion, time distributed, fMRI

DOI: 10.3233/JCM-225999

Journal: Journal of Computational Methods in Sciences and Engineering, vol. 22, no. 4, pp. 1105-1116, 2022