Affiliations: Faculty of Computer and IT Engineering, Shahrood University of Technology, Shahrood, Iran
Correspondence:
[*]
Corresponding author. Samira Hourali, Faculty of Computer and IT Engineering, Shahrood University of Technology, Shahrood, Iran. E-mail: s.hourali@shahroodut.ac.ir.
Abstract: Coreference resolution is critical for improving the performance of all text-based systems including information extraction, document summarization, machine translation, and question-answering. Most of coreference resolution solutions rely on using knowledge resources like lexical knowledge, syntactic knowledge, world knowledge and semantic knowledge. This paper presents a new knowledge-based coreference resolution model using neural network architecture. It uses XLNet embeddings as input and does not rely on any syntactic or dependency parsers. For more efficient span representation and mention detection, we used entity-level information. Mentions were extracted from the text with an unhand engineered mention detector, and the features were extracted from a deep neural network. We also propose a nonlinear multi-criteria ranking model to rank the candidate antecedents. This model simultaneously determines the total score of alternatives and the weight of the features in order to speed up the process of ranking alternatives. Compared to the state-of-the-art models, the simulation results showed significant improvements on the English CoNLL-2012 shared task (+6.4 F1). Moreover, we achieved 96.1% F1 score on the n2c2 medical dataset.
Keywords: Natural language processing, coreference resolution, knowledge management, entity level information, neural network, multi-criteria ranking model
