Affiliations: [a] School of Electronics Engineering and Computer Science, Peking University, Beijing, China | [b] School of Software and Microelectronics, Peking University, Beijing, China | [c] The College of Information Engineering, Xiangtan University, Xiangtan, Hunan, China | [d] National Engineering Research Center for Software Engineering, Peking University, Beijing, China
Correspondence:
[*]
Corresponding author: Junfei Liu, National Engineering Research Center for Software Engineering, Peking University, Beijing 100871, China. Tel.: +86 13901056728; E-mail: xxjh@pku.edu.cn.
Abstract: Knowledge bases (KBs) provide a large amount of structured information for entities and relations, which are successfully leveraged in many natural language processing tasks. However, distantly supervised relation extraction only utilizes KBs to automatically generate datasets, while ignoring the background information in KBs during the relation extraction process. We herein propose a knowledge-embodied attention that leverages knowledge information in KBs to reduce the impact of noisy data for distantly supervised relation extraction. Specifically, we pre-train distributed representations of KBs with the knowledge representation learning (KRL) model, and subsequently incorporate them into relation extraction to learn sentence-level attention weights. The experimental results demonstrate that our approach outperforms all baselines, thus indicating that we can focus our attention on valid data by leveraging background information in KBs.
