Temporal link prediction in directed networks based on self-attention mechanism

Article type: Research Article

Authors: Li, Jinsong^* | Peng, Jianhua | Liu, Shuxin | Weng, Lintianran | Li, Cong

Affiliations: PLA Strategic Support Force Information Engineering University, Beijing, China

Correspondence: [*] Corresponding author: Jinsong Li, PLA Strategic Support Force Information Engineering University, Beijing, China. E-mail: lijinsong33@126.com.

Abstract: The development of graph neural networks (GCN) makes it possible to learn structural features from evolving complex networks. Even though a wide range of realistic networks are directed ones, few existing works investigated the properties of directed and temporal networks. In this paper, we address the problem of temporal link prediction in directed networks and propose a deep learning model based on GCN and self-attention mechanism, namely TSAM. The proposed model adopts an autoencoder architecture, which utilizes graph attentional layers to capture the structural feature of neighborhood nodes, as well as a set of graph convolutional layers to capture motif features. A graph recurrent unit layer with self-attention is utilized to learn temporal variations in the snapshot sequence. We run comparative experiments on four realistic networks to validate the effectiveness of TSAM. Experimental results show that TSAM outperforms most benchmarks under two evaluation metrics.

Keywords: Directed network, temporal link prediction, graph neural network, autoencoder, self-attention mechanism

DOI: 10.3233/IDA-205524

Journal: Intelligent Data Analysis, vol. 26, no. 1, pp. 173-188, 2022