Systematic n-Tuple Networks for Othello Position Evaluation

Article type: Research Article

Authors: Jaśkowski, Wojciech¹

Affiliations: Poznań, Poland

Note: [1] Institute of Computing Science, Poznan University of Technology, Poznań, Poland. email:wjaskowski@cs.put.poznan.pl

Abstract: n-tuple networks have been successfully used as position evaluation functions for board games such as Othello and Connect Four. The effectiveness of such networks depends on their architecture, which is determined by the placement of constituent n-tuples (sequences of board locations) providing input to the network. The most popular method of placing n-tuples consists of randomly generating a small number of long, snake-shaped board location sequences. In this article, we show that learning n-tuple networks is more effective if it involves a large number of systematically placed, short, straight n-tuples. In addition, we demonstrate that a straightforward variant of coevolutionary learning can evolve a systematic n-tuple network with tuples of size just 2 of a comparable performance to the best 1-ply Othello players. Our network consists of only 288 parameters, which is an order of magnitude less than the top published players to date. This indicates a need for more effective learning methods that would be capable of taking a full advantage of larger networks.

DOI: 10.3233/ICG-2014-37203

Journal: ICGA Journal, vol. 37, no. 2, pp. 85-96, 2014