Experiments in Parameter Learning Using Temporal Differences

Article type: Research Article

Authors: Baxter, J.^{; 1} | Tridgell, A.^{; 2} | Weaver, L^{; 2}

Affiliations: Canberra, Australia

Note: [1] Department of Systems Engineering, Australian National University, Canberra 0200, Australia. Email: Jon.Baxter@anu.edu.au

Note: [2] Department of Computer Science, Australian National University, Canberra 0200, Australia. Email: Andrew.Tridgell, Lex.Weaver@anu.edu.au.

Abstract: This paper deals with the problem of automatically learning evaluation-function parameters. In particular, we describe some experiments in which our chess program KNIGHTCAP learnt the parameters of its evaluation function using a combination of temporal difference learning and on-line play on FICS (Free Internet Chess Server) and ICC (Internet Chess Club). The main success reported is that KNIGHTCAP went from a blitz rating of 1650 to a blitz rating of 2150 in just three days and 308 games. We provide details of our learning algorithm, details of KNIGHTCAP, and some reasons for KNIGHTCAP’S rapid improvement in playing strength.

DOI: 10.3233/ICG-1998-21203

Journal: ICGA Journal, vol. 21, no. 2, pp. 84-99, 1998