TY - GEN
T1 - Point-to-point car racing
T2 - 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007
AU - Lucas, Simon M.
AU - Togelius, Julian
N1 - Copyright:
Copyright 2008 Elsevier B.V., All rights reserved.
PY - 2007
Y1 - 2007
N2 - This paper considers variations on an extremely simple form of car racing, the challenge being to visit as many way-points as possible in a fixed amount of time. The simplicity of the models enables a very thorough evaluation of various learning algorithms and control architectures, and enables other researchers to work on the same models with relative ease. The models are used to compare the performance of various hand-programmed controllers, and neural networks trained using evolution, and using temporal difference learning. Comparisons are also made between state-based and action-based controller architectures. The best controllers were obtained using evolution to learn the weights of state-evaluation neural networks, and these were greatly superior to human drivers.
AB - This paper considers variations on an extremely simple form of car racing, the challenge being to visit as many way-points as possible in a fixed amount of time. The simplicity of the models enables a very thorough evaluation of various learning algorithms and control architectures, and enables other researchers to work on the same models with relative ease. The models are used to compare the performance of various hand-programmed controllers, and neural networks trained using evolution, and using temporal difference learning. Comparisons are also made between state-based and action-based controller architectures. The best controllers were obtained using evolution to learn the weights of state-evaluation neural networks, and these were greatly superior to human drivers.
KW - Car racing
KW - Evolving neural networks
KW - Reinforcement learning
UR - http://www.scopus.com/inward/record.url?scp=34548765403&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34548765403&partnerID=8YFLogxK
U2 - 10.1109/CIG.2007.368107
DO - 10.1109/CIG.2007.368107
M3 - Conference contribution
AN - SCOPUS:34548765403
SN - 1424407095
SN - 9781424407095
T3 - Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007
SP - 260
EP - 267
BT - Proceedings of the 2007 IEEE Symposium on Computational Intelligence and Games, CIG 2007
Y2 - 1 April 2007 through 5 April 2007
ER -