How to Run a Successful Game-Based AI Competition

Julian Togelius

    Research output: Contribution to journalArticlepeer-review

    Abstract

    Game-based competitions are commonly used within the Computational Intelligence (CI) and Artificial Intelligence (AI) in games community to benchmark algorithms and to attract new researchers. While many competitions have been organized based on different games, the success of these competitions is highly varied. This short paper is a self-help paper for competition organizers and aspiring competition organizers. After analyzing the fate of a number of recent competitions, some factors likely to contribute to the success or failure of a competition are laid out, and a set of concrete recommendations is offered. There is also a discussion of how to write up game-based AI competitions and what we can ultimately learn from them.

    Original languageEnglish (US)
    Article number6937175
    Pages (from-to)95-100
    Number of pages6
    JournalIEEE Transactions on Computational Intelligence and AI in Games
    Volume8
    Issue number1
    DOIs
    StatePublished - Mar 2016

    Keywords

    • Benchmarking
    • competitions

    ASJC Scopus subject areas

    • Software
    • Control and Systems Engineering
    • Artificial Intelligence
    • Electrical and Electronic Engineering

    Fingerprint Dive into the research topics of 'How to Run a Successful Game-Based AI Competition'. Together they form a unique fingerprint.

    Cite this