The Mario Ai benchmark and competitions

Sergey Karakovskiy, Julian Togelius

    Research output: Contribution to journalArticlepeer-review


    This paper describes the Mario AI benchmark, a game-based benchmark for reinforcement learning algorithms and game AI techniques developed by the authors. The benchmark is based on a public domain clone of Nintendo's classic platform game Super Mario Bros, and completely open source. During the last two years, the benchmark has been used in a number of competitions associated with international conferences, and researchers and students from around the world have contributed diverse solutions to try to beat the benchmark. The paper summarizes these contributions, gives an overview of the state of the art in Mario-playing AIs, and chronicles the development of the benchmark. This paper is intended as the definitive point of reference for those using the benchmark for research or teaching.

    Original languageEnglish (US)
    Article number6156425
    Pages (from-to)55-67
    Number of pages13
    JournalIEEE Transactions on Computational Intelligence and AI in Games
    Issue number1
    StatePublished - Mar 2012


    • Benchmarking
    • competitions
    • game AI
    • reinforcement learning

    ASJC Scopus subject areas

    • Software
    • Control and Systems Engineering
    • Artificial Intelligence
    • Electrical and Electronic Engineering


    Dive into the research topics of 'The Mario Ai benchmark and competitions'. Together they form a unique fingerprint.

    Cite this