Assessing believability

Julian Togelius, Georgios N. Yannakakis, Sergey Karakovskiy, Noor Shaker

    Research output: Chapter in Book/Report/Conference proceedingChapter


    We discuss what it means for a non-player character (NPC) to be believable or human-like, and how we can accurately assess believability. We argue that participatory observation, where the human assessing believability takes part in the game, is prone to distortion effects. For many games, a fairer (or at least complementary) assessment might be made by an external observer that does not participate in the game, through comparing and ranking the performance of human and non-human agents playing a game. This assessment philosophy was embodied in the Turing Test track of the recent Mario AI Championship, where non-expert bystanders evaluated the human-likeness of several agents and humans playing a version of Super Mario Bros. We analyze the results of this competition. Finally, we discuss the possibilities for forming models of believability and of maximizing believability through adjusting game content rather than NPC control logic.

    Original languageEnglish (US)
    Title of host publicationBelievable Bots
    Subtitle of host publicationCan Computers Play Like People?
    PublisherSpringer-Verlag Berlin Heidelberg
    Number of pages16
    ISBN (Electronic)9783642323232
    ISBN (Print)3642323227, 9783642323225
    StatePublished - Oct 1 2012

    ASJC Scopus subject areas

    • General Computer Science

    Cite this