Word autobots: Using transformers for word association in the game codenames

Catalina M. Jaramillo, Megan Charity, Rodrigo Canaan, Julian Togelius

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Winning the social game Codenames involves combining cooperative and language understanding capabilities. We developed six cooperative bots designed to play the Codemaster and Guesser roles in the Codenames AI Competition and tested them using the provided framework and a round-robin tournament set. The bots are based on term frequency - inverse document frequency (TF-IDF), Naive-Bayes and GPT-2 Transformer word embedding. Additionally, Transformer-based bots were assessed and compared with the concatenation of word2vec and GloVe baseline bot developed by Codenames AI Competition creators. Results from this Transformer implementation rivals the concatenated bot in terms of win rates and guess precision and outperforms it in terms of minimum and average turns taken to win the game and training data load time. Additionally, in an initial evaluation performed with 10 human players, the Transformer agent performed slightly better than the baseline as Codemaster, but worse as a Guesser.

    Original languageEnglish (US)
    Title of host publicationProceedings of the 16th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2020
    EditorsLevi Lelis, David Thue
    PublisherThe AAAI Press
    Pages231-237
    Number of pages7
    ISBN (Electronic)9781577358497
    StatePublished - 2020
    Event16th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2020 - Virtual, Online
    Duration: Oct 19 2020Oct 23 2020

    Publication series

    NameProceedings of the 16th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2020

    Conference

    Conference16th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2020
    CityVirtual, Online
    Period10/19/2010/23/20

    ASJC Scopus subject areas

    • Visual Arts and Performing Arts
    • Artificial Intelligence

    Fingerprint Dive into the research topics of 'Word autobots: Using transformers for word association in the game codenames'. Together they form a unique fingerprint.

    Cite this