The 1st ChatGPT4PCG Competition

Febri Abdullah, Pittawat Taveekitworachai, Mury F. Dewantoro, Ruck Thawonmas, Julian Togelius, Jochen Renz

    Research output: Contribution to journalArticlepeer-review

    Abstract

    This study summarizes the first ChatGPT4PCG competition held at the 2023 IEEE Conference on Games. The goal of the competition is to explore emergent abilities of publicly available LLMs in performing complex tasks related to procedural content generation, specifically physics-based level generation for Angry Bird-like games. Participants are tasked with submitting their prompts for ChatGPT to generate Angry Birds-like game structures that resemble English uppercase characters. A structure is a collection of stacked game objects comprising a part of an entire Angry Birds-like level. A prompt is an input for large language models (LLMs) including ChatGPT. Two evaluation metrics, i.e., stability and similarity, are used to evaluate the submitted prompts. Stability measures the sturdiness of a structure to withstand in-game gravity, while similarity measures a structure's resemblance to the target character. With such evaluation, participants are challenged not only to produce character-like but also stable structures by utilizing prompt engineering techniques. Finally, the competition's results are discussed to provide valuable insights for future studies and competitions.

    Original languageEnglish (US)
    Pages (from-to)1-17
    Number of pages17
    JournalIEEE Transactions on Games
    DOIs
    StateAccepted/In press - 2024

    Keywords

    • Angry Birds
    • Artificial intelligence
    • Birds
    • Chatbots
    • ChatGPT
    • Codes
    • Games
    • LLMs
    • Measurement
    • PCG
    • Task analysis

    ASJC Scopus subject areas

    • Software
    • Control and Systems Engineering
    • Artificial Intelligence
    • Electrical and Electronic Engineering

    Fingerprint

    Dive into the research topics of 'The 1st ChatGPT4PCG Competition'. Together they form a unique fingerprint.

    Cite this