Increasing generality in machine learning through procedural content generation

Sebastian Risi, Julian Togelius

    Research output: Contribution to journalReview articlepeer-review

    Abstract

    Procedural content generation (PCG) refers to the practice of generating game content, such as levels, quests or characters, algorithmically. Motivated by the need to make games replayable, as well as to reduce authoring burden and enable particular aesthetics, many PCG methods have been devised. At the same time that researchers are adapting methods from machine learning (ML) to PCG problems, the ML community has become more interested in PCG-inspired methods. One reason for this development is that ML algorithms often only work for a particular version of a particular task with particular initial parameters. In response, researchers have begun exploring randomization of problem parameters to counteract such overfitting and to allow trained policies to more easily transfer from one environment to another, such as from a simulated robot to a robot in the real world. Here we review existing work on PCG, its overlap with current efforts in ML, and promising new research directions such as procedurally generated learning environments. Although originating in games, we believe PCG algorithms are critical to creating more general machine intelligence.

    Original languageEnglish (US)
    Pages (from-to)428-436
    Number of pages9
    JournalNature Machine Intelligence
    Volume2
    Issue number8
    DOIs
    StatePublished - Aug 1 2020

    ASJC Scopus subject areas

    • Software
    • Human-Computer Interaction
    • Computer Vision and Pattern Recognition
    • Computer Networks and Communications
    • Artificial Intelligence

    Fingerprint Dive into the research topics of 'Increasing generality in machine learning through procedural content generation'. Together they form a unique fingerprint.

    Cite this