Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

Christoph Salge; Claus Aranha; Adrian Brightmoore; Sean Butler; Rodrigo De Moura Canaan; Michael Cook; Michael Green; Hagen Fischer; Christian Guckelsberger; Jupiter Hadley; Jean Baptiste Herve; Mark Johnson; Quinn Kybartas; David Mason; Mike Preuss; Tristan Smith; Ruck Thawonmas; Julian Togelius

doi:10.1145/3555858.3555940

Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

Christoph Salge, Claus Aranha, Adrian Brightmoore, Sean Butler, Rodrigo De Moura Canaan, Michael Cook, Michael Green, Hagen Fischer, Christian Guckelsberger, Jupiter Hadley, Jean Baptiste Herve, Mark Johnson, Quinn Kybartas, David Mason, Mike Preuss, Tristan Smith, Ruck Thawonmas, Julian Togelius

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics - all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.

Original language	English (US)
Title of host publication	Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG 2022
Editors	Kostas Karpouzis, Stefano Gualeni, Allan Fowler
Publisher	Association for Computing Machinery
ISBN (Electronic)	9781450397957
DOIs	https://doi.org/10.1145/3555858.3555940
State	Published - Sep 5 2022
Event	17th International Conference on the Foundations of Digital Games, FDG 2022 - Athens, Greece Duration: Sep 5 2022 → Sep 8 2022

Publication series

Name	ACM International Conference Proceeding Series

Conference

Conference	17th International Conference on the Foundations of Digital Games, FDG 2022
Country/Territory	Greece
City	Athens
Period	9/5/22 → 9/8/22

Keywords

Artificial Intelligence
Competition
Computational Creativity
Experience Survey
Minecraft
Procedural Content Generation

ASJC Scopus subject areas

Software
Human-Computer Interaction
Computer Vision and Pattern Recognition
Computer Networks and Communications

Access to Document

10.1145/3555858.3555940

Cite this

Salge, C., Aranha, C., Brightmoore, A., Butler, S., De Moura Canaan, R., Cook, M., Green, M., Fischer, H., Guckelsberger, C., Hadley, J., Herve, J. B., Johnson, M., Kybartas, Q., Mason, D., Preuss, M., Smith, T., Thawonmas, R., & Togelius, J. (2022). Impressions of the GDMC AI Settlement Generation Challenge in Minecraft. In K. Karpouzis, S. Gualeni, & A. Fowler (Eds.), Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG 2022 Article 45 (ACM International Conference Proceeding Series). Association for Computing Machinery. https://doi.org/10.1145/3555858.3555940

Impressions of the GDMC AI Settlement Generation Challenge in Minecraft. / Salge, Christoph; Aranha, Claus; Brightmoore, Adrian et al.
Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG 2022. ed. / Kostas Karpouzis; Stefano Gualeni; Allan Fowler. Association for Computing Machinery, 2022. 45 (ACM International Conference Proceeding Series).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Salge, C, Aranha, C, Brightmoore, A, Butler, S, De Moura Canaan, R, Cook, M, Green, M, Fischer, H, Guckelsberger, C, Hadley, J, Herve, JB, Johnson, M, Kybartas, Q, Mason, D, Preuss, M, Smith, T, Thawonmas, R & Togelius, J 2022, Impressions of the GDMC AI Settlement Generation Challenge in Minecraft. in K Karpouzis, S Gualeni & A Fowler (eds), Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG 2022., 45, ACM International Conference Proceeding Series, Association for Computing Machinery, 17th International Conference on the Foundations of Digital Games, FDG 2022, Athens, Greece, 9/5/22. https://doi.org/10.1145/3555858.3555940

Salge C, Aranha C, Brightmoore A, Butler S, De Moura Canaan R, Cook M et al. Impressions of the GDMC AI Settlement Generation Challenge in Minecraft. In Karpouzis K, Gualeni S, Fowler A, editors, Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG 2022. Association for Computing Machinery. 2022. 45. (ACM International Conference Proceeding Series). doi: 10.1145/3555858.3555940

Salge, Christoph ; Aranha, Claus ; Brightmoore, Adrian et al. / Impressions of the GDMC AI Settlement Generation Challenge in Minecraft. Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG 2022. editor / Kostas Karpouzis ; Stefano Gualeni ; Allan Fowler. Association for Computing Machinery, 2022. (ACM International Conference Proceeding Series).

@inproceedings{d08f059114aa47e98b9bbe4f8e982093,

title = "Impressions of the GDMC AI Settlement Generation Challenge in Minecraft",

abstract = "The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics - all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.",

keywords = "Artificial Intelligence, Competition, Computational Creativity, Experience Survey, Minecraft, Procedural Content Generation",

author = "Christoph Salge and Claus Aranha and Adrian Brightmoore and Sean Butler and {De Moura Canaan}, Rodrigo and Michael Cook and Michael Green and Hagen Fischer and Christian Guckelsberger and Jupiter Hadley and Herve, {Jean Baptiste} and Mark Johnson and Quinn Kybartas and David Mason and Mike Preuss and Tristan Smith and Ruck Thawonmas and Julian Togelius",

note = "Publisher Copyright: {\textcopyright} 2022 ACM.; 17th International Conference on the Foundations of Digital Games, FDG 2022 ; Conference date: 05-09-2022 Through 08-09-2022",

year = "2022",

month = sep,

day = "5",

doi = "10.1145/3555858.3555940",

language = "English (US)",

series = "ACM International Conference Proceeding Series",

publisher = "Association for Computing Machinery",

editor = "Kostas Karpouzis and Stefano Gualeni and Allan Fowler",

booktitle = "Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG 2022",

}

TY - GEN

T1 - Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

AU - Salge, Christoph

AU - Aranha, Claus

AU - Brightmoore, Adrian

AU - Butler, Sean

AU - De Moura Canaan, Rodrigo

AU - Cook, Michael

AU - Green, Michael

AU - Fischer, Hagen

AU - Guckelsberger, Christian

AU - Hadley, Jupiter

AU - Herve, Jean Baptiste

AU - Johnson, Mark

AU - Kybartas, Quinn

AU - Mason, David

AU - Preuss, Mike

AU - Smith, Tristan

AU - Thawonmas, Ruck

AU - Togelius, Julian

PY - 2022/9/5

Y1 - 2022/9/5

N2 - The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics - all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.

AB - The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics - all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.

KW - Artificial Intelligence

KW - Competition

KW - Computational Creativity

KW - Experience Survey

KW - Minecraft

KW - Procedural Content Generation

UR - http://www.scopus.com/inward/record.url?scp=85142386197&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85142386197&partnerID=8YFLogxK

U2 - 10.1145/3555858.3555940

DO - 10.1145/3555858.3555940

M3 - Conference contribution

AN - SCOPUS:85142386197

T3 - ACM International Conference Proceeding Series

BT - Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG 2022

A2 - Karpouzis, Kostas

A2 - Gualeni, Stefano

A2 - Fowler, Allan

PB - Association for Computing Machinery

T2 - 17th International Conference on the Foundations of Digital Games, FDG 2022

Y2 - 5 September 2022 through 8 September 2022

ER -

Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this