Generating Novice Heuristics for Post-Flop Poker

Fernando De Mesentier Silva; Julian Togelius; Frank Lantz; Andy Nealen

doi:10.1109/CIG.2018.8490415

Generating Novice Heuristics for Post-Flop Poker

Fernando De Mesentier Silva, Julian Togelius, Frank Lantz, Andy Nealen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Agents now exist that can play Texas Hold'em Poker at a very high level, and simplified versions of the game have been solved. However, this does not directly translate to learning heuristics humans can use to play the game. We address the problem of learning chains of human-learnable heuristics for playing heads-up limit Texas Hold'em, focusing on the post-flop stages of the game. By restricting the policy space to fast and frugal trees, which are sequences of if-then-else rules, we can learn such heuristics using several methods including genetic programming. This work builds on our previous work on learning such heuristic rule set for Blackjack and pre-flop Texas Hold'em, but introduces a richer language for heuristics.

Original language	English (US)
Title of host publication	Proceedings of the 2018 IEEE Conference on Computational Intelligence and Games, CIG 2018
Publisher	IEEE Computer Society
ISBN (Electronic)	9781538643594
DOIs	https://doi.org/10.1109/CIG.2018.8490415
State	Published - Oct 11 2018
Event	14th IEEE Conference on Computational Intelligence and Games, CIG 2018 - Maastricht, Netherlands Duration: Aug 14 2018 → Aug 17 2018

Publication series

Name	IEEE Conference on Computatonal Intelligence and Games, CIG
Volume	2018-August
ISSN (Print)	2325-4270
ISSN (Electronic)	2325-4289

Other

Other	14th IEEE Conference on Computational Intelligence and Games, CIG 2018
Country/Territory	Netherlands
City	Maastricht
Period	8/14/18 → 8/17/18

Keywords

Beginner heuristics
Genetic algorithms
Poker

ASJC Scopus subject areas

Artificial Intelligence
Computer Graphics and Computer-Aided Design
Computer Vision and Pattern Recognition
Human-Computer Interaction
Software

Access to Document

10.1109/CIG.2018.8490415

Cite this

De Mesentier Silva, F., Togelius, J., Lantz, F., & Nealen, A. (2018). Generating Novice Heuristics for Post-Flop Poker. In Proceedings of the 2018 IEEE Conference on Computational Intelligence and Games, CIG 2018 Article 8490415 (IEEE Conference on Computatonal Intelligence and Games, CIG; Vol. 2018-August). IEEE Computer Society. https://doi.org/10.1109/CIG.2018.8490415

Generating Novice Heuristics for Post-Flop Poker. / De Mesentier Silva, Fernando; Togelius, Julian; Lantz, Frank et al.
Proceedings of the 2018 IEEE Conference on Computational Intelligence and Games, CIG 2018. IEEE Computer Society, 2018. 8490415 (IEEE Conference on Computatonal Intelligence and Games, CIG; Vol. 2018-August).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

De Mesentier Silva, F, Togelius, J, Lantz, F & Nealen, A 2018, Generating Novice Heuristics for Post-Flop Poker. in Proceedings of the 2018 IEEE Conference on Computational Intelligence and Games, CIG 2018., 8490415, IEEE Conference on Computatonal Intelligence and Games, CIG, vol. 2018-August, IEEE Computer Society, 14th IEEE Conference on Computational Intelligence and Games, CIG 2018, Maastricht, Netherlands, 8/14/18. https://doi.org/10.1109/CIG.2018.8490415

@inproceedings{6125489d84dc4e4fb3383152cc47709f,

title = "Generating Novice Heuristics for Post-Flop Poker",

abstract = "Agents now exist that can play Texas Hold'em Poker at a very high level, and simplified versions of the game have been solved. However, this does not directly translate to learning heuristics humans can use to play the game. We address the problem of learning chains of human-learnable heuristics for playing heads-up limit Texas Hold'em, focusing on the post-flop stages of the game. By restricting the policy space to fast and frugal trees, which are sequences of if-then-else rules, we can learn such heuristics using several methods including genetic programming. This work builds on our previous work on learning such heuristic rule set for Blackjack and pre-flop Texas Hold'em, but introduces a richer language for heuristics.",

keywords = "Beginner heuristics, Genetic algorithms, Poker",

author = "{De Mesentier Silva}, Fernando and Julian Togelius and Frank Lantz and Andy Nealen",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 14th IEEE Conference on Computational Intelligence and Games, CIG 2018 ; Conference date: 14-08-2018 Through 17-08-2018",

year = "2018",

month = oct,

day = "11",

doi = "10.1109/CIG.2018.8490415",

language = "English (US)",

series = "IEEE Conference on Computatonal Intelligence and Games, CIG",

publisher = "IEEE Computer Society",

booktitle = "Proceedings of the 2018 IEEE Conference on Computational Intelligence and Games, CIG 2018",

}

TY - GEN

T1 - Generating Novice Heuristics for Post-Flop Poker

AU - De Mesentier Silva, Fernando

AU - Togelius, Julian

AU - Lantz, Frank

AU - Nealen, Andy

PY - 2018/10/11

Y1 - 2018/10/11

N2 - Agents now exist that can play Texas Hold'em Poker at a very high level, and simplified versions of the game have been solved. However, this does not directly translate to learning heuristics humans can use to play the game. We address the problem of learning chains of human-learnable heuristics for playing heads-up limit Texas Hold'em, focusing on the post-flop stages of the game. By restricting the policy space to fast and frugal trees, which are sequences of if-then-else rules, we can learn such heuristics using several methods including genetic programming. This work builds on our previous work on learning such heuristic rule set for Blackjack and pre-flop Texas Hold'em, but introduces a richer language for heuristics.

AB - Agents now exist that can play Texas Hold'em Poker at a very high level, and simplified versions of the game have been solved. However, this does not directly translate to learning heuristics humans can use to play the game. We address the problem of learning chains of human-learnable heuristics for playing heads-up limit Texas Hold'em, focusing on the post-flop stages of the game. By restricting the policy space to fast and frugal trees, which are sequences of if-then-else rules, we can learn such heuristics using several methods including genetic programming. This work builds on our previous work on learning such heuristic rule set for Blackjack and pre-flop Texas Hold'em, but introduces a richer language for heuristics.

KW - Beginner heuristics

KW - Genetic algorithms

KW - Poker

UR - http://www.scopus.com/inward/record.url?scp=85055531746&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055531746&partnerID=8YFLogxK

U2 - 10.1109/CIG.2018.8490415

DO - 10.1109/CIG.2018.8490415

M3 - Conference contribution

AN - SCOPUS:85055531746

T3 - IEEE Conference on Computatonal Intelligence and Games, CIG

BT - Proceedings of the 2018 IEEE Conference on Computational Intelligence and Games, CIG 2018

PB - IEEE Computer Society

T2 - 14th IEEE Conference on Computational Intelligence and Games, CIG 2018

Y2 - 14 August 2018 through 17 August 2018

ER -

Generating Novice Heuristics for Post-Flop Poker

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this