Can Transformers Learn to Strategize?

TicTacGPT for playing simple board games

Photo by Jon Tyson on Unsplash

Although most board games appeal to the use of convolutional neural nets or other geometrically inspired architectures, the fact that we can actually represent board states as strings begs the question of whether transformers can naturally be applied to the game. Here, we’ll see if we can answer this in the context of a simple game…