Approaches

Q-learning and value learning

Learn from past games how much each column is worth, so the player can rank moves without searching ahead.

Read the primer →

Q-learning and value learningfeatured

Denoised public value

Instead of asking one future what a board was worth, simulate 32 futures from it and average them.

completedrecorded

Q-learning and value learningfeatured

Klein-Friedmann linear Q-learning

Score each column with six hand-made numbers about what the drop does right now, learn the six weights from experience, and find out how much of Drop7 that can see.

completedreproduced

Q-learning and value learning

Double-DQN and continuation

Use textbook reinforcement learning to score each column from experience, reward survival, and add a short look-ahead.

completed

Q-learning and value learning

One-ply Q as a pruning prior and a refit leaf

Fit a linear action value to the depth-4 search's own sibling values, then use it not to play but to decide which siblings the search may skip, and separately refit the leaf to the search's own value.

completedreproduced