<story><title>Counterfactual Regret Minimisation or How I won any money in Poker?</title><url>https://rnikhil.com/2023/12/31/ai-cfr-solver-poker.html</url></story><parent_chain></parent_chain><comment><author>munchler</author><text>I used CFR to solve another card game called Setback (aka Auction Pitch), which is a trick-taking game that’s similar to, but simpler than, Bridge.&lt;p&gt;CFR is very effective, but slow and requires a lot of RAM. I had to create a smaller, abstract version of the game, solve that, and then map the result back to the actual game, so I didn’t end up with a perfect Nash equilibrium, but the solution does still play at a super-human level.&lt;p&gt;One of the interesting things about my approach is that it actually uses CFR at two separate levels: First it solves a single-deal version of the game, then it uses that solution to run CFR again on a repeated version of the game where each player accumulates points across multiple deals. (Bidding in Setback is highly score-dependent.)&lt;p&gt;I think a similar approach might be possible for Hearts, but I haven’t tried it yet. Solving Bridge with CFR may be beyond our current capability, but could also be possible in the future.&lt;p&gt;[0]: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.bernsrite.com&amp;#x2F;Setback&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.bernsrite.com&amp;#x2F;Setback&lt;/a&gt;&lt;p&gt;[1]: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;brianberns&amp;#x2F;Setback&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;brianberns&amp;#x2F;Setback&lt;/a&gt;&lt;p&gt;[2]: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;brianberns&amp;#x2F;Cfrm&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;brianberns&amp;#x2F;Cfrm&lt;/a&gt;</text></comment>
<story><title>Counterfactual Regret Minimisation or How I won any money in Poker?</title><url>https://rnikhil.com/2023/12/31/ai-cfr-solver-poker.html</url></story><parent_chain></parent_chain><comment><author>blackbear_</author><text>I&amp;#x27;m curious if one can make any money playing poker online while following some computer-optimized strategy. I assume many (most?) players are already doing this. Insights are appreciated :)</text></comment>