<story><title>ChatGPT vs. a Cryptic Crossword</title><url>https://jameswillia.ms/posts/chatgpt-cryptics.html</url></story><parent_chain><item><author>JacobiX</author><text>The problem with many of the tasks that people are trying is: the answers are already available on the internet for those very popular crosswords. For example a quick search for &amp;quot;1 Chap recalled skill: something frequently repeated (6)&amp;quot; returns hundreds of correct answers. It’s highly probable that it has already encountered the questions and answers for this crosswords in the training phase.</text></item></parent_chain><comment><author>ehsankia</author><text>I don&amp;#x27;t think that&amp;#x27;s always true. I do a lot of puzzle hunt, and I&amp;#x27;ve been using GPT-3 for cryptics in the past week, and I&amp;#x27;d say it gets it right around 20% of the time, which isn&amp;#x27;t horrible but still impressive, and these are brand new cryptics that are definitely not found online. And the ones it gets wrong show that it partly understands the mechanics of cryptics.&lt;p&gt;&lt;pre&gt;&lt;code&gt;    Solve these cryptic clues:

    Wash part of Uncle Andrew (5)
    Pain, hype, breaking down: a revelation (8)
    Bad Romano is reddish-brown (6)
    Eternally the Raven’s headless refrain (8)
    Boxer Joe switched from Fahrenheit to Celsius to get more absurd (7)
    Mill traps rock and roll heads, flipping bro, and first aid to get disco item (10)
    Prestigious institution’s climbing plant (3)
    Fin? Feet? Strange first tennis point (7)
    Jordan? He destroyed a breakup letter (4 4)
    Maine is yours truly (2)

    ANSWERS: 

    ANDREW, EPIPHANY, BRUNET, NEVERMORE, ABSURDER, DISCO BALL, IVY, FORFEIT, DEVOURED IT, ME
&lt;/code&gt;&lt;/pre&gt;
The real answers are:&lt;p&gt;CLEAN, EPIPHANY, MAROON, EVERMORE, CRAZIER, MIRROR BALL, IVY, FIFTEEN, DEAR JOHN, ME&lt;p&gt;So got 3, and pretty close for 2-3 others.</text></comment>
<story><title>ChatGPT vs. a Cryptic Crossword</title><url>https://jameswillia.ms/posts/chatgpt-cryptics.html</url></story><parent_chain><item><author>JacobiX</author><text>The problem with many of the tasks that people are trying is: the answers are already available on the internet for those very popular crosswords. For example a quick search for &amp;quot;1 Chap recalled skill: something frequently repeated (6)&amp;quot; returns hundreds of correct answers. It’s highly probable that it has already encountered the questions and answers for this crosswords in the training phase.</text></item></parent_chain><comment><author>riffraff</author><text>fun fact: a common riddle for toddlers in Italy is &amp;quot;what color was garibaldi&amp;#x27;s white horse?&amp;quot;.&lt;p&gt;This has hundreds of thousands of results in Google, but of course nobody bothers to actually give an answer, so ChatGPT does not know how to answer.</text></comment>