<story><title>Jailbroken AI Chatbots Can Jailbreak Other Chatbots</title><url>https://www.scientificamerican.com/article/jailbroken-ai-chatbots-can-jailbreak-other-chatbots/</url></story><parent_chain></parent_chain><comment><author>norir</author><text>The problem of preventing leaks of forbidden knowledge seems impossible without excluding the forbidden knowledge from the training data. I fail to see how that would be possible without crippling the desirable use cases. Companies need to be honest about this and stop pretending that it is a solvable problem with technical safeguards. Your child safety locks may work for a while, but eventually the child grows up and figures out how to bypass them. Also, sure, you can punish any users who ask about forbidden topics but is that really the kind of society we want to live in?</text></comment>
<story><title>Jailbroken AI Chatbots Can Jailbreak Other Chatbots</title><url>https://www.scientificamerican.com/article/jailbroken-ai-chatbots-can-jailbreak-other-chatbots/</url></story><parent_chain></parent_chain><comment><author>gmerc</author><text>Simplified: System Prompts and Finetuning are ineffective at suppressing training data, security theatre at 11.</text></comment>