<story><title>Building Boba AI: Lessons learnt in building an LLM-powered application</title><url>https://martinfowler.com/articles/building-boba.html</url></story><parent_chain></parent_chain><comment><author>mvdtnz</author><text>I am so despondent at the lack of creativity in most of the (many, many) LLM powered projects that are popping up. I have seen hardly a single thing that goes beyond &amp;quot;it&amp;#x27;s a chat bot, but with a special prompt&amp;quot;. Like, is this the best we can expect from this supposedly ground-breaking technology?</text></comment>
<story><title>Building Boba AI: Lessons learnt in building an LLM-powered application</title><url>https://martinfowler.com/articles/building-boba.html</url></story><parent_chain></parent_chain><comment><author>akiselev</author><text>&lt;i&gt;&amp;gt; Along the way, we’ve learned some useful lessons on how to build these kinds of applications, which we’ve formulated in terms of patterns.&lt;/i&gt;&lt;p&gt;&lt;pre&gt;&lt;code&gt;    * Use a text template to enrich a prompt with context and structure
    * Tell the LLM to respond in a structured data format
    * Stream the response to the UI so users can monitor progress
    * Capture and add relevant context information to subsequent action
    * Allow direct conversation with the LLM within a context.
    * Tell LLM to generate intermediate results while answering
    * Provide affordances for the user to have a back-and-forth interaction with the co-pilot
    * Combine LLM with other information sources to access data beyond the LLM&amp;#x27;s training set&lt;/code&gt;&lt;/pre&gt;</text></comment>