<story><title>Getting Started with Mistral-7b-Instruct-v0.1</title><url>https://www.secondstate.io/articles/mistral-7b-instruct-v0.1/</url></story><parent_chain></parent_chain><comment><author>udev4096</author><text>How is this different than ollama (&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;jmorganca&amp;#x2F;ollama&quot;&gt;https:&amp;#x2F;&amp;#x2F;github.com&amp;#x2F;jmorganca&amp;#x2F;ollama&lt;/a&gt;)? I would argue it&amp;#x27;s even simpler to run LLMs locally with ollama</text></comment>
<story><title>Getting Started with Mistral-7b-Instruct-v0.1</title><url>https://www.secondstate.io/articles/mistral-7b-instruct-v0.1/</url></story><parent_chain></parent_chain><comment><author>politelemon</author><text>Mistral have created a docker image which hosts their model in vllm. Vllm creates an openai like http API interface.&lt;p&gt;&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;docs.mistral.ai&amp;#x2F;quickstart&amp;#x2F;&quot; rel=&quot;nofollow noreferrer&quot;&gt;https:&amp;#x2F;&amp;#x2F;docs.mistral.ai&amp;#x2F;quickstart&amp;#x2F;&lt;/a&gt;</text></comment>