<story><title>Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools</title><url>https://github.com/SecureAI-Tools/SecureAI-Tools</url><text>Hey everyone,&lt;p&gt;We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools.&lt;p&gt;It works with locally running LLMs as well as with OpenAI-compatible APIs. For local LLMs, it supports Ollama which supports all the gguf&amp;#x2F;ggml models.&lt;p&gt;Currently, it has two features: Chat-with-LLM, and Chat-with-PDFs. It is optimized for self-hosting use cases and comes with basic user management features.&lt;p&gt;Here are some quick demos:&lt;p&gt;&lt;pre&gt;&lt;code&gt;  * Chat with documents using OpenAI&amp;#x27;s GPT3.5 model: https:&amp;#x2F;&amp;#x2F;www.youtube.com&amp;#x2F;watch?v=Br2D3G9O47s
  * Chat with documents using a locally running Mistral model (M2 MacBook): https:&amp;#x2F;&amp;#x2F;www.youtube.com&amp;#x2F;watch?v=UvRHL6f_w74
&lt;/code&gt;&lt;/pre&gt;
Hope you all like it :)</text></story><parent_chain><item><author>caseyf7</author><text>How do you get value from chatting with documents?  I can scan and read a pdf faster than I can chat with an AI about it.  There must be more to it than I realize.</text></item></parent_chain><comment><author>capableweb</author><text>&amp;gt;  There must be more to it than I realize.&lt;p&gt;PDF material comes with different information density. If you have a lose collection of 100 manuals, and you need to find a snippet of information that could be in 10 different ones, I&amp;#x27;m guessing something like this can help you navigate and locate what you need.</text></comment>
<story><title>Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools</title><url>https://github.com/SecureAI-Tools/SecureAI-Tools</url><text>Hey everyone,&lt;p&gt;We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools.&lt;p&gt;It works with locally running LLMs as well as with OpenAI-compatible APIs. For local LLMs, it supports Ollama which supports all the gguf&amp;#x2F;ggml models.&lt;p&gt;Currently, it has two features: Chat-with-LLM, and Chat-with-PDFs. It is optimized for self-hosting use cases and comes with basic user management features.&lt;p&gt;Here are some quick demos:&lt;p&gt;&lt;pre&gt;&lt;code&gt;  * Chat with documents using OpenAI&amp;#x27;s GPT3.5 model: https:&amp;#x2F;&amp;#x2F;www.youtube.com&amp;#x2F;watch?v=Br2D3G9O47s
  * Chat with documents using a locally running Mistral model (M2 MacBook): https:&amp;#x2F;&amp;#x2F;www.youtube.com&amp;#x2F;watch?v=UvRHL6f_w74
&lt;/code&gt;&lt;/pre&gt;
Hope you all like it :)</text></story><parent_chain><item><author>caseyf7</author><text>How do you get value from chatting with documents?  I can scan and read a pdf faster than I can chat with an AI about it.  There must be more to it than I realize.</text></item></parent_chain><comment><author>freedomben</author><text>a one-page PDF, sure.  But if it&amp;#x27;s a 500 page pdf of a law and&amp;#x2F;or regulation, then definitely not.</text></comment>