Post
1499
I've built a small open utility pip package called LLM-Forwarder that allows you to inject context, such as adding a private RAG, into existing chat applications by forwarding the app through the LLM-Forwarder. In the forwarder server, you can configure custom code to re-process chat messages and alter the user prompt, for example, by adding extra context.
https://pypi.org/project/llm-forwarder/
More details
https://devquasar.com/llmforwarder/
https://pypi.org/project/llm-forwarder/
More details
https://devquasar.com/llmforwarder/