🚅 LiteLLM
Ollama
GPT4All
Arthur
Chat Over Documents with Vectara
TextGen
Llama.cpp
Titan Takeoff
Eden AI
C Transformers
Huggingface TextGen Inference
Replicate
Run LLMs locally
Set env var OPENAI_API_KEY or load from a .env file
Use local LLMs
WebResearchRetriever