vicuna-v1.5-demo / docs /Windows-installation-guide.md
do-dong-park's picture
Upload folder using huggingface_hub
5ed9e85

A newer version of the Gradio SDK is available: 5.6.0

Upgrade

If you are having trouble following the installation instructions in the README, Reddit user Technical_Leather949 has created a more detailed, step-by-step guide covering:

  • Windows installation
  • 8-bit mode on Windows
  • LLaMA
  • LLaMA 4-bit

The guide can be found here: https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_install_llama_8bit_and_4bit/