How to use these models

by KSOPKOVIC - opened Oct 18, 2023

Oct 18, 2023

Is there any guidance how to use these models, eg. 2.5bit Llama?

Thank you

Owner Oct 18, 2023

You would use them with ExLlamaV2. There's also support in text-generation-webui.

KSOPKOVIC changed discussion status to closed Oct 24, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment