metadata

license: other
language:
  - en
pipeline_tag: text-generation
inference: false
tags:
  - transformers
  - gguf
  - imatrix
  - vicuna-7b-v1.5-16k

Quantizations of https://huggingface.co/lmsys/vicuna-7b-v1.5-16k

Inference Clients/UIs

From original readme

Vicuna is a chat assistant trained by fine-tuning Llama 2 on user-shared conversations collected from ShareGPT.

Developed by: LMSYS
Model type: An auto-regressive language model based on the transformer architecture
License: Llama 2 Community License Agreement
Finetuned from model: Llama 2

Model Sources

Repository: https://github.com/lm-sys/FastChat
Blog: https://lmsys.org/blog/2023-03-30-vicuna/
Paper: https://arxiv.org/abs/2306.05685
Demo: https://chat.lmsys.org/

Uses

The primary use of Vicuna is research on large language models and chatbots. The primary intended users of the model are researchers and hobbyists in natural language processing, machine learning, and artificial intelligence.

How to Get Started with the Model

Command line interface: https://github.com/lm-sys/FastChat#vicuna-weights
APIs (OpenAI API, Huggingface API): https://github.com/lm-sys/FastChat/tree/main#api