GGUF
Composer
MosaicML
llm-foundry
filipealmeida commited on
Commit
78a654a
1 Parent(s): 323baf3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -11,9 +11,15 @@ inference: false
11
 
12
  # MPT-7B-Instruct
13
 
 
 
14
  This is the GGUF version of MPT-7B-Instruct based on [jploski's fork of llama.cpp](https://github.com/jploski/llama.cpp)
15
 
16
- Right now it only works with that branch, but hopefully this will be integrated with the official [llama.cpp](https://github.com/ggerganov/llama.cpp)
 
 
 
 
17
 
18
  MPT-7B-Instruct is a model for short-form instruction following.
19
  It is built by finetuning [MPT-7B](https://huggingface.co/mosaicml/mpt-7b) on a [dataset](https://huggingface.co/datasets/sam-mosaic/dolly_hhrlhf) derived from the [Databricks Dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k) and the [Anthropic Helpful and Harmless (HH-RLHF)](https://huggingface.co/datasets/Anthropic/hh-rlhf) datasets.
 
11
 
12
  # MPT-7B-Instruct
13
 
14
+ <span style="color:red">This is not working yet with the official version of llama.cpp</span>
15
+
16
  This is the GGUF version of MPT-7B-Instruct based on [jploski's fork of llama.cpp](https://github.com/jploski/llama.cpp)
17
 
18
+ Right now it only works with that branch, but hopefully, this will be integrated with the official [llama.cpp](https://github.com/ggerganov/llama.cpp)
19
+
20
+ I needed this for some prototyping so I'll also maintain a fork of the python bindings while this isn't all merged in here: [llama-cpp-python-mpt](https://github.com/filipe-m-almeida/llama-cpp-python-mpt)
21
+
22
+ -----
23
 
24
  MPT-7B-Instruct is a model for short-form instruction following.
25
  It is built by finetuning [MPT-7B](https://huggingface.co/mosaicml/mpt-7b) on a [dataset](https://huggingface.co/datasets/sam-mosaic/dolly_hhrlhf) derived from the [Databricks Dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k) and the [Anthropic Helpful and Harmless (HH-RLHF)](https://huggingface.co/datasets/Anthropic/hh-rlhf) datasets.