filipealmeida
commited on
Commit
•
78a654a
1
Parent(s):
323baf3
Update README.md
Browse files
README.md
CHANGED
@@ -11,9 +11,15 @@ inference: false
|
|
11 |
|
12 |
# MPT-7B-Instruct
|
13 |
|
|
|
|
|
14 |
This is the GGUF version of MPT-7B-Instruct based on [jploski's fork of llama.cpp](https://github.com/jploski/llama.cpp)
|
15 |
|
16 |
-
Right now it only works with that branch, but hopefully this will be integrated with the official [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
|
|
|
|
|
|
|
|
17 |
|
18 |
MPT-7B-Instruct is a model for short-form instruction following.
|
19 |
It is built by finetuning [MPT-7B](https://huggingface.co/mosaicml/mpt-7b) on a [dataset](https://huggingface.co/datasets/sam-mosaic/dolly_hhrlhf) derived from the [Databricks Dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k) and the [Anthropic Helpful and Harmless (HH-RLHF)](https://huggingface.co/datasets/Anthropic/hh-rlhf) datasets.
|
|
|
11 |
|
12 |
# MPT-7B-Instruct
|
13 |
|
14 |
+
<span style="color:red">This is not working yet with the official version of llama.cpp</span>
|
15 |
+
|
16 |
This is the GGUF version of MPT-7B-Instruct based on [jploski's fork of llama.cpp](https://github.com/jploski/llama.cpp)
|
17 |
|
18 |
+
Right now it only works with that branch, but hopefully, this will be integrated with the official [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
19 |
+
|
20 |
+
I needed this for some prototyping so I'll also maintain a fork of the python bindings while this isn't all merged in here: [llama-cpp-python-mpt](https://github.com/filipe-m-almeida/llama-cpp-python-mpt)
|
21 |
+
|
22 |
+
-----
|
23 |
|
24 |
MPT-7B-Instruct is a model for short-form instruction following.
|
25 |
It is built by finetuning [MPT-7B](https://huggingface.co/mosaicml/mpt-7b) on a [dataset](https://huggingface.co/datasets/sam-mosaic/dolly_hhrlhf) derived from the [Databricks Dolly-15k](https://huggingface.co/datasets/databricks/databricks-dolly-15k) and the [Anthropic Helpful and Harmless (HH-RLHF)](https://huggingface.co/datasets/Anthropic/hh-rlhf) datasets.
|