RonanMcGovern
commited on
Commit
•
213ec81
1
Parent(s):
72a17ab
Update README.md
Browse files
README.md
CHANGED
@@ -12,9 +12,14 @@ tags:
|
|
12 |
- functions
|
13 |
- function calling
|
14 |
---
|
15 |
-
# fLlama 2 - Function Calling Llama 2
|
16 |
|
17 |
-
fLlama 2 extends the hugging face Llama 2
|
|
|
|
|
|
|
|
|
|
|
18 |
|
19 |
## Licensing and Usage
|
20 |
|
@@ -48,22 +53,13 @@ The dataset used for training this model can be found at [Trelis Function Callin
|
|
48 |
|
49 |
The data may be used for free for commercial and non-commercial use. It is Apache 2 licensed and does not have any dependencies (i.e. does not depend on Meta's Llama license.)
|
50 |
|
51 |
-
## Inference with HuggingFace 🤗
|
52 |
-
|
53 |
-
Ensure you have the `transformers` package installed:
|
54 |
|
55 |
-
|
56 |
-
pip install transformers
|
57 |
-
```
|
58 |
|
59 |
-
|
60 |
|
61 |
-
|
62 |
-
from transformers import AutoModelForCausalLM, AutoTokenizer
|
63 |
-
|
64 |
-
tokenizer = AutoTokenizer.from_pretrained("Trelis/Llama-2-7b-chat-hf-function-calling")
|
65 |
-
model = AutoModelForCausalLM.from_pretrained("Trelis/Llama-2-7b-chat-hf-function-calling")
|
66 |
-
```
|
67 |
|
68 |
To make a function call, you should format your input like this:
|
69 |
|
|
|
12 |
- functions
|
13 |
- function calling
|
14 |
---
|
15 |
+
# fLlama 2 - Function Calling Llama 2
|
16 |
|
17 |
+
- fLlama 2 extends the hugging face Llama 2 models with function calling capabilities.
|
18 |
+
- The model responds with a structured json argument with the function name and arguments
|
19 |
+
|
20 |
+
Available models:
|
21 |
+
- fLlama-7B (this repo)
|
22 |
+
- [fLlama-13](https://huggingface.co/Trelis/Llama-2-13b-chat-hf-function-calling) - RECOMMENDED. This is a stronger model and handles function calling more accurately.
|
23 |
|
24 |
## Licensing and Usage
|
25 |
|
|
|
53 |
|
54 |
The data may be used for free for commercial and non-commercial use. It is Apache 2 licensed and does not have any dependencies (i.e. does not depend on Meta's Llama license.)
|
55 |
|
56 |
+
## Inference with Google Colab and HuggingFace 🤗
|
|
|
|
|
57 |
|
58 |
+
Get started by saving your own copy of this [fLlama_Inference notebook](https://colab.research.google.com/drive/1Ow5cQ0JNv-vXsT-apCceH6Na3b4L7JyW?usp=sharing).
|
|
|
|
|
59 |
|
60 |
+
You will be able to run inference using a free Colab notebook if you select a gpu runtime. See the notebook for more details.
|
61 |
|
62 |
+
## Prompt and Response Format
|
|
|
|
|
|
|
|
|
|
|
63 |
|
64 |
To make a function call, you should format your input like this:
|
65 |
|