RonanMcGovern commited on
Commit
213ec81
1 Parent(s): 72a17ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -15
README.md CHANGED
@@ -12,9 +12,14 @@ tags:
12
  - functions
13
  - function calling
14
  ---
15
- # fLlama 2 - Function Calling Llama 2 - 7B
16
 
17
- fLlama 2 extends the hugging face Llama 2 - 7B model with function calling capabilities. It allows users to make function calls within the model's input, making it capable of performing a variety of tasks.
 
 
 
 
 
18
 
19
  ## Licensing and Usage
20
 
@@ -48,22 +53,13 @@ The dataset used for training this model can be found at [Trelis Function Callin
48
 
49
  The data may be used for free for commercial and non-commercial use. It is Apache 2 licensed and does not have any dependencies (i.e. does not depend on Meta's Llama license.)
50
 
51
- ## Inference with HuggingFace 🤗
52
-
53
- Ensure you have the `transformers` package installed:
54
 
55
- ```
56
- pip install transformers
57
- ```
58
 
59
- Then, load the model from HuggingFace's model hub:
60
 
61
- ```
62
- from transformers import AutoModelForCausalLM, AutoTokenizer
63
-
64
- tokenizer = AutoTokenizer.from_pretrained("Trelis/Llama-2-7b-chat-hf-function-calling")
65
- model = AutoModelForCausalLM.from_pretrained("Trelis/Llama-2-7b-chat-hf-function-calling")
66
- ```
67
 
68
  To make a function call, you should format your input like this:
69
 
 
12
  - functions
13
  - function calling
14
  ---
15
+ # fLlama 2 - Function Calling Llama 2
16
 
17
+ - fLlama 2 extends the hugging face Llama 2 models with function calling capabilities.
18
+ - The model responds with a structured json argument with the function name and arguments
19
+
20
+ Available models:
21
+ - fLlama-7B (this repo)
22
+ - [fLlama-13](https://huggingface.co/Trelis/Llama-2-13b-chat-hf-function-calling) - RECOMMENDED. This is a stronger model and handles function calling more accurately.
23
 
24
  ## Licensing and Usage
25
 
 
53
 
54
  The data may be used for free for commercial and non-commercial use. It is Apache 2 licensed and does not have any dependencies (i.e. does not depend on Meta's Llama license.)
55
 
56
+ ## Inference with Google Colab and HuggingFace 🤗
 
 
57
 
58
+ Get started by saving your own copy of this [fLlama_Inference notebook](https://colab.research.google.com/drive/1Ow5cQ0JNv-vXsT-apCceH6Na3b4L7JyW?usp=sharing).
 
 
59
 
60
+ You will be able to run inference using a free Colab notebook if you select a gpu runtime. See the notebook for more details.
61
 
62
+ ## Prompt and Response Format
 
 
 
 
 
63
 
64
  To make a function call, you should format your input like this:
65