Update README.md
Browse files
README.md
CHANGED
@@ -6,10 +6,17 @@ license: apache-2.0
|
|
6 |
|
7 |
## Function Calling Performance
|
8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
### Berkeley function-calling leaderboard (EN)
|
10 |
|
11 |
-
| Models |
|
12 |
-
|
13 |
-
| [**Breeze-7B-FC-v1_0 (FC)**](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0) |
|
14 |
-
| [GPT-3.5-Turbo-0125 (FC)](https://openai.com) |
|
15 |
|
|
|
6 |
|
7 |
## Function Calling Performance
|
8 |
|
9 |
+
| Models | #Parameters | License | Function Calling? | Chatbot? |
|
10 |
+
|--------------------------------------------------------------------------------------------|-------------|------------|-------------------|----------|
|
11 |
+
| [Breeze-7B-Instruct-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v1_0)| 7B | Apache 2.0 | Yes | No |
|
12 |
+
| [**Breeze-7B-FC-v1_0**](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0) | 7B | Apache 2.0 | Yes | Yes |
|
13 |
+
| [Gorilla-OpenFunctions-v2](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0) | 7B | Apache 2.0 | Yes | No |
|
14 |
+
| [GPT-3.5-Turbo-0125](https://openai.com) | | Proprietary| Yes | Yes |
|
15 |
+
|
16 |
### Berkeley function-calling leaderboard (EN)
|
17 |
|
18 |
+
| Models | ↑ Overall | Relevance<br/>Detection | AST/<br/>Simple | AST/<br/>Multiple | AST/<br/>Parallel | AST/<br/>Parallel-Multiple | Exec/<br/>Simple | Exec/<br/>Multiple | Exec/<br/>Parallel | Exec/<br/>Parallel-Multiple |
|
19 |
+
|-------------------------------------------------------------------------------------------------|----------|---------------------|------------|--------------|--------------|------------------------|--------------|---------------------|---------------------|-------------------------------|
|
20 |
+
| [**Breeze-7B-FC-v1_0 (FC)**](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0) | 86.01 | 74.58 | 90.00 | 93.00 | 82.00 | 83.00 | 98.00 | 92.00 | 88.00 | 75.00 |
|
21 |
+
| [GPT-3.5-Turbo-0125 (FC)](https://openai.com) | 72.77 | 4.58 | 87.75 | 90.50 | 88.50 | 82.50 | 91.00 | 82.00 | 78.00 | 52.50 |
|
22 |
|