File size: 940 Bytes
4468ab7
 
ad0e49f
 
 
 
 
4468ab7
ad0e49f
c776c3b
ad0e49f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
---
license: llama2
language:
- ja
- en
base_model: tokyotech-llm/Swallow-70b-instruct-hf
pipeline_tag: text-generation
---

**[2.2bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/2.2bpw)**  (high quality loss, only for 24GB vRAM test.)  
**[4.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/4.0bpw)**  
**[6.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/6.0bpw)**  
**[8.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/8.0bpw)**

# Swallow-70b-instruct-exl2
- Model creator: [tokyotech-llm](https://huggingface.co/tokyotech-llm)
- Original model: [Swallow-70b-instruct-hf](https://huggingface.co/tokyotech-llm/Swallow-70b-instruct-hf)

## Prompt template

```
### 指示:
{instruction}

### 入力:
{input}

### 応答:

```

### Licence

Llama 2 is licensed under the LLAMA 2 Community License, Copyright (c) Meta Platforms, Inc. All Rights Reserved.