2.2bpw (high quality loss, only for 24GB vRAM test.)
4.0bpw
6.0bpw
8.0bpw
Swallow-70b-instruct-exl2
- Model creator: tokyotech-llm
- Original model: Swallow-70b-instruct-hf
Prompt template
### 指示:
{instruction}
### 入力:
{input}
### å¿œç”:
Licence
Llama 2 is licensed under the LLAMA 2 Community License, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
Model tree for RioShiina/Swallow-70b-instruct-exl2
Base model
tokyotech-llm/Swallow-70b-instruct-hf