metadata

base_model: Unbabel/TowerInstruct-7B-v0.2
inference: false
language:
  - en
  - de
  - fr
  - zh
  - pt
  - nl
  - ru
  - ko
  - it
  - es
license: cc-by-nc-4.0
model_creator: Unbabel
model_name: TowerInstruct 7B v0.2
model_type: llama
pipeline_tag: translation
quantized_by: arzeth

Quantization info

I didn't use imatrix because I have no idea if they are okay for non-general-purpose LLMs.

Quantized with llama.cpp @ 4c4cb30736582cacb1a164a9d4bc8e17b1014be7 (2024-02-24).

IQ3_M requires minimum 4c4cb30736582cacb1a164a9d4bc8e17b1014be7

Model creator: Unbabel
Original card: https://huggingface.co/Unbabel/TowerInstruct-7B-v0.2
Template: The model was trained using the ChatML prompt templates without any system prompts

These .gguf files themselves are under CC-0 (i.e. public domain). TowerInstruct-7B-v0.2 itself is under CC-BY-NC-4.0, but it is based on Llama 2 which is licensed under the LLAMA 2 Community License (Copyright © Meta Platforms, Inc. All Rights Reserved.)