imone's picture
Create README.md
7a983aa
|
raw
history blame
309 Bytes
metadata
license: other
language:
  - en
pipeline_tag: text-generation

LLaMA 13B with End-of-turn (EOT) Token

This is the LLaMA 13B model with <|end_of_turn|> token added as id 32000. The token input/output embedding is initialized as the mean of all existing input/output token embeddings, respectively.