meta-llama

/

Llama-3.1-8B-Instruct

like 2.97k

Follow

Meta Llama 7,265

For Llama 3.1 model during training, should the padding side be to the left or right?

python

tokenizer = AutoTokenizer.from_pretrained(model_name, padding_side="left", add_eos_token=True)
tokenizer.pad_token = tokenizer.eos_token