How do you download the whole pack of files?

#16
by Maslenok - opened

Srry I'm very new to the site and I can't do shit, I don't know how to install files!!

You can git clone the repo to get all the files:
git lfs install
git clone https://huggingface.co/EleutherAI/gpt-j-6B

Also you just download the model weights and then use them at inference when loading it from the transformers library:

from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-j-6B")
model = AutoModelForCausalLM.from_pretrained("EleutherAI/gpt-j-6B")

i tried the above command. after downloading the model to 100%, it gets killed. A quick fix/response would be highly appriciated.

@majidbhatti I think the issue is with memory. It loads 42GB of the model weights. So I think using a large RAM instance will help.

Sign up or log in to comment