sgugger

/

sharded-gpt-j-6B

like 3

Hello,

1. I wanted to understand how this sharded version will be useful compared to the original model weights on EleutherAI/gpt-j-6b;
2. Also, how did you do the sharding, can you share a script for the same.
3. I found some errors when trying to load in the tokenizer,

OSError: Can't load tokenizer for 'sgugger/sharded-gpt-j-6B'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'sgugger/sharded-gpt-j-6B' is the correct path to a directory containing all relevant files for a GPT2TokenizerFast tokenizer.