Load in pythia-12b

#28
by ghidav - opened

I need to download this model and upload its weight into the classic pythia-12b. However, it returns the following error:

The size of tensor a (50688) must match the size of tensor b (50288) at non-singleton dimension 0

Shouldn't it be the same model structure?

I'm not sure, but there may be some minor changes because there were a few added tokens. I'm not completely sure about this

Sign up or log in to comment