no config.json file
I am using oobabooga with cpu only on 5900x
I try to use this model with oobabooga an get an error
OSError: models\GPT-NeoX-20B-Erebus-GGML does not appear to have a file named config.json.
when I use the config file from non GGML branch I got this error
OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory models\GPT-NeoX-20B-Erebus-GGML.
Anyone can help me?
I second that.
After some googling there is supposedly a way to generate them afterwards, but i could not get it to work, yet. Help would be appreciated.
ggml models files don't use config files. they're for applications like KoboldCPP. ooba's program might be able to run it but you'd have to ask them cuz its not a model problem
Thanks for clarifying that, had no luck with KoboldAI nor oobabooga yet to get it running.
Download our software from https://koboldai.org/cpp and it should work out of the box, its the only official software for this model.
If you want a HF Pytorch compatible version of the model look at KoboldAI/GPT-NeoX-20B-Erebus