rinna

/

japanese-gpt-neox-3.6b-instruction-ppo

like 70

Follow

rinna Co., Ltd. 88

https://github.com/byroneverson/gptneox.cpp has code for it. Annoyingly I could only get it to work by letting it download the model from hf, and it wouldn't use my downloaded one, but from the scripts folder in that repo (after doing make, probably):
python ./convert_gptneox_to_ggml.py rinna/japanese-gpt-neox-3.6b-instruction-ppo ./out

You can run it using ./main-gptneox (./main does not work as it is still the llama format).