Open Source on training script?

by deleted - opened Apr 30, 2023

Discussion

deleted

Apr 30, 2023

Thanks for the hard work. Looking forward to the progress here once you guys get everything dialed in.

Are you planning to release the training script and an example JSON once you're done refining the process?

11b

Pygmalion org Apr 30, 2023

Our training code is available here: https://github.com/pygmalionai/accelerate-training-code/

For full transparency, these new models were trained using the feat/xformers-and-warmup branch. We plan on fixing/cleaning up some code there, then properly documenting everything in the README.

deleted

Apr 30, 2023

Awesome, thanks. I was perusing the github and must've missed it. Closing.

deleted changed discussion status to closed Apr 30, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment