QA fine tuning

#14
by codegood - opened

Hello,

I'm planning to fine-tune this model for the QA dataset. I don't know if it's suitable for that.
If it is I want to know if there is any other repository where the model is sharded, as I want to train it on Colab and the model is too big.
If someone has used this model. If you can let me know what are the best hyperparameters, any tutorial to follow.

Thanks

Hi,
Did you find anything? I also have to do the same.

I dropped the idea to find tune this model as it's focused on SQL coding

codegood changed discussion status to closed

Sign up or log in to comment