on MPT-30B gradient checkpointing

#7
by DanielTTY - opened

Could you do the same for the 30B version? or could you explain to us how it should be done here? thanks

are the changes to allow gradient checkpointing in these lines?:
https://huggingface.co/cekal/mpt-7b-peft-compatible/commit/a5eab52c1c61c1d50a4e01428949f6ff90c73c48

Sign up or log in to comment