Missing the optimizer states?
#1
by
wanicca
- opened
Hi, this repo seems to have no optimizer states (e.g., zero_pp_rank_0_mp_rank_00_optim_states) but only model states.
I think they are in the mp_rank file i.e. mp_rank_00_model_states.pt