moidhassan's picture
Fix for RuntimeError: FlashAttention only support fp16 and bf16 data type during fine tuning.
5b7216f verified