I am able to run 13B but I am receiving this error with 70B.
ValueError: not enough values to unpack (expected 3, got 2)
Please see the README. you need inject_fused_attention=False
inject_fused_attention=False
Β· Sign up or log in to comment