Spaces:

Aarifkhan
/

NSFW-3B

Runtime error

App Files Files Community

Aarifkhan commited on Jun 17

Commit

9a0ede3

•

1 Parent(s): e46f8aa

Update app.py

Files changed (1) hide show

app.py +1 -1

app.py CHANGED Viewed

@@ -82,7 +82,7 @@ model = AutoModelForCausalLM.from_pretrained(
     MODEL_ID,
     device_map="auto",
     quantization_config=quantization_config,
-    attn_implementation="flash_attention_2",
     trust_remote_code=True
 )

     MODEL_ID,
     device_map="auto",
     quantization_config=quantization_config,
+    # attn_implementation="flash_attention_2",
     trust_remote_code=True
 )