Hugging Face's logo

stabilityai
/
stablelm-3b-4e1t

Text Generation
Transformers
Safetensors
English
stablelm
causal-lm
Eval Results
Inference Endpoints
Model card Files Community
13

feat: add flash attention v2

#9
by jon-tow - opened
base: refs/heads/main
←
from: refs/pr/9
Discussion Files changed
+276
-20
jon-tow
 Stability AI org

Adds Flash Attention v2 support (ref: https://github.com/huggingface/transformers/issues/26350)

feat: add flash-attn v2 supportcf8afade
jon-tow changed pull request status to open
jon-tow changed pull request status to merged

Sign up or log in to comment