Text Generation Inference?
3
#28 opened 7 months ago
by
silvacarl
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660775548920-628d998a2b60ec0f336cc1eb.png)
ValueError: Error raised by inference API: Model is overloaded
2
#25 opened 7 months ago
by
alemaooo
Increase `sliding_window` to 32k
1
#24 opened 7 months ago
by
alpindale
![](https://cdn-avatars.huggingface.co/v1/production/uploads/635567189c72a7e742f1419c/tbfBz0furS-y4ISgoe6j0.jpeg)
Intuition for quality decrease after quantization
4
#23 opened 7 months ago
by
krumeto
Test Mixtral Model loading ERROR!
3
#21 opened 7 months ago
by
ExceedZhang
Discuss benefits of this work
1
#20 opened 7 months ago
by
Starlento
![](https://cdn-avatars.huggingface.co/v1/production/uploads/631c7a0fe65cd7f686d52856/01bjIoVpJYtP2Ngx8MliP.png)
Mixtral not generating anything for some prompts
4
#19 opened 7 months ago
by
csgxy2022
Inquiry about Generation Speed
5
#17 opened 7 months ago
by
Boyue27
Error when deploying sagemaker endpoint: Unsupported model type mixtral
7
#16 opened 7 months ago
by
harryneal
GPU requirements
5
#14 opened 7 months ago
by
YorelNation
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1660638608323-noauth.png)
π Torrent File for AI Model Download π
#12 opened 7 months ago
by
Nondzu
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63729f35acef705233c87909/2ApbWLasMZLptlSbk9emj.png)
How did Mixtral make openchat_3.5 worse?
#10 opened 7 months ago
by
JJJJJPSYCHIC
KeyError: 'mixtral'
10
#9 opened 7 months ago
by
meetrais
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64c9db05c547ed5243115119/f52L-o1cGkceScjN1TNk4.jpeg)
What is the ETA for Mistral-embed? And what is the max token length of this emb model?
3
#8 opened 7 months ago
by
kk3dmax
Instruction Template during inference?
7
#6 opened 7 months ago
by
jf-11
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64ece3a86343a356327e51ea/FaHeZQhE0tQ5SwcrSWWe4.png)
Min hardware requirements
16
#3 opened 7 months ago
by
narvind2003
![](https://cdn-avatars.huggingface.co/v1/production/uploads/605cc8ef6ce6cabbb3474b6a/b8yTvn1GFhkA-jdkwat35.png)