Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
arxiv:
2310.08659
Inference Endpoints
text-generation-inference
AutoTrain Compatible
4-bit precision
custom_code
8-bit precision
Misc with no match
Eval Results
Merge
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
25
Full-text search
Edit filters
Sort: Trending
Active filters:
2310.08659
Clear all
LoftQ/Llama-2-7b-hf-4bit-64rank
Text Generation
•
Updated
May 3
•
934
•
1
LoftQ/Llama-2-13b-hf-4bit-64rank
Text Generation
•
Updated
Dec 19, 2023
•
427
•
2
LoftQ/Llama-2-70b-hf-4bit-64rank
Text Generation
•
Updated
May 3
•
43
•
1
LoftQ/Mistral-7B-v0.1-4bit-32rank
Text Generation
•
Updated
Dec 20, 2023
•
28
LoftQ/Mistral-7B-v0.1-4bit-64rank
Text Generation
•
Updated
Apr 18
•
15
•
2
LoftQ/Llama-2-7b-hf-fp16-64rank-gsm8k
Updated
Dec 20, 2023
•
12
LoftQ/phi-2-4bit-64rank
Text Generation
•
Updated
Aug 15
•
1.1k
LoftQ/Meta-Llama-3-8B-4bit-64rank
Text Generation
•
Updated
May 3
•
29
•
1
LoftQ/CodeLlama-7b-hf-4bit-64rank
Text Generation
•
Updated
Apr 20
•
114
LoftQ/CodeLlama-13b-hf-4bit-64rank
Text Generation
•
Updated
Apr 20
•
20
LoftQ/Meta-Llama-3-8B-Instruct-4bit-64rank
Text Generation
•
Updated
May 3
•
20
•
1
LoftQ/Meta-Llama-3-70B-4bit-64rank-1iter
Text Generation
•
Updated
Apr 21
•
19
•
2
LoftQ/Meta-Llama-3-70B-4bit-64rank
Text Generation
•
Updated
May 3
•
11
•
1
LoftQ/Meta-Llama-3-70B-Instruct-4bit-64rank
Text Generation
•
Updated
May 3
•
12
•
1
LoftQ/Phi-3-mini-128k-instruct-4bit-64rank
Text Generation
•
Updated
May 3
•
8
LoftQ/Phi-3-mini-4k-instruct-4bit-64rank
Text Generation
•
Updated
May 3
•
14
anamikac2708/Llama3-8b-LoftQ-finetuned-investopedia-Lora-Adapters
Updated
Jun 18
RichardErkhov/LoftQ_-_Llama-2-13b-hf-4bit-64rank-gguf
Updated
Aug 12
•
115
RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-gguf
Updated
Aug 18
•
140
RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-4bits
Updated
about 1 month ago
•
4
RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-8bits
Updated
about 1 month ago
•
6
RichardErkhov/LoftQ_-_Llama-2-13b-hf-4bit-64rank-4bits
Updated
22 days ago
•
9
RichardErkhov/LoftQ_-_phi-2-4bit-64rank-gguf
Updated
19 days ago
•
368
RichardErkhov/LoftQ_-_phi-2-4bit-64rank-4bits
Updated
18 days ago
•
3
RichardErkhov/LoftQ_-_phi-2-4bit-64rank-8bits
Updated
18 days ago
•
2