Hugging Face's logo
turboderp's picture
TFLOPS icon 388.5 TFLOPS
44 4

turboderp

turboderp
vgoklani's profile picture githung's profile picture fbjr's profile picture
·

AI & ML interests

All the things

Organizations

The Royal Lab's profile picture Hugging Face Discord Community's profile picture Anthracite Core's profile picture

turboderp's activity

New activity in turboderp/Mistral-Large-Instruct-2407-123B-exl2 20 days ago

Bitwidth for LM Head

1
#3 opened 22 days ago by denru
New activity in turboderp/Mixtral-8x22B-Instruct-v0.1-exl2 24 days ago

Does not run in Oobabooga?

1
#5 opened 25 days ago by AIGUYCONTENT
New activity in turboderp/Mistral-Large-Instruct-2407-123B-exl2 about 1 month ago

max_position_embeddings update in config.json

3
#2 opened about 1 month ago by Inktomi93

5.0bpw quants

2
#1 opened about 1 month ago by bullerwins
New activity in turboderp/Qwama-0.5B-Instruct about 1 month ago

Remove stale `model.safetensors.index.json`.

1
#1 opened about 1 month ago by cdnamz
New activity in turboderp/Llama-3.1-70B-Instruct-exl2 about 1 month ago

TypeError: Value for eos_token_id is not of expected type <class 'int'>

1
#1 opened about 1 month ago by St33lMouse
New activity in turboderp/Llama-3.1-8B-Instruct-exl2 about 1 month ago

eos_token_id error in oobabooga

6
#1 opened about 1 month ago by Olafangensan
New activity in turboderp/Mistral-Nemo-Instruct-12B-exl2 about 1 month ago

Upload the tokenizer file on all quants.

1
#2 opened about 1 month ago by CrazyKrow
New activity in turboderp/turbcat-instruct-72b about 1 month ago

Getting run-on sentences at 6k context

4
#1 opened about 1 month ago by St33lMouse
New activity in turboderp/gemma-2-9b-it-exl2 about 2 months ago

exllama 0.1.6

2
#1 opened about 2 months ago by flflow
New activity in google/gemma-2-27b-it about 2 months ago

Exl Quants Please

1
#15 opened about 2 months ago by rjmehta
New activity in royallab/Yi-34B-exl2 2 months ago

Update README.md with license information

1
#1 opened 2 months ago by Chen-01AI
New activity in turboderp/Mixtral-8x7B-instruct-exl2 2 months ago

model.safetensors.index.json refers to non-existent files?

1
#6 opened 2 months ago by dmanary-pronavigator
New activity in bartowski/Phi-3-medium-128k-instruct-GGUF 2 months ago

Quantization suggestion

29
#3 opened 3 months ago by ZeroWw
New activity in turboderp/granite-20b-code-instruct-exl2 3 months ago

Trying to quantize granite-3B

1
#1 opened 3 months ago by Interpause
New activity in turboderp/Cat-Llama-3-70B-instruct 4 months ago

It prints only new lines.

1
#7 opened 4 months ago by rjmehta

pytorch_model.bin.index.json is incorrect

2
#5 opened 4 months ago by dustydecapod
New activity in turboderp/Cat-Llama-3-70B-instruct-exl2 4 months ago

Update README.md

1
#1 opened 4 months ago by Kquant03
New activity in turboderp/Cat-Llama-3-70B-instruct 4 months ago

Update README.md
#2 opened 4 months ago by Kquant03

correct license

1
#1 opened 4 months ago by Walmart-the-bag
New activity in turboderp/Llama-3-8B-Instruct-exl2 4 months ago

Calibration data

2
#2 opened 4 months ago by Apel-sin
New activity in turboderp/Llama-3-70B-exl2 4 months ago

Produces garbage

3
#1 opened 4 months ago by catid
New activity in turboderp/Llama-3-8B-Instruct-exl2 4 months ago

[Update needed to stop infinite generation] On special_tokens_map.json & tokenizer_config.son

9
#1 opened 4 months ago by apolloparty
New activity in turboderp/Mixtral-8x22B-Instruct-v0.1-exl2 4 months ago

Any chance of a 3.75bpw?

5
#3 opened 4 months ago by gghfez

tokenizer.json typo

1
#1 opened 4 months ago by robeyh
New activity in turboderp/Mixtral-8x22B-v0.1-exl2 5 months ago

thank you

2
#1 opened 5 months ago by ek826

typo

1
#2 opened 5 months ago by WaveCut
New activity in turboderp/command-r-v01-35B-exl2 5 months ago

grounded_generation_template support?

2
#3 opened 5 months ago by aw49cj2xf
New activity in turboderp/command-r-plus-103B-exl2 5 months ago

segmentation fault

2
#1 opened 5 months ago by Awadh
New activity in turboderp/Gemma-7B-exl2 6 months ago

ExLlamaV2 looks very cool!

2
#1 opened 6 months ago by julien-c
New activity in turboderp/Mixtral-8x7B-instruct-exl2 6 months ago

tabbyapi usage

1
#4 opened 6 months ago by ainoob101
New activity in turboderp/CodeLlama-34B-instruct-exl2 6 months ago

too many files

1
#2 opened 6 months ago by ainoob101
New activity in turboderp/Smaug-72B-exl2 6 months ago

3 x 4096 - won't load

3
#4 opened 6 months ago by bdambrosio

Qwen 1.5 series pls

9
#2 opened 6 months ago by Pevernow
New activity in codellama/CodeLlama-70b-Instruct-hf 7 months ago

Context length?

10
#2 opened 7 months ago by turboderp
New activity in turboderp/Mixtral-8x7B-exl2 8 months ago

Acting like a Instruction tuned model?

2
#3 opened 8 months ago by Thomasryan1776
New activity in turboderp/Mixtral-8x7B-exl2 9 months ago

multi-gpu?

2
#1 opened 9 months ago by bdambrosio
New activity in amazon/MistralLite 10 months ago

System prompt?

2
#10 opened 10 months ago by turboderp
New activity in 01-ai/Yi-34B 10 months ago

llama-compatibility

34
#11 opened 10 months ago by ehartford
New activity in turboderp/Llama2-70B-chat-exl2 10 months ago

Can 2.35bpw be used on a single 4090 GPU?

1
#2 opened 11 months ago by Wizd
New activity in turboderp/Llama2-70B-chat-exl2 11 months ago

How to use these models

1
#1 opened 11 months ago by KSOPKOVIC
New activity in turboderp/CodeLlama-34B-instruct-exl2 11 months ago

I can't replicate your speed. Nowhere close.

2
#1 opened 11 months ago by 1TBGPU4EVR
New activity in turboderp/Mistral-7B-instruct-exl2 11 months ago

Command used to quantize model

1
#1 opened 11 months ago by ndurkee
New activity in TheBloke/Llama-2-70B-GPTQ about 1 year ago

The `main` branch for TheBloke/Llama-2-70B-GPTQ appears borked

11
#3 opened about 1 year ago by Aivean