gghf

#2 opened 4 days ago by

jokemodel1710

New activity in mistralai/Pixtral-12B-2409 6 days ago

Add EXL2, INT8, and/or INT4 version of the model, PLEASE!

#21 opened 12 days ago by

Abdelhak

New activity in gghfez/SmartMaid-123b-exl2 9 days ago

Good stuff

6

#1 opened 11 days ago by

BigHuggyD

New activity in gghfez/DarkMage-Large-v3-123b-4.5 18 days ago

how

1

#1 opened 23 days ago by

schnapper79

New activity in jukofyork/creative-writing-control-vectors-v3.0 18 days ago

Usage

14

#6 opened 19 days ago by

schnapper79

Model suggestions and requests

15

#5 opened 22 days ago by

New activity in mistralai/Mistral-Small-Instruct-2409 18 days ago

hilarious model card

#9 opened 18 days ago by

gghfez

New activity in jukofyork/creative-writing-control-vectors-v3.0 24 days ago

These seem to work with finetunes too

19

#3 opened about 1 month ago by

gghfez

New activity in CohereForAI/c4ai-command-r-plus-08-2024 24 days ago

Feedback

33

#3 opened about 1 month ago by

ChuckMcSneed

New activity in ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.1 25 days ago

"RPMax's Unconventional Approach"

35

#1 opened 26 days ago by

New activity in grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter-GGUF about 1 month ago

q8 gives error in LM studio: "Checksum failed file corrupted"

#1 opened about 1 month ago by

tazztone

New activity in unsloth/Meta-Llama-3.1-8B-Instruct about 1 month ago

Difference between this model and the one Meta released

#1 opened about 2 months ago by deleted

New activity in TheDrummer/UnslopNemo-v1-GGUF about 1 month ago

Feedback

10

#1 opened about 1 month ago by

TheDrummer

New activity in gghfez/DarkMage-123b-exl2 about 1 month ago

How did you do this?

11

#1 opened about 1 month ago by

New activity in jukofyork/creative-writing-control-vectors-v3.0 about 1 month ago

A very quick test using wizard-lm-2:8x22b and temperature = 0

18

#1 opened about 1 month ago by

New activity in nvidia/Mistral-NeMo-Minitron-8B-Base about 1 month ago

How to efficiently use this model?

#3 opened about 1 month ago by

Varkoyote

New activity in anthracite-org/magnum-v2-123b about 2 months ago

Consider a mistral-7b-instruct-v0.3 to use as an exl2 draft model with this?

4

#3 opened about 2 months ago by

gghfez

New activity in mistralai/Mistral-Large-Instruct-2407 about 2 months ago

Praise and Criticism

8

#23 opened about 2 months ago by

ChuckMcSneed

New activity in unsloth/gemma-2-27b-it-bnb-4bit about 2 months ago

How to create gguf fromm this

5

#3 opened about 2 months ago by

DerErnst

New activity in unsloth/Mistral-Nemo-Base-2407 about 2 months ago

difference

rdtfddgrffdgfdghfghdfujgdhgsf

#1 opened 3 months ago by

ehartford

New activity in ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ 2 months ago

Where GGUF?

7

#1 opened 2 months ago by

New activity in turboderp/Mistral-Large-Instruct-2407-123B-exl2 2 months ago

max_position_embeddings update in config.json

#2 opened 2 months ago by

Inktomi93

New activity in second-state/Mistral-Nemo-Instruct-2407-GGUF 3 months ago

Can't load in LM studio

10

#1 opened 3 months ago by

YujiKaido

New activity in Sao10K/L3-8B-Chara-v1-Alpha 3 months ago

Example groupchat-friendly character cards?

#1 opened 3 months ago by

gghfez

New activity in anthracite-org/magnum-v1-72b 4 months ago

GGUF (Q4_K_M only) outputs gibberish

15

#3 opened 4 months ago by

Ainonake

can someone make an EXL2 models for this but not using the max length 2048 thing :(

#7 opened 4 months ago by

NimbleDreams

New activity in alpindale/Refined-Anime-Text 4 months ago

Quite disappointed with your decision to re-upload.

17

#2 opened 4 months ago by

JosephusCheung

New activity in gghfez/WizardLM-2-8x22B-Beige-exl2_3.75bpw 4 months ago

ValueError: ## Could not find lm_head.* in model

#1 opened 4 months ago by

Asdfgbvcxz3355

New activity in gghfez/WizardLM-2-8x22B-Beige-GGUF 4 months ago

exl2

#1 opened 4 months ago by

DmitryPLSKN

New activity in cognitivecomputations/dolphin-2.9.2-mixtral-8x22b 4 months ago

Congrats!

15

#1 opened 4 months ago by

aaronday3

New activity in LoneStriker/llama-3-70B-Instruct-abliterated-6.0bpw-h6-exl2 5 months ago

did you have to do anything special to quantize this one?

1

#1 opened 5 months ago by

gghfez

New activity in hjhj3168/Llama-3-8b-Orthogonalized-exl2 5 months ago

It works, and IMO, it actually feels safter than the judgemental refusals.

#5 opened 5 months ago by

gghfez

New activity in turboderp/Mixtral-8x22B-Instruct-v0.1-exl2 6 months ago

Better way to download particular versions and track progress

#4 opened 6 months ago by

hrishbhdalal

Any chance of a 3.75bpw?

5

#3 opened 6 months ago by

gghfez

New activity in meta-llama/Meta-Llama-3-70B-Instruct 6 months ago

Cutoff March, 2023? Shouldn't it be 2024?

#7 opened 6 months ago by

kil3r

New activity in MaziyarPanahi/WizardLM-2-8x22B-GGUF 6 months ago

That wizardlm 8x22b is very advanced.!

18

#8 opened 6 months ago by

mirek190

New activity in cognitivecomputations/dolphin-2.5-mixtral-8x7b 10 months ago

Repetitive Text

13

#8 opened 10 months ago by

mlenno1

New activity in TheBloke/dolphin-2.5-mixtral-8x7b-GGUF 10 months ago

Reasoning this model id worse that original mixtral-8x7b-instruct model.