DBME's picture

1

DBME

DBMe

·

AI & ML interests

I do optimized EXL2 quants for 48GB VRAM setups.

Recent Activity

updated a model about 23 hours ago

DBMe/Evathene-v1.0-4.86bpw-h6-exl2

updated a model 4 days ago

DBMe/Monstral-123B-2.85bpw-h6-exl2

updated a model 5 days ago

DBMe/Mistral-Large-Instruct-2411-2.86bpw-h6-exl2

View all activity

Organizations

None yet

DBMe's activity

New activity in DBMe/Mistral-Large-Instruct-2407-2.85bpw-h6-exl2 about 1 month ago

Set PYTORCH_CUDA_ALLOC_CONF=backend:cudaMallocAsync

#1 opened about 1 month ago by

Set PYTORCH_CUDA_ALLOC_CONF=backend:cudaMallocAsync

#1 opened about 1 month ago by