Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
  • bits: 4,
  • group_size: 128,
  • desc_act: true,
  • static_groups: false,
  • sym: true,
  • lm_head: false,
  • damp_percent: 0.01,
  • true_sequential: true,
  • model_name_or_path: ,
  • model_file_base_name: model,
  • quant_method: gptq,
  • checkpoint_format: gptq,
  • meta:
  • quantizer: gptqmodel:0.9.9-dev0
Downloads last month
30
Safetensors
Model size
261M params
Tensor type
BF16
I32
FP16
Inference Examples
Inference API (serverless) is not available, repository is disabled.