README.md

metadata

license: apache-2.0

Quantization config

    "zero_point": true,
    "q_group_size": 128,
    "w_bit": 4,
    "version": "GEMM"

Work supported by https://datacrunch.io/

Quantized by: gradjitta