File size: 82 Bytes
1ebaa91
 
 
 
 
 
1
2
3
4
5
6
{
  "zero_point": true,
  "q_group_size": 128,
  "w_bit": 4,
  "version": "GEMM"
}