See the full model card here: https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.0 6.0bpw version, using default calibration dataset, for the 72gb chads
See the full model card here: https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.0 6.0bpw version, using default calibration dataset, for the 72gb chads