\(\bullet\)_Bitsandbytes36_ is developed based on the methods introduced in the papers of LLM.int80 [413] and 8-bit optimizers [426]. It focuses on the quantization of both activations and weights for LLMs, including the support on 8-bit and 4-bit (NF4,FP4) matrix multiplication for efficient inference, as well as an 8-bit optimizer for efficient training.