\(\bullet\)_llama.cpp39_ makes it feasible to run quantized LLMaM models on a MacBook device. It supports INT4, INT5 and INT8 quantization, which is developed in efficient C/C++ implementation. It also supports a number of LLMaM based models, such as Alpaca and Vicuna.