Due to the huge number of model parameters, LLMs take a significant memory footprint for inference, making it very costly to be deployed in real-world applications. In this section, we discuss how to reduce the memory footprint of LLMs via a popular model compression approach (_i.e._, model quantization), so that large-sized LLMs can be used in resource-limited settings, which also likely reduces the inference latency.