There are various frameworks and libraries developed for LLM training, evaluation, and deployment, and covering every single framework is out of this paper's scope. But we try to provide a brief introduction of some of the most popular ones, grouped into different categories.