LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding
Paper
•
2404.16710
•
Published
•
72
LayerSkip
Models continually pretrained using LayerSkip - https://arxiv.org/abs/2404.16710
-
-
facebook/layerskip-llama2-7B
Text Generation • Updated • 191 • 10 -
facebook/layerskip-llama2-13B
Text Generation • Updated • 58 • 5 -
facebook/layerskip-llama2-70B
Text Generation • Updated • 57 • 4 -
facebook/layerskip-codellama-7B
Text Generation • Updated • 33 • 5 -
facebook/layerskip-codellama-34B
Text Generation • Updated • 48 • 4 -
facebook/layerskip-llama3-8B
Text Generation • Updated • 142 • 15 -
facebook/layerskip-llama3.2-1B
Text Generation • Updated • 428 • 15