Pre-training Distillation for Large Language Models: A Design Space Exploration
Paper
•
2410.16215
•
Published
•
15
By
ByRookie
AI & ML interests
None yet
Recent Activity
liked
a dataset
about 1 month ago
opencsg/chinese-fineweb-edu-v2
liked
a dataset
about 1 month ago
BAAI/CCI3-HQ
updated
a collection
about 1 month ago
kd
Organizations
ByRookie's activity
upvoted
2
papers
about 1 month ago