O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?
Paper
•
2411.16489
•
Published
•
36
qinluo
qinluo
AI & ML interests
None yet
Recent Activity
View all activity
Organizations
None yet
qinluo's activity
upvoted
a
paper
16 days ago
upvoted
an
article
26 days ago
Article
Releasing the largest multilingual open pretraining dataset
By
•
•
98
upvoted
a
paper
30 days ago
upvoted
2
papers
about 1 month ago
upvoted
a
paper
2 months ago
upvoted
4
papers
3 months ago
Let's Verify Step by Step
Paper
•
2305.20050
•
Published
•
10
V-STaR: Training Verifiers for Self-Taught Reasoners
Paper
•
2402.06457
•
Published
•
9
LongRecipe: Recipe for Efficient Long Context Generalization in Large Languge Models
Paper
•
2409.00509
•
Published
•
38
RegMix: Data Mixture as Regression for Language Model Pre-training
Paper
•
2407.01492
•
Published
•
35
upvoted
an
article
4 months ago
Article
SmolLM - blazingly fast and remarkably powerful
•
286
upvoted
a
paper
6 months ago
upvoted
a
collection
6 months ago
upvoted
a
paper
6 months ago
upvoted
3
papers
7 months ago
FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design
Paper
•
2401.14112
•
Published
•
18
Decoding Compressed Trust: Scrutinizing the Trustworthiness of Efficient LLMs Under Compression
Paper
•
2403.15447
•
Published
•
16
WildChat: 1M ChatGPT Interaction Logs in the Wild
Paper
•
2405.01470
•
Published
•
60
upvoted
a
paper
8 months ago
upvoted
2
articles
8 months ago
Article
⚗️ 🧑🏼🌾 Let's grow some Domain Specific Datasets together
By
•
•
29Article
🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets
By
•
•
73