Eli Chen's picture

2 4 55

Eli Chen

elichen3051

·

AI & ML interests

Learning Algorithm, Reinforcement Learning, Data Synthesize, Benchmarking

Recent Activity

upvoted an article 3 days ago

Efficient LLM Pretraining: Packed Sequences and Masked Attention

updated a dataset 6 days ago

skymizer/axolotl-tiny-set

updated a dataset 6 days ago

skymizer/fineweb-edu-dedup-5B

View all activity

Organizations

elichen3051's activity

upvoted an article 3 days ago

Article

Efficient LLM Pretraining: Packed Sequences and Masked Attention

By

•

Oct 7

• 7

upvoted 3 collections 6 months ago

🍷 FineWeb datasets

5 items • Updated Jun 26 • 20

📚 FineWeb-Edu

FineWeb-Edu datasets, classifier and ablation model • 5 items • Updated Jun 12 • 11

Instruction Tuning Datasets

For both SFT and DPO • 23 items • Updated 7 days ago • 1