Penghui Qi

QPHutu's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted 5 collections 7 days ago

⚓️ Sailor Language Models

Collection

Sailor: Open Language Models tailored for South-East Asia (SEA) released by Sea AI Lab. • 17 items • Updated 9 days ago • 17

💡 DICE

Collection

Self-alignment with DPO Implicit Rewards • 5 items • Updated Jul 28 • 9

📈 Scaling Laws with Vocabulary

Collection

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11 • 6

🧬 RegMix: Data Mixture as Regression

Collection

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26 • 8

🔱 Sailor2 Language Models

Collection

Sailing in South-East Asia with Inclusive Multilingual LLMs • 9 items • Updated 9 days ago • 18

upvoted a paper about 1 month ago

Balancing Pipeline Parallelism with Vocabulary Parallelism

Paper • 2411.05288 • Published Nov 8 • 19

upvoted a paper 6 months ago

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24 • 3

upvoted a paper 11 months ago

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 23