taicheng (taicheng guo)

upvoted 2 papers 10 days ago

GRIN: GRadient-INformed MoE

Paper • 2409.12136 • Published 17 days ago • 14

Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale

Paper • 2409.17115 • Published 10 days ago • 58

upvoted 2 papers 15 days ago

Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization

Paper • 2409.12903 • Published 16 days ago • 20

Training Language Models to Self-Correct via Reinforcement Learning

Paper • 2409.12917 • Published 16 days ago • 128

upvoted a paper 17 days ago

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler

Paper • 2408.13359 • Published Aug 23 • 21

upvoted a paper 24 days ago

Alignment Studio: Aligning Large Language Models to Particular Contextual Regulations

Paper • 2403.09704 • Published Mar 8 • 31

upvoted a paper about 1 month ago

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published Sep 3 • 77

upvoted an article about 1 month ago

Article

Preference Tuning LLMs with Direct Preference Optimization Methods

Jan 18

• 33

upvoted a paper about 1 month ago

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Paper • 2408.10188 • Published Aug 19 • 51

upvoted a paper 2 months ago

Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters

Paper • 2406.05955 • Published Jun 10 • 22

upvoted a collection 2 months ago

DeepSeekCoder-V2

Collection

6 items • Updated about 1 month ago • 81

upvoted 2 papers 3 months ago

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18 • 52

Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models

Paper • 2406.13542 • Published Jun 19 • 16

upvoted 2 papers 4 months ago

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published May 19 • 150

SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmark

Paper • 2402.05138 • Published Feb 6 • 2

upvoted a collection 5 months ago

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12 • 212

upvoted a paper 7 months ago

Teaching Large Language Models to Reason with Reinforcement Learning

Paper • 2403.04642 • Published Mar 7 • 46

upvoted a paper 8 months ago

Large Language Model based Multi-Agents: A Survey of Progress and Challenges

Paper • 2402.01680 • Published Jan 21 • 2

taicheng guo

AI & ML interests

Organizations

taicheng's activity