Irina Rish

irinarish's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

authored a paper 4 days ago

RedPajama: an Open Dataset for Training Large Language Models

Paper • 2411.12372 • Published 5 days ago • 44

upvoted a paper 4 months ago

Spectra: A Comprehensive Study of Ternary, Quantized, and FP16 Language Models

Paper • 2407.12327 • Published Jul 17 • 77

authored a paper 6 months ago

$μ$LO: Compute-Efficient Meta-Generalization of Learned Optimizers

Paper • 2406.00153 • Published May 31 • 10

authored a paper 9 months ago

Simple and Scalable Strategies to Continually Pre-train Large Language Models

Paper • 2403.08763 • Published Mar 13 • 49