The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper
•
2402.17764
•
Published
•
602
paper_collection
-
-
Yi: Open Foundation Models by 01.AI
Paper • 2403.04652 • Published • 62 -
Simple and Scalable Strategies to Continually Pre-train Large Language Models
Paper • 2403.08763 • Published • 48 -
Stealing Part of a Production Language Model
Paper • 2403.06634 • Published • 90 -
BitNet: Scaling 1-bit Transformers for Large Language Models
Paper • 2310.11453 • Published • 96 -
Chain-of-Thought Reasoning Without Prompting
Paper • 2402.10200 • Published • 99 -
Learn Your Reference Model for Real Good Alignment
Paper • 2404.09656 • Published • 82 -
Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences
Paper • 2404.03715 • Published • 60