Zachary Mueller's picture

Zachary Mueller

muellerzr

·

AI & ML interests

None yet

Articles

Fixing Gradient Accumulation

Accelerate 1.0.0

From DeepSpeed to FSDP and Back Again with Hugging Face Accelerate

GaLore: Advancing Large Model Training on Consumer-grade Hardware

From PyTorch DDP to 🤗 Accelerate to 🤗 Trainer, mastery of distributed training with ease

CO2 Emissions and the 🤗 Hub: Leading the Charge

Supercharged Searching on the Hugging Face Hub

Organizations

muellerzr's activity

upvoted a paper 16 days ago

SelfCodeAlign: Self-Alignment for Code Generation

Paper • 2410.24198 • Published 17 days ago • 20

upvoted an article 2 months ago

Article

Accelerate 1.0.0

Sep 13

• 50

upvoted 2 articles 5 months ago

Article

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Jun 18

• 41

Article

From DeepSpeed to FSDP and Back Again with Hugging Face Accelerate

Jun 13

• 44

upvoted an article 7 months ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 74

upvoted a collection 7 months ago

llama 3 self-align experiments

Replicating the pipeline for StarCoder-2 Instruct on Llama-3-8B with some tweaks https://huggingface.co/blog/sc2-instruct • 4 items • Updated May 9 • 6