Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
allenai
/
OLMoE-1B-7B-0924
like
107
Follow
Ai2
1,419
Text Generation
Transformers
Safetensors
allenai/OLMoE-mix-0924
English
olmoe
Mixture of Experts
olmo
Carbon Emissions
Inference Endpoints
arxiv:
2409.02060
License:
apache-2.0
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
main
OLMoE-1B-7B-0924
/
config.json
Commit History
Fix load balancing coefficient
83792c6
verified
awettig
commited on
Aug 30
Update config.json
628fa0e
verified
Muennighoff
commited on
Jul 24
Update config.json
ad1b9ae
verified
Muennighoff
commited on
Jul 24
Add step1200000
175203d
Muennighoff
commited on
Jul 24