Read-ME: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design
Paper
•
2410.19123
•
Published
•
15
Peihao Wang
peihaowang
AI & ML interests
Geometric Learning, Generative Models, Neural Rendering, Large Language Models
Recent Activity
updated
a model
17 days ago
peihaowang/llama-410m-nh8-dclm-7.5b
updated
a model
17 days ago
peihaowang/llama-410m-nh16-dclm-7.5b
Organizations
