| base_model: 01-ai/Yi-Coder-9B-Chat | |
| gate_mode: random | |
| dtype: bfloat16 | |
| experts: | |
| - source_model: 01-ai/Yi-Coder-9B-Chat | |
| - source_model: 01-ai/Yi-Coder-9B-Chat | |
| - source_model: 01-ai/Yi-Coder-9B-Chat | |
| - source_model: 01-ai/Yi-Coder-9B-Chat | |
| - source_model: 01-ai/Yi-Coder-9B-Chat | |
| - source_model: 01-ai/Yi-Coder-9B-Chat | |
| - source_model: 01-ai/Yi-Coder-9B-Chat | |
| - source_model: 01-ai/Yi-Coder-9B-Chat | |
| # and then train the sucker! |