Crystalcareai commited on
Commit
fdf8bd0
1 Parent(s): e8d49a9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -3
README.md CHANGED
@@ -11,10 +11,15 @@ license_link: https://ai.google.dev/gemma/terms
11
  </p>
12
 
13
 
 
14
 
15
- Note: If you wish to use GemMoE while it is in beta, you must flag (trust_remote_code=True) in your training/inference config.
16
- Please read the howto.md below for a description of these newer models.
17
- I've shared how you can make your own, you can find it [here](https://huggingface.co/Crystalcareai/GemMoE-Base-Random/blob/main/howto.md).
 
 
 
 
18
 
19
 
20
  # GemMoE: An 8x8 Mixture Of Experts based on Gemma.
 
11
  </p>
12
 
13
 
14
+ # Using GemMoE (Beta)
15
 
16
+ > **Note:** If you wish to use GemMoE while it is in beta, you must add the flag `trust_remote_code=True` in your training/inference config.
17
+
18
+ Please read the `howto.md` below for a description of these newer models.
19
+
20
+ ## Creating Your Own GemMoE Model
21
+
22
+ I've shared instructions on how you can create your own GemMoE model. You can find the guide [here](https://huggingface.co/Crystalcareai/GemMoE-Base-Random/blob/main/howto.md).
23
 
24
 
25
  # GemMoE: An 8x8 Mixture Of Experts based on Gemma.