AuriAetherwiing commited on
Commit
18b930e
1 Parent(s): 50597d2

revert to previous commit, I'm stupid

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -29,7 +29,7 @@ model-index:
29
 
30
  <p>Dedicated to Nev.</p>
31
 
32
- <p><b>Version notes for 0.1</b>: Reprocessed dataset (via Cahvay), readjusted training config for 8xH100 SXM. Significant improvements in instruction following, long context understanding and overall coherence over v0.0.</p>
33
 
34
  <p>
35
  <p>Prompt format is ChatML.</p><br>
@@ -63,7 +63,7 @@ model-index:
63
  <h3>
64
  Training time and hardware:
65
  </h3>
66
- <ul><li>12 hours on 8xH100 SXM, provided by <a href=https://featherless.ai/>FeatherlessAI</a></li></ul><br>
67
  </p>
68
  <p>Model was created by Kearm, Auri and Cahvay.</p>
69
  <h4>Special thanks:</h4><ul>
 
29
 
30
  <p>Dedicated to Nev.</p>
31
 
32
+ <p><b>Version notes for 0.2</b>: Basically, reprocessed the whole dataset again, due to a severe mistake in previously used pipeline, which left the data poisoned with a lot of non-unicode characters. Now, no more weird generation artifacts, and more stability. Major kudos to Cahvay for his work on fixing this critical issue.</p>
33
 
34
  <p>
35
  <p>Prompt format is ChatML.</p><br>
 
63
  <h3>
64
  Training time and hardware:
65
  </h3>
66
+ <ul><li>7 hours on 8xH100 SXM, provided by <a href=https://featherless.ai/>FeatherlessAI</a></li></ul><br>
67
  </p>
68
  <p>Model was created by Kearm, Auri and Cahvay.</p>
69
  <h4>Special thanks:</h4><ul>