Update README.md

README.md

@@ -5,8 +5,11 @@ license: apache-2.0
 license: apache-2.0
 ---
 # LLM360 Research Suite: K2 Loss Spike 2
-During the first K2 training phase, we encountered two loss spikes. This repo contains 8 checkpoints that capture the training dynamics during the loss spikes.
+We encountered two major loss spikes while training K2. 
+* The [first loss spike](https://huggingface.co/LLM360/K2-Spike-1/) occured after X checkpoints and lasted over ~34 checkpoints. We restarted training at checkpoint X and training returned to normal.
+* The second loss spike occured after restarting training to fix the first loss spike at checkpoint X and lasted from ~8 checkpoints.
 
+We are releasing these checkpoints so others can study this interesting phenomena in large model training.
 <img src="k2_spike_1.png" alt="k2 spike 1"/>
 
 # Purpose