victormiller commited on
Commit
a9ef891
1 Parent(s): b4f09c6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -10,11 +10,11 @@ pinned: false
10
 
11
  **LLM360 is an initiative to open-source large language models (LLMs) that foster transparency, trust, and collaborative research.**
12
 
13
- LLM360 releases complete training details including all of the following artifacts associated with each model:
14
 
15
- * Frequent Intermediate Model Checkpoints: During training, model parameters and optimizer states are collected regularly. These artifacts can offer valuable insights for studying LLM training dynamics and how it scales with data.
16
- * Training Data with Full Data Sequence: The entire training dataset is fully disclosed and made publicly available. In addition, the full sequence of data examples used at each training step.
17
- * Source Code: All the code used, including data processing, training, evaluation, and analysis.
18
- * Logs and Metrics: All the training logs and evaluations done during training and using the final model are publicly disclosed.​
19
 
20
  LLM360 is a collaboration between Petuum, MBZUAI, and Cerebras.
 
10
 
11
  **LLM360 is an initiative to open-source large language models (LLMs) that foster transparency, trust, and collaborative research.**
12
 
13
+ All models under LLM360 will release:
14
 
15
+ * Up to 360 Intermediate Model Checkpoints
16
+ * Training Data with Full Data Sequence
17
+ * Training, Data Processing, and Evaluation Source Code
18
+ * Logs and Metrics
19
 
20
  LLM360 is a collaboration between Petuum, MBZUAI, and Cerebras.