OpenNLPLab commited on
Commit
144fe25
β€’
1 Parent(s): 127ea79
Files changed (1) hide show
  1. README.md +12 -3
README.md CHANGED
@@ -39,9 +39,18 @@ This official repository unveils the TransNormerLLM3 model along with its open-s
39
 
40
  # Released Weights
41
 
42
- | param | token | Hugging Face | Model Scope | Wisemodel |
43
- | :-----: | :---: | :----------: | :---------: | :-------: |
44
- | **15B** | 50B | πŸ€— | πŸ€– | 🐯 |
 
 
 
 
 
 
 
 
 
45
 
46
  # Benchmark Results
47
  The evaluations of all models are conducted using the official settings and the [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) framework.
 
39
 
40
  # Released Weights
41
 
42
+ | param | token | Hugging Face | Model Scope | Wisemodel |
43
+ | :-----: | :---: | :------------------------------------------------------------------------------------------------------------------: | :---------: | :-------: |
44
+ | **15B** | 50B | πŸ€—[step13000](ttps://huggingface.co/OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints/tree/step13000-50Btokens) | πŸ€– | 🐯 |
45
+
46
+
47
+ ```python
48
+ from transformers import AutoModelForCausalLM, AutoTokenizer
49
+
50
+ tokenizer = AutoTokenizer.from_pretrained("OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints", revision='step13000-50Btokens', trust_remote_code=True)
51
+
52
+ model = AutoModelForCausalLM.from_pretrained("OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints", torch_dtype=torch.bfloat16,revision='step13000-50Btokens', device_map="auto", trust_remote_code=True)
53
+ ```
54
 
55
  # Benchmark Results
56
  The evaluations of all models are conducted using the official settings and the [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) framework.