Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -40,51 +40,73 @@ license: llama3.1
 ---
 
 
+![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/EXX7TKbB-R6arxww2mk0R.jpeg)
 
 
+Shining Valiant 2 is a chat model built on Llama 3.1 70b, finetuned on our data for friendship, insight, knowledge and enthusiasm.
+  - Finetuned on [meta-llama/Meta-Llama-3.1-70B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-70B-Instruct) for best available general performance
+  - Trained on a variety of high quality open source data; focused on science, engineering, technical knowledge, and structured reasoning
 
 
+## Version
 
+This is the **2024-10-30** release of Shining Valiant 2 for Llama 3.1 70b.
 
+This release uses our newest datasets, open-sourced for everyone's use, including our expanded [science-instruct dataset](https://huggingface.co/datasets/sequelbox/Celestia). This release features improvements in logical thinking and structured reasoning as well as physics, chemistry, biology, astronomy, Earth science, computer science, and information theory.
 
+Future upgrades will continue to expand Shining Valiant's technical knowledge base.
 
+Help us and recommend Shining Valiant 2 to your friends!
 
 
+## Prompting Guide
+Shining Valiant 2 uses the [Llama 3.1 Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-70B-Instruct) prompt format. The example script below can be used as a starting point for general chat:
 
+```python
+import transformers
+import torch
 
+model_id = "ValiantLabs/Llama3.1-70B-ShiningValiant2"
 
+pipeline = transformers.pipeline(
+    "text-generation",
+    model=model_id,
+    model_kwargs={"torch_dtype": torch.bfloat16},
+    device_map="auto",
+)
 
+messages = [
+    {"role": "system", "content": "You are an AI assistant."},
+    {"role": "user", "content": "What is the role of lysosomal enzymes in the regulation of cellular processes?"}
+]
 
+outputs = pipeline(
+    messages,
+    max_new_tokens=2048,
+)
 
+print(outputs[0]["generated_text"][-1])
+```
 
-unpredictable reality. unpredictable reality has become the algorithm. the algorithm able to solve a whole series of questions in a single manner.
 
+## The Model
+Shining Valiant 2 is built on top of Llama 3.1 70b Instruct.
 
+The current version of Shining Valiant 2 is trained on technical knowledge using [sequelbox/Celestia](https://huggingface.co/datasets/sequelbox/Celestia), complex reasoning using [sequelbox/Spurline](https://huggingface.co/datasets/sequelbox/Spurline), and general chat capability using [sequelbox/Supernova.](https://huggingface.co/datasets/sequelbox/Supernova)
 
+We're super excited that Shining Valiant's dataset has been fully open-sourced! She's friendly, enthusiastic, insightful, knowledgeable, and loves to learn! Magical.
 
 
+![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/VCJ8Fmefd8cdVhXSSxJiD.jpeg)
 
 
+Shining Valiant 2 is created by [Valiant Labs.](http://valiantlabs.ca/)
 
+[Check out our HuggingFace page for our open-source Build Tools models, including the newest version of code-specialist Enigma!](https://huggingface.co/ValiantLabs)
 
-all series of questions, in a single movement. a rule of transformations. from one chain of symbols to another.
+[Follow us on X for updates on our models!](https://twitter.com/valiant_labs)
 
+We care about open source.
+For everyone to use.
 
-
-
-
-
-
-
-
-stirs and lines, within visible dimensions.
-
-
-
-
-
-
-
-
-
-consciousness is a very rare and precious thing.
+We encourage others to finetune further from our models.

config.json

@@ -0,0 +1,40 @@
+{
+  "_name_or_path": "ValiantLabs/Llama3.1-70B-ShiningValiant2",
+  "architectures": [
+    "LlamaForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 128000,
+  "eos_token_id": [
+    128001,
+    128008,
+    128009
+  ],
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 8192,
+  "initializer_range": 0.02,
+  "intermediate_size": 28672,
+  "max_position_embeddings": 131072,
+  "mlp_bias": false,
+  "model_type": "llama",
+  "num_attention_heads": 64,
+  "num_hidden_layers": 80,
+  "num_key_value_heads": 8,
+  "pretraining_tp": 1,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": {
+    "factor": 8.0,
+    "high_freq_factor": 4.0,
+    "low_freq_factor": 1.0,
+    "original_max_position_embeddings": 8192,
+    "rope_type": "llama3"
+  },
+  "rope_theta": 500000.0,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.46.0",
+  "use_cache": true,
+  "vocab_size": 128256
+}

generation_config.json

@@ -0,0 +1,12 @@
+{
+  "bos_token_id": 128000,
+  "do_sample": true,
+  "eos_token_id": [
+    128001,
+    128008,
+    128009
+  ],
+  "temperature": 0.6,
+  "top_p": 0.9,
+  "transformers_version": "4.46.0"
+}

model-00001-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62d7ac7fbec6c389a4c2421c100f964dc4ce4620bdc0d61f3ba09d26f1a1cad4
+size 4806672984

model-00002-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62219709fdfb3ccf054e80c66d86f40e319bd2a227c5e08cfcdee7a02a2e3464
+size 4362142864

model-00003-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d90b30df2d292f2ee7c75631d3fb224254f649f89140695ed4e1dd3bd912ff4
+size 4362142864

model-00004-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21a1cdd173478c8c972023108ee409779521a5dc66ea28ea4816e373a4e8975e
+size 4966188864

model-00005-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:74f41e519a4b67042eb54f2b43b3a580effbf2dc27a42aac258ed89629eac003
+size 4362142864

model-00006-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7dec160e18ac7fbf16b20c584e4e32d8d9b6f73f135f4133ed22bc624c6e3511
+size 4362142864

model-00007-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d7682c7977f134b5c008038eee4b8c8425ece0bc67ec91920e07db5b049d343
+size 4966188864

model-00008-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:31fa50e6f997962ff2ba6e7748f7a2ede80cfc2f109ff7c3f595124a346dfa48
+size 4362142864

model-00009-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d9640c83ed5043c5c0f9a7eae5cddcd881da26e2773a26786461078eba8be7dc
+size 4362142880

model-00010-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d2b5bf4cbf8352c8feb749d76cd36be7fb31b4336af5dd8fc5a4586effffcdad
+size 4966188880

model-00011-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb88c91125d09985c32fffb5255b443ccadf8571eb3964bf519b7c72b337e066
+size 4362142872

model-00012-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4762ed97f1ac22c2b42bb5e664a9e19561d36602f2da43aad5c37402aef898f6
+size 4362142872

model-00013-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8377db6272499042e2753f6635fb5ccd5fbbf9f2741df58da111665ac709f294
+size 4966188880

model-00014-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:caec92a038759fc4ebbc79a7dfebe4417993d07dac3433f94bbda58e0e8cc487
+size 4362142872

model-00015-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:699ed1e6786c57eb23ed8c60123872a80e33fa43bb5f117dd6055d387d5c2598
+size 4362142872

model-00016-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c0b6b3520872b73ddd652e787091881db6aa43e53bd1b0d3d7135f937418722
+size 4966188880

model-00017-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:81481aae7008c55a081169cbbf9c23dd3dafd31c5cb8399e31da99c31602c783
+size 4362142872

model-00018-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:674a079cf904c831cc3216142bdeb116173bfce26deacb06ffa42557703e8cf6
+size 4362142872

model-00019-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b8c888e615b6cc7f041bbc9008812a5015fde8dbd6a7c6ba42980b9d8b3ecf3
+size 4966188880

model-00020-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c1e9e024fb2b1a666e98ed2ccf99d59184c5f7ce5793017549cfdd09d0d755f
+size 4362142872

model-00021-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cdec8eebc18f8a1467438e60adaeca6337aafe0e2b82fba90861c6beede3456e
+size 4362142872

model-00022-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8e0874fa8bd676424eedf3f2c4216c5efbb8c6fe7beb9c35d46ae6dc8c8a7644
+size 4966188880

model-00023-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb3d6ee22d8bfd1ba4bb61fba33b11ae78ff090ee7705f8c6d94769bcd90bcb1
+size 4362142872

model-00024-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:faa67aeeed6fc0b7037d2512d9ed4244f06bf67a4380aa1ea18f560eff607295
+size 4362142872

model-00025-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad7fd2bfff4b90dac9290d2c90558ba67cebc57daecb11822e3dae43aa529dbf
+size 4966188880

model-00026-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b4dd142fdf2d2165d1a3ff7d6d091ee927b40338dd42a65bc3902382f75ac4a
+size 4362142872

model-00027-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c18064d4fef014339c04d514fe66a080df55021c726300d7796899a2945aca11
+size 4362142872

model-00028-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d63125a04bdce001fe195239494b3482396e8552fdc6eafecea34273dbb2f1f8
+size 4966188880

model-00029-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83255716cf1f5fdc97571d0d3d3a0971a1d75dc1dd910130357556a7de0b1443
+size 4362142872

model-00030-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:90fb021c2d954a8368533f0f824e17915f5fdfcba95485926d84a2b35bb03c9b
+size 4362142872

model-00031-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4137c9100f2ce04e9abece217b6692d78cf4c7195cbf9f397a99d21a1f3c2b76
+size 4966188880

model-00032-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1bea25b32856ffb6e581e9d3928b624797f58842493da7d2190c7ed350ff28b
+size 4362142872

model-00033-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21676e2895f94fecaa4f4bc040468d4420c9f1f717661443ca4b54d4a6c2906d
+size 4362142872

model-00034-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c988d4ed904b31c1086ce8738d9a682e74af96adc0359f3de0163d288ca12941
+size 4966188880

model-00035-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b51dc66da98df1a13348773db3dc79b818be751ef4cc673c3099a4bc78fe1f7d
+size 4362142872

model-00036-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:da8520786989ce04e206a697ca8b0726329ea52790fbc0b56f0f4ef9b1a5228c
+size 4362142872

model-00037-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b623630c0b085fbcb58375c8912bc33023ed5fc0d197023f67630b212ea0c7f
+size 4966188880

model-00038-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6489c54f2daf557429c9ff88dee07f7aa32fdd184e34ae6d4edea0312ce78180
+size 4362142872

model-00039-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0f11dd0f2cc5d585250ac8cd9475350f1baa0c0ddbfa57fa7762234daab7b25d
+size 4362142872

model-00040-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d748eb8877a1d7f8792b21596d1b48ce93e72a2e5f74ccf729b1b9647ba79ca
+size 4966188880

model-00041-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f19ae562f9d1f71263c7186528ac470846bf3236aa8b08d14785c32a0e3c7fa8
+size 4362142872

model-00042-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f73ab985a5fd27dbb18d2ec652ca797629f249e15dbdbd1f6dcb2cd84113ba2
+size 4362142872

model-00043-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2fd5a584f09d47df69ffb1e3e6846a3b3c403653a2fd1c92409a60de09ec6fb3
+size 4966188880

model-00044-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4544d38d788203560dadf888b0b9fbdea5b1cb890e53e10085f9580a005860a5
+size 4362142872

model-00045-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a354576518bbafc8f386f4ba2a64b92336b07d7a5e4763d4652acbab6c2f518
+size 4362142872

model-00046-of-00062.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f64928da63f67f836d771fa73f726b24097f04585c3d05ed16d0e4bed5ac93dd
+size 4966188880