ksyang commited on
Commit
9a5e541
1 Parent(s): 048b677

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -2,4 +2,19 @@
2
  license: apache-2.0
3
  ---
4
 
5
- This repository will serve the same model with [llamion-14b-chat](https://huggingface.co/vaiv/llamion-14b-chat).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  ---
4
 
5
+ # **GeM2-Llamion-14B**
6
+
7
+ We have released **Llamion** as **GeM 2.0**, the second series of generative models developed by VAIV Company to address the our principal business needs.
8
+
9
+ **Llamion** (Llamafied Orion) is derived from transforming the [Orion model](https://huggingface.co/OrionStarAI/Orion-14B-Chat)
10
+ into [the standard LLaMA architecture](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py)
11
+ through parameter mapping and offline distillation. More details will be available in our upcoming paper, which will be accessible on this page.
12
+
13
+ <!-- Note that this model has NOT been contaminated to artificially inflate its scores for the Open LLM Leaderboards,
14
+ unlike some recent models which have been intentionally tainted. -->
15
+
16
+ ![vaiv_png](./vaiv.png)
17
+
18
+ ### Contributors
19
+
20
+ - VAIV Company AI Lab ([vaiv.kr](https://www.vaiv.kr/))