zhenggq lucianodelcorro commited on
Commit
60e31e6
1 Parent(s): 07bbfb8

Update README.md (#7)

Browse files

- Update README.md (70ae9f3de7ea34b7af152415977c9eece00410d7)


Co-authored-by: Luciano Del Corro <[email protected]>

Files changed (1) hide show
  1. README.md +8 -4
README.md CHANGED
@@ -13,11 +13,15 @@ license_link: LICENSE
13
 
14
  <!-- Provide a quick summary of what the model is/does. -->
15
 
16
- Orca 2 is a helpful assistant that is built for research purposes only and provides a single turn response
17
- in tasks such as reasoning over user given data, reading comprehension, math problem solving and text summarization.
18
- The model is designed to excel particularly in reasoning.
19
 
20
- We publicly release Orca 2 to encourage further research on the development, evaluation, and alignment of smaller LMs.
 
 
 
 
 
 
21
 
22
  ## What is Orca 2’s intended use(s)?
23
 
 
13
 
14
  <!-- Provide a quick summary of what the model is/does. -->
15
 
16
+ Orca 2 is built for research purposes only and provides a single turn response in tasks such as reasoning over user given data, reading comprehension, math problem solving and text summarization. The model is designed to excel particularly in reasoning.
 
 
17
 
18
+ Note that:
19
+
20
+ 1. This is a research model, intended to show that we can use capable models and complex workflows (advanced prompts, multiple calls) to create synthetic data that can teach Small Language Models (SLMs) new capabilities. We chose reasoning because it is a widely useful capability that SLMs lack.
21
+ 2. The model is not optimized for chat and has not been trained with RLHF or DPO. It is best used after being finetuned for chat or for a specific task.
22
+ 3. Beyond reasoning, the model inherits capabilities and limitations of its base (LLAMA-2 base). We have already seen that the benefits of the Orca training can be applied to other base model too.
23
+
24
+ We make Orca 2's weights publicly available to support further research on the development, evaluation, and alignment of SLMs.
25
 
26
  ## What is Orca 2’s intended use(s)?
27