TinyDialog-1.1B / README.md
Zeger56644's picture
Update README.md
f942592 verified
metadata
license: cc-by-4.0
datasets:
  - allenai/soda
language:
  - en
base_model:
  - TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
library_name: transformers

Model Card for TinyDialog-1.1B

Model Details

Basic Information

  • Model Name: TinyDialog-1.1B
  • Model Type: Language Model optimized for dialog
  • Version: 1.1B
  • Base Model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
  • Training Data: allenai/soda
  • Language(s): English

Limitations

  • Limited to English language only
  • No unicode support, all text will be normalized to lowercase
  • May not perform as well on non-dialog tasks

Prompt Format

The model uses the following prompt template:

<|begin_of_text_id|><|start_header_id|>Name of person1<|end_header_id|>Sentence 1.<|end_of_sentence_id|><|end_of_message_id|><|start_header_id|>Name of person2<|end_header_id|>Sentence 2.<|end_of_sentence_id|>Sentence 3.<|end_of_sentence_id|><|end_of_message_id|>