File size: 381 Bytes
63d9bd1
 
 
 
 
 
45015a3
28090b9
 
db95f35
 
 
1
2
3
4
5
6
7
8
9
10
11
12
---
license: apache-2.0
datasets:
- Open-Orca/FLAN
language:
- en
pipeline_tag: text2text-generation
---

T5-small distilled from T5-flan-base using OpenOrca'a FLAN dataset using Seq2seq methodology. The baseline for Seq2seq distillation on T5 decoder models. It is free under Apache License.

The distilled model is a T5-small model with 60M parameters, not a T5-flan-small model.