fix google t5 link
Browse files
README.md
CHANGED
@@ -6,7 +6,7 @@ language:
|
|
6 |
---
|
7 |
|
8 |
An 11B T5 model trained on the [P3](https://huggingface.co/datasets/bigscience/P3) (T0 split) dataset for 20,000 steps with a batch size of 2048 a maximum input sequence length of 1024, a maximum output sequence length of 256, and the Adafactor optimizer with a constant learning rate of 0.001.
|
9 |
-
The model is trained from the [T5 v1.1 lm-adapt checkpoint](https://huggingface.co/google/t5-
|
10 |
|
11 |
For more details, see [HINT: Hypernetwork Instruction Tuning for Efficient Zero- & Few-Shot Generalisation](https://arxiv.org/abs/2212.10315).
|
12 |
|
|
|
6 |
---
|
7 |
|
8 |
An 11B T5 model trained on the [P3](https://huggingface.co/datasets/bigscience/P3) (T0 split) dataset for 20,000 steps with a batch size of 2048 a maximum input sequence length of 1024, a maximum output sequence length of 256, and the Adafactor optimizer with a constant learning rate of 0.001.
|
9 |
+
The model is trained from the [T5 v1.1 lm-adapt checkpoint](https://huggingface.co/google/t5-xxl-lm-adapt) and fully finetuned.
|
10 |
|
11 |
For more details, see [HINT: Hypernetwork Instruction Tuning for Efficient Zero- & Few-Shot Generalisation](https://arxiv.org/abs/2212.10315).
|
12 |
|