context length for Yi-1.5B-chat
#14
by
hbhf
- opened
what is the context length for "Yi-1.5-34B-Chat"? 4k?
For "Yi-1.5-34B-Chat-16k", I guess the context length is 16k. will there be a version of chat model for 32k context length?
Hello @hbhf our Yi-1.5-34B-Chat model is 4k, and there is also a 16k version: https://huggingface.co/collections/01-ai/yi-15-2024-05-663f3ecab5f815a3eaca7ca8 . However, our base model has a 32k version: https://huggingface.co/01-ai/Yi-1.5-34B-32K
Yes, Yi-1.5 in this repository has context length of 4096, as indicated in config.json -> max_position_embeddings.
what is the context length for "Yi-1.5-34B-Chat"? 4k?
For "Yi-1.5-34B-Chat-16k", I guess the context length is 16k. will there be a version of chat model for 32k context length?
lorinma
changed discussion status to
closed