Context Size?
#7
by
lazyDataScientist
- opened
Is it 4K and are there plans to increase the context length?
Since this is based on llama 2 it supports 4k natively, but I use it at 8k length without issue.
Is it 4K and are there plans to increase the context length?
Since this is based on llama 2 it supports 4k natively, but I use it at 8k length without issue.