I am doing a project where I need to feed Bloom more than 1000 tokens. is there a paid API where I can have a higher token limit?
#95
by
rexer3000
- opened
I am doing a project where I need to feed Bloom more than 1000 tokens. is there a paid API where I can have a higher token limit?
I'm not sure. I guess not. The purpose of the current deployment is for people to manually test it and get a feeling of how BLOOM performs. cc @Narsil to confirm
I think the only thing that's left would be to spawn your own instance and run evaluation there? There's some inference codebase we use if you want to check it out https://github.com/huggingface/text-generation-inference