Any configuration to increate max_tokens?

#113
by jietian1 - opened

I see there is an information:

Error: Input validation error: `inputs` tokens + `max_new_tokens` must be <= 1512. Given: 733 `inputs` tokens and 1024 `max_new_tokens`

but is there any way to increase max tokens from 1512 to a bigger number?

Sign up or log in to comment