How to process more than 1 input at a time?

#10
by calistatan03 - opened

Hey! This is a great model, love it. I would like to ask how I may be able to make only 1 call to the model but get it to return predictions for more than 1 text chunk at a time. Right now the code that has been given only supports one prediction at a time, which can be very slow if one has many text chunks to process.

Sign up or log in to comment