Hosting Mistral 7B API

#69
by wahab12 - opened

Hello everyone,

I want to host a flask API which has an endpoint that uses the Mistral 7B model. I want to host this app somewhere. Please tell me the best hosting provider for this app? I would like to have some gpu power as well for better response

Thank you

Hello everyone,

I want to host a flask API which has an endpoint that uses the Mistral 7B model. I want to host this app somewhere. Please tell me the best hosting provider for this app? I would like to have some gpu power as well for better response

Thank you

Did you find any?

You can use runpod.io, or other similarly service. If you dont use model 24/7 use serverless part of runpod.

Sign up or log in to comment