Mistral

#2
by mrfakename - opened

Hey,
Super cool! Are there any plans to add Mistral to the demo?
Thanks!

Yeah I would love to, but unfortunately to hold both models in memory, ~34GB of RAM are required, which requires quite a beefy machine (at least A10G large). If we are able to get a grant for that, I'll happily enable both models. Alternatively, you can clone the space and manually comment lines 36..46 in main.py.

Thanks, makes sense!

mrfakename changed discussion status to closed

Sign up or log in to comment