Multi GPU Setup

#52
by Ayush8120 - opened

Can I inference this using multi GPU setup ? Also, can we expect Mistral support on lmsys soon?

maybe cc @zhisbug @lmzheng @DachengLi from Lmsys

@Ayush8120 It is available now at https://chat.lmsys.org/?single under both the single model tab and arena tab.
It is also supported by our https://github.com/lm-sys/FastChat with multi-GPU support.

Ayush8120 changed discussion status to closed

Sign up or log in to comment