Can I use vLLM or other inference tools to accelerate the model?
#2
by
Labmem009
- opened
Or do you have any plan to support a inference tool?
Thanks a lot!
Or do you have any plan to support a inference tool?
Thanks a lot!