although gguf is great, transformers is more universal and easier to convert into other formats
We plan to release transformer version soon, and have forward propogation implementation shared to community
· Sign up or log in to comment
