Works well on a 3090 ! Insane good !
#11
by
goldrushgames
- opened
Wow this is really a lot like ChatGPT or Claude, miiiiiles ahead of the 7b or 13b models!
It worked fine and is fast on a RTX 3090 / windows
I did have to increase my pagefiles to 100 GB
did you stress test it?