uncensored?
Is this model also uncensored? what is the context?
Yes fully uncensored, context size is the same as the Gradient 262k model. So pretty long.
What hardware is needed to run this model?
sry for the late response. Well it depends, if you want to run it in its 16 bit format it would require around `136gb of vram. But i would recommend running it in 4bit, or download one of the quants that are available, best to take the v2.1
I myself run it in 4bit, on a rtx a6000 (48gb) + 4090 (24gb) with lots of room for the large context, but i understand that is not a setup available to most. If you have to go small its best to go with a gguf quant so you can also partly spread it in the main memory.
Will there be a smaller model 9-27b? with a large context so that everyone can create, not everyone has the ability to even run 4 bits :)