Join our Discord! https://discord.gg/Nbv9pQ88Xb
Works on Kobold 1.72 and Layla (iOS / Android)
BeaverAI team proudly presents
Gemmasutra Mini 2B v1 🧘
Gemma's been training for ALL of you.
A tiny RP model packing an unbelievable PUNCH. Finetuned by yours truly.
Description
Gone are the days when models below 7B were too small to give you a satisfying RP experience.
Gemmasutra Mini 2B v1 marks the beginning of a new chapter in our local LLM community.
Be it in your browser, your crappy laptop, your mid-tier phone running Layla, or your Raspberry Pi...
This lil 2B will give you a playthrough worth having.
A model for thee, a model for all!
(And yes, it is uncensored and unaligned. Enjoy!)
Links
- Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
- iMatrix (recommended / better quants): https://huggingface.co/MarsupialAI/Gemmasutra-Mini-2B-v1_iMatrix_GGUF
Usage
- For the best experience, use the Gemma Instruct template and modify it to support the
systemrole (e.g.,<start_of_turn>system) - Chat Completion works well too
- Don't use it for Math
Examples
A big thanks to @kurgan1138 for most of the logs!
SFW
4K context
NSFW NSFW NSFW NSFW NSFW
NSFW NSFW NSFW NSFW NSFW
NSFW NSFW NSFW NSFW NSFW
Forgiveness Meter
Group Character
- Downloads last month
- 7,656