Hugging Face's logo

TheDrummer
/
Gemmasutra-Mini-2B-v1-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
Gemmasutra-Mini-2B-v1-GGUF
File size: 3,353 Bytes 
fb7c2a5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1de577a
fb7c2a5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
 
---
license: other
---
# Join our Discord! https://discord.gg/Nbv9pQ88Xb

### Works on [Kobold 1.72](https://github.com/LostRuins/koboldcpp/releases/tag/v1.72)

---

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/HjVYV2h_YTL9P-insb7fz.png)

[BeaverAI](https://huggingface.co/BeaverAI) team proudly presents

# Gemmasutra Mini 2B v1 🧘

*Gemma's been training for ALL of you.*

![image/webp](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/w0Oi8TReoQNT3ljm5Wf6c.webp)

*A tiny RP model packing an unbelievable PUNCH. Finetuned by yours truly.*

## Description

Gone are the days when models below 7B were too small to give you a satisfying RP experience.

Gemmasutra Mini 2B v1 marks the beginning of a new chapter in our local LLM community.

Be it in your browser, your crappy laptop, your mid-tier phone running [Layla](https://www.layla-network.ai/), or your Raspberry Pi...

This lil 2B will give you a playthrough worth having.

A model for thee, a model for all!

*(And yes, it is uncensored and unaligned. Enjoy!)*

## Links

- Original: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1
- GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Mini-2B-v1-GGUF

## Usage

- For the best experience, use the Gemma Instruct template and modify it to support the `system` role (e.g., `<start_of_turn>system`)
- Chat Completion works well too
- Don't use it for Math

## Examples

A big thanks to @kurgan1138 for most of the logs!

### SFW

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/IstS_eSV_Z52jII1UkZ7d.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/eLU-AlpTd8VCI9H7gOmX2.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/Rnpwj1XE0CflOnOyJtJSK.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/7Y9x9A2HYoyfMkrBpBeO4.png)

#### 4K context

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/te_wnC9Tcg2BVeLrtARjr.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/oTiXmVmK7KiI26wgHmS1u.png)

### NSFW NSFW NSFW NSFW NSFW
### NSFW NSFW NSFW NSFW NSFW
### NSFW NSFW NSFW NSFW NSFW

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/J9SwuYQBULHY9Wobljv5V.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/qhCgIEAeXJqA0Msq5mAFA.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/RkgOg_mvjADiXgb5859gm.png)

#### Forgiveness Meter

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/_NnPS-kwD7ZpoWUa3wvux.png)

#### Group Character

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/TxF2YbcUwJOtcqxWSKybZ.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/CQKkSq6lXj7yKuwcoPdeQ.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/q0KFuHhh3ybz51DQze89G.png)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/Ll8CA5RR7ugTi72P2HBb8.png)