File size: 651 Bytes
3058d26
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
---
license: apache-2.0
---

Self trained microscopic Mamba. Around 2.1G parameters.

The tokenizer is the one from https://huggingface.co/state-spaces/mamba-2.8b-hf.

It is being trained on around 400B tokens and this is step 1.0k.

The evaluation is being conducted now.


## License

This model is available under the Apache 2.0 License. 


## Discord Server

Join our Discord server [here](https://discord.gg/xhcBDEM3).


## Feeling Generous? 😊

Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: [https://ko-fi.com/drnicefellow](https://ko-fi.com/drnicefellow). Please add a note on which one you want me to drink?