language:en license:cc-by-4.0 art region:us
---
license: cc-by-4.0
language:
- en
tags:
- art
---
# Model and Gallery Data in Civitai


### Dataset Summary
This Dataset includes model message and gallery data under model, like:

![](https://ik.imagekit.io/dfidfiskkxn/docs/civitai_crawl?updatedAt=1681430636533)

1. I crawl some data from [Civitai](https://civitai.com/) using Github CodeSpace and Deno, It takes me 6 hours to download it safely😄. 
2. This dataset can be use to create many interesting model like auto prompting AI or prompt improve AI.
3. This project has a github repo for code that crawl all Data. [Link](https://github.com/KonghaYao/tinyproxy/tree/main/civitai)


### Dataset
1. /index/index.jsonl: It's all Model Base Message!
2. /index/index.filter.jsonl: filtered Model!
3. /index/info.jsonl: All Gallery Post Info!

### Notice some info in dataset
1. It includes many **NSFW** prompts or image URLs you will meet in dataset
2. `jsonl file` is a file that every row is a single json, but I just use '\n' to join an array and wrote to the file, so some bug could appear.
