region:us
---
# For reference on model card metadata, see the spec: https://github.com/huggingface/hub-docs/blob/main/datasetcard.md?plain=1
# Doc / guide: https://huggingface.co/docs/hub/datasets-cards
{}
---

# Dataset Card for SlimPajama-6B-embedded

This is a copy of [DKYoon/SlimPajama-6B](https://huggingface.co/datasets/DKYoon/SlimPajama-6B), together with embeddings generated by [thenlper/gte-large](https://huggingface.co/thenlper/gte-large). 
There are 5.49 million examples of text, a representative random sample of [SlimPajama-627B](https://huggingface.co/datasets/cerebras/SlimPajama-627B). Each text is associated with a 1024-dimensional embedding vector that is meant to represent the semantic content. The vectors were generated by average-pooling (max-pooling dataset to come in the future).

This dataset is intended to help with downstream tasks such as reverse-embeddings, interpreting embedding spaces and creating adapters between embeddings models.