---
library_name: transformers
base_model:
- FacebookAI/roberta-base
---

# Longformer 8192

<!-- Provide a quick summary of what the model is/does. -->
Longformer model with 8192 tokens sequence length. Initialized from [FaceboookAI/roberta-base](https://huggingface.co/FacebookAI/roberta-base). No additional pre-training has been done.

Model can be loaded and run using AutoModel and AutoTokenizer.