| library_name: transformers | |
| base_model: | |
| - FacebookAI/roberta-base | |
| # Longformer 8192 | |
| <!-- Provide a quick summary of what the model is/does. --> | |
| Longformer model with 8192 tokens sequence length. Initialized from [FaceboookAI/roberta-base](https://huggingface.co/FacebookAI/roberta-base). No additional pre-training has been done. | |
| Model can be loaded and run using AutoModel and AutoTokenizer. |