metadata
library_name: transformers
base_model:
- FacebookAI/roberta-base
Longformer 8192
Longformer model with 8192 tokens sequence length. Initialized from FaceboookAI/roberta-base. No additional pre-training has been done.
Model can be loaded and run using AutoModel and AutoTokenizer.