Minivoc
Collection
3 items
•
Updated
You need to agree to share your contact information to access this model
This repository is publicly accessible, but you have to accept the conditions to access its files and content.
This model is exclusively available to Pro subscribers of The Kaitchup. To gain access, subscribe to The Kaitchup Pro, subscribe here. If you are already a Pro subscriber, you will find your access token on this page.
Log in or Sign Up to review the conditions and access this model content.
Model Details
This is nvidia/Mistral-NeMo-Minitron-8B-Base with a vocabulary reduced to 32k entries using the Minivoc (with average embeddings) approach. The model has been created, tested, and evaluated by The Kaitchup.
All the details about the Minivoc approach and evaluation in this article: Introducing Minivoc: Faster and Memory-Efficient LLMs Through Vocabulary Reduction
- Developed by: The Kaitchup
- Language(s) (NLP): English
- Downloads last month
- 21
Inference API (serverless) is not available, repository is disabled.