This is a fan made HQQ version of M4-ai's NeuralReyna-Mini-1.8b-v0.3, many thanks to the team especially Locutusque and aloobun.
This model repo has python code to run inference on HQQ models.
- Downloads last month
- 6
Inference API (serverless) is not available, repository is disabled.