The perfect organism.
An adapter for KnutJaegersberg/Yi-34B-Llamafied. 5 epochs with NEFTune. The brand new bitsandbytes 4-bit file format.
Run pip install -U bitsandbytes and install this pull requested transformer version: https://github.com/poedator/transformers/tree/save4
Might still be buggy. It was a bit too early. I'll wait until the functionality is officially supported, due to some cuda issues. I don't want to resolve those, I'll just wait a couple of days.
Prompt Example:
### System:
You are an AI assistant. User will give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.
### Instruction:
How do you fine tune a large language model?
### Response:
- Downloads last month
- 11
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.