README.md

metadata

base_model: []
library_name: transformers
tags:
  - mergekit
  - peft

Untitled LoRA Model (1)

This is a LoRA extracted from a language model. It was extracted using mergekit.

LoRA Details

This LoRA adapter was extracted from /workspace/models/teknium_OpenHermes-2.5-Mistral-7B/ and uses /workspace/models/thomasgauthier_Mistral-7B-v0.1-zeroed_out-ChatML-base/ as a base.

Parameters

The following command was used to extract this LoRA adapter:

mergekit-extract-lora /workspace/models/thomasgauthier_Mistral-7B-v0.1-zeroed_out-ChatML-base/ /workspace/models/teknium_OpenHermes-2.5-Mistral-7B/ OUTPUT_PATH --rank=256 --device=cuda:0