Transformers
German
Inference Endpoints
Edit model card

OPT-2.7B finetuned on OSCAR with LoRA

This model was finetuned on 80000 examples from the german subset of the oscar corpus. See the git repo for more info and exact hyperparameters.

To run this model, simply instantiate the facebook/opt-2.7b model as per usual and activate the adapter with PEFT:

from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM

model = AutoModelForCausalLM.from_pretrained("facebook/opt-2.7b")
model = PeftModel.from_pretrained(model, "bjoernp/opt2.7B-de-lora")

Refer to the OPT Documentation for more infos on how to run the model and use the processor.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Dataset used to train bjoernp/opt2.7B-de-lora