Error : Loading Model

#2
by Onkur - opened

Load model

model = AutoModel.from_pretrained(
"McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp",
trust_remote_code=True,
config=config,
torch_dtype=torch.bfloat16,
device_map="cuda" if torch.cuda.is_available() else "cpu",
)

Error:

TypeError: LoraConfig.init() got an unexpected keyword argument 'loftq_config'

I am getting this error while loading the model.

McGill NLP Group org

Which version of peft and transformers are you using?

Sign up or log in to comment