muhtasham

/

bert-tiny-finetuned-pile-of-law-tos

like 1

Hi,

I'm getting an "unexpected keyword argument 'rope_scaling' " error. If it matters, I'm using the oobabooga webui.

The full relevant error:

14:53:48-941535 INFO Loading muhtasham_bert-tiny-finetuned-pile-of-law-tos
14:53:48-989909 ERROR Failed to load the model.
Traceback (most recent call last):
File "/Users/[USERNAME]/Downloads/text-generation-webui-main/modules/ui_model_menu.py", line 220, in load_model_wrapper
shared.model, shared.tokenizer = load_model(selected_model, loader)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/[USERNAME]/Downloads/text-generation-webui-main/modules/models.py", line 87, in load_model
output = load_func_maploader
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/[USERNAME]/Downloads/text-generation-webui-main/modules/models.py", line 235, in huggingface_loader
model = LoaderClass.from_pretrained(path_to_model, **params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/[USERNAME]/Downloads/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 566, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/[USERNAME]/Downloads/text-generation-webui-main/installer_files/env/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3594, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: BertLMHeadModel.init() got an unexpected keyword argument 'rope_scaling'

I've ensured transformers is up to date and I have all the files downloaded to the relevant model subfolder for the webui program.

I'm at a bit of a loss -- can anyone point me in the right direction?