KeyError: 'factor'
#45
by
surak
- opened
2024-09-26 12:12:09 | ERROR | stderr | File "/p/project/ccstao/cstao05/FastChat/fastchat/serve/model_worker.py", line 500, in <module>
2024-09-26 12:12:09 | ERROR | stderr | args, worker = create_model_worker()
2024-09-26 12:12:09 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^
2024-09-26 12:12:09 | ERROR | stderr | File "/p/project/ccstao/cstao05/FastChat/fastchat/serve/model_worker.py", line 471, in create_model_worker
2024-09-26 12:12:09 | ERROR | stderr | worker = ModelWorker(
2024-09-26 12:12:09 | ERROR | stderr | ^^^^^^^^^^^^
2024-09-26 12:12:09 | ERROR | stderr | File "/p/project/ccstao/cstao05/FastChat/fastchat/serve/model_worker.py", line 98, in __init__
2024-09-26 12:12:09 | ERROR | stderr | self.context_len = get_context_length(self.model.config)
2024-09-26 12:12:09 | ERROR | stderr | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-09-26 12:12:09 | ERROR | stderr | File "/p/project/ccstao/cstao05/FastChat/fastchat/utils.py", line 367, in get_context_length
2024-09-26 12:12:09 | ERROR | stderr | rope_scaling_factor = config.rope_scaling["factor"]
2024-09-26 12:12:09 | ERROR | stderr | ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
2024-09-26 12:12:09 | ERROR | stderr | KeyError: 'factor'