MLX
Safetensors
dbrx
custom_code

Invalid header in file

#3
by jcluff - opened

python3.11 -m mlx_lm.generate --model dbrx-instruct-4bit --prompt "Hello" --trust-remote-code --max-tokens 500

Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "llm/mlx-examples/llms/mlx_lm/generate.py", line 148, in
main(args)
File "llm/mlx-examples/llms/mlx_lm/generate.py", line 112, in main
model, tokenizer = load(
^^^^^
File "llms/mlx_lm/utils.py", line 381, in load
model = load_model(model_path, lazy)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "llms/mlx_lm/utils.py", line 314, in load_model
weights.update(mx.load(wf))
^^^^^^^^^^^
RuntimeError: [load] Invalid header in file dbrx-instruct-4bit/model-00013-of-00014.safetensors

I am not sure how to fix this at present. Any help in solving this would be appreciated.

Sign up or log in to comment