OSError, is the config correct?
#1
by
jackinthebox52
- opened
OSError: neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic does not appear to have a file named model-00001-of-00030.safetensors. Checkout 'https://huggingface.co/neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic/tree/main' for available files.
When trying to load using Transformers Version: 4.43.3
Sorry, that was a mistake in a recent patch - fixing now.
Should be fixed now, can you try again?
mgoin
changed discussion status to
closed