Please add the following model to the neuron cache
GGUF models are not supported on Inferentia.
· Sign up or log in to comment