How do I use onnx model?

#6
by erickdp - opened

Thank you for the contribution. I have a problem when using the quantized model, I load it using pipeline but it generates an error like this, do you know how to solve it?

Screenshot from 2024-03-18 15-43-26.png

I solved it by:

tokenizer.model_input_names = ['input_ids', 'attention_mask']

erickdp changed discussion status to closed

Sign up or log in to comment