about trocr retrained model onnx conversion

#2
by sainithish - opened

how to convert my fine tune model to encoder.onnx , decoder.onnx? also how to quantize onnx mdoels

sainithish changed discussion title from retrained model onnx conversion to about trocr retrained model onnx conversion
Owner

You can use Optimum to convert trocr models to ONNX. Alternatively, you can use the transformers.js conversion script (here), which will do conversion and quantization in one step.

thanks and also letme know if possible, first i have tried with microsoft/trocr-small-printed model onnx conversion, inference also working nice as same as before onnx conversion, but problem with fine tune model, after onnx converted model results not good as compare with before onnx conversion.

Sign up or log in to comment