Creation steps / conversion differences to transformers.js

by do-me - opened Aug 30, 2023

Aug 30, 2023

Thanks a lot for the fork!
Could you provide the steps/scripts how to create this transformers.js compatible onnx version? I'd like to apply them myself to other models.

For anyone wondering why the gte and e5 model families don't work out of the box, @Xenova explained the problem here (and here).

ggrn

Supabase org Aug 30, 2023

Hey @do-me , Xenova has some great docs on how to convert models to ONNX here:
https://huggingface.co/docs/transformers.js/custom_usage#convert-your-models-to-onnx

do-me

Aug 31, 2023

Thanks @ggrn - I was aware of the scripts, I just got confused when testing some models with transformers.js. I thought I encountered an error with Xenova's gte-small version, found yours to be working and was wondering what you did differently - but that's not the case, they are both working. Instead, there's only an issue with multilingual-e5-* models as mentioned in the GitHub issue.

do-me changed discussion status to closed Aug 31, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment