compatibilty

#8
by nauman483 - opened

can we use this onnx model with langchain if yes then anyone tell me how to load i have used onnx_runtime_genai but failed if we cant use onnx model with langchain please tell me and and can we train this model like with pdf embedding question answers ..

Microsoft org
edited Jun 4

These published models are intended to work with ONNX Runtime GenAI and Hugging Face's Optimum. You can finetune the PyTorch model for your scenario with ONNX Runtime Training or another tool and then convert your finetuned model to a final ONNX model using ONNX Runtime GenAI's model builder.

Can response in spanish?

Microsoft org

Phi-3 mini was predominantly trained and optimized for English. Its capabilities in other languages are limited, meaning it could understand but will not be as fluent as English. Customers are encouraged to use the Microsoft Translator service in tandem to translate prompts and responses for best results.

okay thankyou for your responce but my question was different

Microsoft org

This response is in reply to the other question.

The response to your question is here. In summary, the two verified ways to run the models are with ONNX Runtime GenAI and Hugging Face's Optimum. LangChain is not officially supported for the ONNX models but there may be third-party solutions that you can try to use to run the ONNX models with LangChain. You can train Phi-3 mini with ONNX Runtime Training for your tasks.

kvaishnavi changed discussion status to closed

Sign up or log in to comment