how to optimize this model to run faster on CPU?

#8
by priyank-m - opened

not able to use torch.compile with this model, also tried using onnx but did not work,
is there any way to make the inference faster on a CPU for this model?

how i can use this model with mistrails -7 b

Sign up or log in to comment