Matryoshka question training and inference

#2
by aari1995 - opened

Hi there! Really cool model! I have a question though. Does it support matryoshka embeddings? For inference, how? And was it considered in training the Colbert part? I think it was considered in the embed model.

Thank you!

Mixedbread org

Hey, it's a "normal" colbert model. So no tricks for reducing memory footprint.

aamirshakir changed discussion status to closed

Sign up or log in to comment