Fill in the middle
#2
by
bskesse
- opened
How do we do fill in the middle?
Have you tried the example here https://github.com/mistralai/mistral-inference?tab=readme-ov-file#python
FWIW, the example uses codestral.
Hi there, Mamba Codestral does not support FIM, only Instruct
@pandora-s Can you please elaborate on this? The example shows an FIM scenario, but is it not recommended to use OOB Mamba Codestral in an FIM setting?
@Kartik305 The example uses Codestral 22B that has FIM support, Mamba Codestral 7B only has Instruct support and not FIM. I hope this answers!
@pandora-s Thanks for answering. I was inspecting using it as a code completion assistant, but without having FIM, might have to switch to the larger 22B model.