Issue with Phi-3 Mini 4K Instruct Response Format
#93
by
adameda
- opened
I'm experiencing an issue with the Phi-3 Mini 4K Instruct model. The responses I get include the prompt and input along with the answer, resulting in unnecessarily long outputs. Even when I specify in the prompt that I only want the answer, the problem persists.
I’m not sure if this is an inherent behavior or if there's a way to adjust the model to provide only the answer. Does anyone have any insights or suggestions on how to address this?
@adameda
Thank you for your interest in Phi models!
I would recommend you to use Phi-3.5-Mini https://huggingface.co/microsoft/Phi-3.5-mini-instruct