"Instruct: <prompt>\nOutput:" or "Instruction: <prompt>\nOutput:"

#60
by J22 - opened

The latter one seems better because Phi-2 likes to generate "Instruction: ...... ".

Or rather: Instruction: <prompt>\nOutput:\n.

J22 changed discussion status to closed
J22 changed discussion status to open
Microsoft org

Hello @J22 !

Thanks for providing the prompt. We will update the model card accordingly.

Regards,
Gustavo.

On a more specific use-case, I found this prompt worked when incorporating some context for RAG (Retrieval-Augmented Generation):
"Instruction: With this context\n\n{context}\n\nQuestion: {input}\nOutput:"

Where {context} is the set of excerpts and {input} is the question being asked.

Note: "Instruct" or "Instruction" worked the same.

On a more specific use-case, I found this prompt worked when incorporating some context for RAG (Retrieval-Augmented Generation):
"Instruction: With this context\n\n{context}\n\nQuestion: {input}\nOutput:"

Where {context} is the set of excerpts and {input} is the question being asked.

Note: "Instruct" or "Instruction" worked the same.

This works like a charm. TYSM. I thought I have to fine-tune it.

Glad it helped ardinursyamsu!

Sign up or log in to comment