"Instruct: <prompt>\nOutput:" or "Instruction: <prompt>\nOutput:"
The latter one seems better because Phi-2 likes to generate "Instruction: ...... ".
Or rather: Instruction: <prompt>\nOutput:\n
.
On a more specific use-case, I found this prompt worked when incorporating some context for RAG (Retrieval-Augmented Generation):
"Instruction: With this context\n\n{context}\n\nQuestion: {input}\nOutput:"
Where {context} is the set of excerpts and {input} is the question being asked.
Note: "Instruct" or "Instruction" worked the same.
On a more specific use-case, I found this prompt worked when incorporating some context for RAG (Retrieval-Augmented Generation):
"Instruction: With this context\n\n{context}\n\nQuestion: {input}\nOutput:"Where {context} is the set of excerpts and {input} is the question being asked.
Note: "Instruct" or "Instruction" worked the same.
This works like a charm. TYSM. I thought I have to fine-tune it.
Glad it helped ardinursyamsu!