How to remember conversation history (prior prompts and responses)

#97
by TheBacteria - opened

Like many other models, out-of-the-box mistral7b doesn't remember conversation history (prior prompts, responses etc.). What are some of the approaches (other than tracking prior prompts and responses in a global variable and adding them to each prompt) to make it remember conversation history and draw responses within that context?

you can pass things like that
messages = [
{"role": "user", "content": "Tell me about the Harry Potter"},
{"role": "system", "content": """{
"name": "Harry Potter",
"age": 33,
"fact": [
"Harry Potter is a fictional character and the titular protagonist of J.K. Rowling's series of the same name.",
"He is a wizard, famous for defeating the Dark Lord Voldemort.",
"Harry is known for his lightning bolt scar, glasses, and his wand made of holly and phoenix feather.",
"He is a Gryffindor student at Hogwarts School of Witchcraft and Wizardry.",
"Harry is also known as 'The Boy Who Lived' and 'The Chosen One'."
]
}"""},
{"role": "user", "content": "Tell me about the luffy"},
]

Sign up or log in to comment