Real word test: What is the third word you wrote? [7b q5_k_m]

#3
by boqsc - opened

Hello! How can I assist you today?
What is the third word you wrote?
The third word I wrote was "today".

OpenHermes-2-Mistral-7B produced incorrect answer.

image.png

Can't win em all, however, chatgpt 3.5turbo thinks it wrote a word it didnt even say, so I'd say that's a win:

image.png

Models do not think in words. They only think in tokens.

Sign up or log in to comment