Compared with the original model, the quality of Chinese has dropped significantly (same Q8_0 quantification).

by riceballl - opened May 1

May 1

eg,

<|system|>
You are a helpful AI assistant.<|end|>
<|user|>
从科学的角度解释为啥天是蓝色的?<|end|>
<|assistant|>

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment