fast tokenizer and stream_chat fix
#5
by
x54-729
- opened
No description provided.
The consistency of fast and slow was tested. Also tested saving fast tokenizer, the chatml special tokens are saved correctly. Looks good to me.
Approve.
RangiLyu
changed pull request status to
merged