rwkv-5-world-7b / tokenization_rwkv_world.py

Commit History

Update tokenization_rwkv_world.py
f2ca022
verified

SmerkyG commited on

change padding token to newline (id=11)
49f029b
verified

SmerkyG commited on