Harsha Vardhan Khurdula

HV-Khurdula's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in meta-llama/Llama-3.2-1B 19 days ago

[Query-ISSUE] tokenizer.vocab_size is 128000, however len(tokenizer) is 128256, which prevents me from using those other tokens.

1

#34 opened 19 days ago by HV-Khurdula