csujeong's picture
Training in progress, step 10
f648b93
raw
history blame contribute delete
233 Bytes
You're using a PreTrainedTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.