Spaces:

abxhr
/

design-project

Runtime error

App Files Files Community

design-project / test.py

abxhr's picture

Add app

34473f3 over 2 years ago

214 Bytes

	#%%
	from transformers import GPT2Tokenizer

	# %%
	tok = GPT2Tokenizer.from_pretrained("D:/ML/Models/aragpt2-medium", use_fast=False)
	# %%
	tok.pad_token = tok.eos_token
	#%%
	tok.pad_token_id = [tok.eos_token_id]
	# %%