IlyaGusev
/

saiga_30b_lora

Text Generation

Model card Files Files and versions Community

IlyaGusev commited on Apr 26, 2023

Commit

c896ba3

•

1 Parent(s): d3787c7

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -92,6 +92,8 @@ model = PeftModel.from_pretrained(
     MODEL_NAME,
     torch_dtype=torch.float16
 )
 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)
 generation_config = GenerationConfig.from_pretrained(MODEL_NAME)
 print(generation_config)

     MODEL_NAME,
     torch_dtype=torch.float16
 )
+model.eval()
 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)
 generation_config = GenerationConfig.from_pretrained(MODEL_NAME)
 print(generation_config)