Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference

Add eos_token_id to generation config

#65
by udhavsethi - opened
Files changed (1) hide show
  1. generation_config.json +1 -0
generation_config.json CHANGED
@@ -1,5 +1,6 @@
1
  {
2
  "_from_model_config": true,
3
  "transformers_version": "4.28.1",
 
4
  "use_cache": false
5
  }
 
1
  {
2
  "_from_model_config": true,
3
  "transformers_version": "4.28.1",
4
+ "eos_token_id": 0,
5
  "use_cache": false
6
  }