bapatra philschmid HF staff commited on
Commit
1adb635
1 Parent(s): abd8229

Add attention_bias to make TGI work (#3)

Browse files

- Add attention_bias to make TGI work (6ab525ada4d8179f985ccb41e2ab7ace5d0496c1)
- Update config.json (0eeef57477fab26450a599d02ee859d2dd00715e)


Co-authored-by: Philipp Schmid <[email protected]>

Files changed (1) hide show
  1. config.json +1 -0
config.json CHANGED
@@ -43,5 +43,6 @@
43
  "torch_dtype": "bfloat16",
44
  "transformers_version": "4.38.1",
45
  "use_cache": true,
 
46
  "vocab_size": 100352
47
  }
 
43
  "torch_dtype": "bfloat16",
44
  "transformers_version": "4.38.1",
45
  "use_cache": true,
46
+ "attention_bias": false,
47
  "vocab_size": 100352
48
  }