llemma_7b / handler.py

Commit History

adding logging + some bad words
31cf0d3

Pierce Maloney commited on

adding back truncation
eebf1ef

Pierce Maloney commited on

lowering temp to 0.7
0425154

Pierce Maloney commited on

taking out .to(cuda)
c5d86f3

Pierce Maloney commited on

back to .generate. forgot about returning gen ids
dee492f

Pierce Maloney commited on

bug + only new tokens
813fd4a

Pierce Maloney commited on

bugfix
355a0ec

Pierce Maloney commited on

pipeline trial
a36be93

Pierce Maloney commited on

torch.cuda.empty_cache()
b873ed7

Pierce Maloney commited on

taking out truncation of input_ids
8cda5e7

Pierce Maloney commited on

do_sample=True, and model.to('cuda')
b179918

Pierce Maloney commited on

truncating earliest tokens if longer than 4092
6d8b690

Pierce Maloney commited on

arg name change, Abort
4c4f932

Pierce Maloney commited on

adding periods back, adding Aborted.
d8be130

Pierce Maloney commited on

taking out . after Abort etc
4705b72

Pierce Maloney commited on

adding Ab ort . to bad words
b356a46

Pierce Maloney commited on

adding additional bad words ids
66e62c6

Pierce Maloney commited on

banning Admitted and Abort
0e224b1

Pierce Maloney commited on

banning token 13
b29c898

Pierce Maloney commited on

returning generated ids
392d92f

Pierce Maloney commited on

getting generated_ids[0]
5e35500

Pierce Maloney commited on

back to normal, removed additional bad words argument
216cf30

Pierce Maloney commited on

adding intros k v l. to bad words (for testing)
60ed7ab

Pierce Maloney commited on

using .generate, returning ids, custom bad_words
000ad8b

Pierce Maloney commited on

adding new bad word
833b301

Pierce Maloney commited on

returning ids
88fdb99

Pierce Maloney commited on

printing generated ids
2872c1c

Pierce Maloney commited on

testing .generate instead of pipeline
366e62e

Pierce Maloney commited on

testing custom logit processor for bad words
02ffbef

Pierce Maloney commited on

temp=2! top_k 40, 1 ret seq
37b54cb

Pierce Maloney commited on

num ret seqs 2
cb274aa

Pierce Maloney commited on

testing high temperature
e1040a6

Pierce Maloney commited on

adding second way of describing bad word (*
26070b4

Pierce Maloney commited on

increase temp, add top_k=20
320c7f3

Pierce Maloney commited on

XXS comment
4f7f1d5

Pierce Maloney commited on

temperature 0.7
cd860a6

Pierce Maloney commited on

only return new generated tokens, bad_words = comments
d1e4ec5

Pierce Maloney commited on

base llemma-7b and custom handler.py
bf66e5a

Pierce Maloney commited on