test on Q4

by gopi87 - opened Sep 9

gopi87

Sep 9

i did some coding test on Q4 went really well !!

parameter i used
temp 0.8
top p 0.95
min p 0.05
rpenalty 1.1
top k 40

gopi87

Sep 9

not sure if i will get same output from lama 3.1 Q4

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment