Retrieving logprobs from prompt
#23
by
Pwicke
- opened
Hi,
I was wondering what steps need to be undertaken to retrieve the logprobs for the generated output? I've tried using the compute_transition_scores function, but I cannot obtain the logprobs for each token of the generation. Thus far, I have only been able to retrieve the logprobs using a Tokenizer, not a Processor.
Could you provide some help?