Unable to get the model to work

#1
by jordimas - opened

Hello

Using the standard HuggingFace inference code, see:

https://github.com/jordimas/calaix-de-sastre/tree/master/whisper-medusa

OpenIA base model produces "[' My name is Andy Dessler and I was born in Houston, Texas in 1964. I am a professor of atmospheric sciences at Texas A&M, where I study clouds and water vapor and how they affect our climate system.']

Howerver, whisper-medusa outputs make no sense (see below).

Is there is any change needed in the standard HuggingFace Whisper inference code to make this model work or do you need specific inference code?

Thanks. Jordi

The model produces ['ειει Kons Kons Kons Kons Kons Kons Kons Kons Kons Kons Konsειειειειει wy wy wy wy wy wy wy wy wy wy wy wy wy wy wyокококококококококококококококококококококококококококококειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειειει τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους τους destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinations destinationsειειειειειειειειει']

Hi @jordimas , please check out the example usage code here: https://github.com/aiola-lab/whisper-medusa?tab=readme-ov-file#usage

Seeing a similar issue using the code from the github:

Session always offers new reform's what education performance would you be a a about i can be good and say just about anything the legislature puts forward it it's always kind of been my opinion that a lot of times the legislature could be a a a good a in a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a

From whisper medium:

[0.00s -> 23.84s] I can be glad to say just about anything the legislature puts forward that it's always
[23.84s -> 31.52s] kind of been my opinion that a lot of times the legislature we have a state school board
[32.64s -> 39.92s] system that should be the experts in the state school system but many times the legislators

(Audio file is from a school board meeting I use as a test case)

Yes, it works when using your library. Thanks!

Sign up or log in to comment