ThomasSimonini
/

Moondream2-streaming

Image-Text-to-Text

text-generation

Inference Endpoints

Model card Files Files and versions Community

ThomasSimonini HF staff commited on Jul 30

Commit

ab91894

•

1 Parent(s): c7b5560

Upload moondream.py

Files changed (1) hide show

moondream.py +1 -1

moondream.py CHANGED Viewed

@@ -266,7 +266,7 @@ class Moondream(PreTrainedModel):
         with torch.no_grad():
             inputs_embeds = self.input_embeds(prompt, image_embeds, tokenizer)
-            streamer = TextIteratorStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)
             # Start generation in a separate thread
             thread = Thread(target=self.text_model.generate, kwargs={

         with torch.no_grad():
             inputs_embeds = self.input_embeds(prompt, image_embeds, tokenizer)
+            streamer = TextIteratorStreamer(tokenizer)
             # Start generation in a separate thread
             thread = Thread(target=self.text_model.generate, kwargs={