Saraansh Tandon

Satandon1999's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in microsoft/Phi-3-small-128k-instruct about 2 months ago

Out of resource: shared memory

6

#16 opened 6 months ago by iszhaoxin

New activity in microsoft/Phi-3-mini-4k-instruct-onnx 4 months ago

A lot of <unk> generations in the cuda int 4 model.

1

#12 opened 4 months ago by Satandon1999

New activity in microsoft/Phi-3-small-128k-instruct 5 months ago

Slower generation with multi-batch size.

#26 opened 5 months ago by Satandon1999

Model not working with accelerate for inference.

1

#25 opened 5 months ago by Satandon1999

Fix for FlashAttention RuntimeError & Triton Multi GPU fix.

1

#17 opened 6 months ago by Satandon1999

Multi-GPU case device mismatch while finetuning.

3

#19 opened 5 months ago by Satandon1999

New activity in microsoft/Phi-3-small-128k-instruct 6 months ago

RuntimeError: FlashAttention only support fp16 and bf16 data type

1

#15 opened 6 months ago by Satandon1999