ValueError: Attention bias and Query/Key/Value should be on the same device
#18
by
JesusCrist
- opened
Model file exist some bugs that will occur in specified device。
reproduction：
model = SentenceTransformer(args.model, trust_remote_code=True,device=f"cuda:1")
doc_embeddings = model.encode(docs)