ValueError: Attention bias and Query/Key/Value should be on the same device
#18
by
JesusCrist
- opened
Model file exist some bugs that will occur in specified device。
reproduction：
model = SentenceTransformer(args.model, trust_remote_code=True,device=f"cuda:1")
doc_embeddings = model.encode(docs)
I am facing same issue, were you able to resolve it?
I am facing same issue, were you able to resolve it?
already make a pr，just update your code.
JesusCrist
changed discussion status to
closed