Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2-7B-Instruct-GPTQ-Int8
like
16
Follow
Qwen
8.88k
Text Generation
Transformers
Safetensors
English
qwen2
chat
conversational
text-generation-inference
Inference Endpoints
8-bit precision
gptq
arxiv:
2309.00071
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
I tried vllm and without vllm, "RuntimeError: probability tensor contains either `inf`, `nan` or element < 0 during inference with transformer" still exist!
#2
by
Zaiping
- opened
Jul 4, 2024
Discussion
Zaiping
Jul 4, 2024
rt
Phillsf
Jul 16, 2024
This comment has been hidden
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
