adriabama06
/

SmallThinker-3B-Preview-AWQ

Text Generation

4-bit precision

Model card Files Files and versions Community

AWQ 4 bit, 128 groupsize of PowerInfer/SmallThinker-3B-Preview

Warning: This model seems to not work, not at least in my computer with vLLM

Downloads last month: 22

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for adriabama06/SmallThinker-3B-Preview-AWQ

Base model

Qwen/Qwen2.5-3B

Finetuned

Qwen/Qwen2.5-3B-Instruct

Finetuned

PowerInfer/SmallThinker-3B-Preview

Quantized

(17)

this model

Datasets used to train adriabama06/SmallThinker-3B-Preview-AWQ