--- base_model: Qwen/QwQ-32B-Preview license: apache-2.0 license_link: https://huggingface.co/Qwen/QwQ-32B-Preview/blob/main/LICENSE model_creator: Qwen model_name: QwQ-32B-Preview quantized_by: Second State Inc. language: - en pipeline_tag: text-generation tags: - chat --- # QwQ-32B-Preview-GGUF ## Original Model [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview) ## Run with Gaianet **Prompt template** prompt template: `chatml` **Context size** chat_ctx_size: `32000` **Run with GaiaNet** - Quick start: https://docs.gaianet.ai/node-guide/quick-start - Customize your node: https://docs.gaianet.ai/node-guide/customize *Quantized with llama.cpp b4120*