---
license: apache-2.0
license_link: https://huggingface.co/pipihand01/QwQ-32B-Preview-abliterated-linear75/blob/main/LICENSE
language:
  - en
base_model:
- Qwen/QwQ-32B-Preview
- huihui-ai/QwQ-32B-Preview-abliterated
tags:
- chat
- abliterated
- uncensored
- mergekit
- merge
library_name: transformers
---
This is a 75% abliterated model obtained from linear-weighted merging [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview) (weight: 0.25) and [huihui-ai/QwQ-32B-Preview-abliterated](https://huggingface.co/huihui-ai/QwQ-32B-Preview-abliterated) (weight: 0.75), using [mergekit](https://github.com/arcee-ai/mergekit).

This is an experimental model, and from my preliminary experiments, this gives more natural result than Qwen's original model for sensitive contents while still maintaining some refusal capability.

Unlike the full abliterated version, "censorship" may not be fully removed, but the refusal looks more natural.

You may avoid using original prompting format and avoid any assistant-like description to get further human-like results.

I also offer other percentages of abliteration so you can try which one best suits your use case.

Or you may use [this LoRA](https://huggingface.co/pipihand01/QwQ-32B-Preview-abliterated-lora-rank32) if you know how to apply LoRA and adjust its weight for the app you use.

**NOTE: I bear no responsibility for any output of this model. When properly prompted, this model may generate contents that are not suitable in some situations. Use it with your own caution.**

---
# pipihand01/QwQ-32B-Preview-abliterated-linear75

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [linear](https://arxiv.org/abs/2203.05482) merge method.

### Models Merged

The following models were included in the merge:
* [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview)
* [huihui-ai/QwQ-32B-Preview-abliterated](https://huggingface.co/huihui-ai/QwQ-32B-Preview-abliterated)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: Qwen/QwQ-32B-Preview
    parameters:
      weight: 0.25
  - model: huihui-ai/QwQ-32B-Preview-abliterated
    parameters:
      weight: 0.75
merge_method: linear
dtype: bfloat16
```