---
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- google/gemma-2b-it
library_name: transformers
---

## google/gemma-2b-it - W8A8_FP8 Compression

This is a compressed model using [llmcompressor](https://github.com/vllm-project/llm-compressor).

## Compression Configuration

- Base Model: google/gemma-2b-it
- Compression Scheme: W8A8_FP8
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Number of Samples: 512
- Preprocessor: chat
- Maximum Sequence Length: 8192

## Sample Output

#### Prompt: 

```
<bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>

```

#### Output: 

```
<bos><bos><start_of_turn>user
Who is Alan Turing?<end_of_turn>
Alan Turing was a British mathematician, computer scientist, cryptanalyst, and philosopher. He is considered one of the pioneers of computer science and artificial intelligence. Turing is best known for his contributions to cryptography, particularly in the development of the modern theory of cryptography. He also made significant contributions to the development of artificial intelligence, including the Turing test, which is a measure of a machine's ability to exhibit intelligent behavior indistinguishable from a human.

Here are some of Turing's most important contributions to computer science and artificial intelligence:

* **Cryptography:** Turing developed the modern theory of cryptography, which is the study of methods for protecting
```

## Evaluation

<TODO>