AtakanTekparmak commited on
Commit
c80b6bf
·
verified ·
1 Parent(s): 9ee3ce4

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. .gitattributes +2 -0
  2. README.md +28 -0
  3. gemma-2-9b-f16.gguf +3 -0
  4. gemma-2-9b-q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gemma-2-9b-f16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ gemma-2-9b-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: gemma
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ extra_gated_heading: Access Gemma on Hugging Face
6
+ extra_gated_prompt: >-
7
+ To access Gemma on Hugging Face, you’re required to review and agree to
8
+ Google’s usage license. To do this, please ensure you’re logged in to Hugging
9
+ Face and click below. Requests are processed immediately.
10
+ extra_gated_button_content: Acknowledge license
11
+ tags:
12
+ - conversational
13
+ quantized_by: AtakanTekparmak
14
+ ---
15
+
16
+ ## gemma-2-9b GGUF
17
+
18
+ Llama.cpp version <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3259">b3259</a> was used for hf to gguf conversion.
19
+
20
+ Original model: https://huggingface.co/google/gemma-2-9b
21
+
22
+ Available Precisions:
23
+ - fp16
24
+ - q8_0
25
+
26
+ ## License
27
+
28
+ [Gemma Terms of Use](https://www.kaggle.com/models/google/gemma/license/consent?verifyToken=CfDJ8GYiNaMVVSVCnegdIdgHCPNs7G2XBpoXihxv2r9_tiHG8yBpLIS5MxFnNQ7_383D4mLGj6dON1dNpVka6uBRl4CI4AnANO_EC7WBtsHqcwNRa-74ScR_Z7jdnObpRuRcOZTUEXiGDu3Fcf1YiAWUEpSFio6htkpio-0Iye9evEIaGPnPLEpSmyFzShl8pk_IYbVZ3yfaX-3eM7bzy4HAuw) applies the same as the original model.
gemma-2-9b-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08d41a517a2b02938db9e07b4ddc1af7fa3d774e0b171a9de3c7a14b35a8bfab
3
+ size 18490680224
gemma-2-9b-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5eed42b150bc2b1cc414ed5297bfc7f21ba95a4ab6fba1e470f068a69df0b8b
3
+ size 9827148704