Csaba Kecskemeti PRO

csabakecskemeti

None yet

updated a model about 2 hours ago

liked a model about 4 hours ago

updated a model about 4 hours ago

Post

294

Managed to run the Q2 quantized Deepseek V3 base locally
The quants are uploading (probably ~10-12hrs) here: DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF

Post

463

Just wondering why the number of parameters changed in the model attributes/Model size from 685B to 684B after converting deepseek-ai/DeepSeek-V3-Base from FP8 to BF16:
DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16
and not just for me:
opensourcerelease/DeepSeek-V3-Base-bf16

??

None public yet