GGUF quants available here
#11
by
andrijdavid
- opened
The GGUF is available here. I had to split it due to the size. Tested using Llama.cpp
https://huggingface.co/andrijdavid/Mixtral-8x22B-v0.1-GGUF/
The GGUF is available here. I had to split it due to the size. Tested using Llama.cpp
https://huggingface.co/andrijdavid/Mixtral-8x22B-v0.1-GGUF/