How do you quantitize that so quickly?

#1
by nlpguy - opened

I uploaded smolchess-v2 about an hour ago, the files say it was quantitized about an hour ago, I'm counting 12 gguf files. How do you quantitize that so quickly?

nlpguy changed discussion title from How do you quantitize that quickly? to How do you quantitize that so quickly?

Just accidental luck - I usually check randomly once per day for "interesting" models, and that was obviously just after you uploaded then. Also, the model is kind of microscopicaly small, so quantizes in seconds. It's not the norm :)

mradermacher changed discussion status to closed

Sign up or log in to comment