Is there a way to convert it in to a 1 bit LLM? and use BITnet
#40
by
infinityai
- opened
Is there a way to convert it in to a 1 bit LLM? and use Microsoft Bitnet
why would you want to use it at 1bit. that would be not useable
Be
why would you want to use it at 1bit. that would be not useable
because he wants to run the model on a PC with low or modest resources..
Be
why would you want to use it at 1bit. that would be not useable
because he wants to run the model on a PC with low or modest resources..
but it would be more inaccurate, making phi3 a better option.
at 1bit it is going to be as helpful as gemma 1
i have ran 1bit models before most turn out to be as good as gemma 1