It is impossible to run it in LM Studio

#1
by Green4el - opened

llama.cpp error: 'error loading model vocabulary: unknown pre-tokenizer type: 'falcon3''

Ah shoot I forgot that I didn't remove that line, yes they're working on falcon support still sadly

apparently if you download the latest beta, then install the newest available llama.cpp runtime, it'll work

https://lmstudio.ai/beta-releases

when it's open, hit control/command + shift + r and then install 1.7.0

I have not any options in the latest LM Studio
image.png

Oh, I've found it

It works, thx

Green4el changed discussion status to closed

For others who may stumble upon this, have to switch to "beta" at the top to see new runtimes

Sign up or log in to comment