It’s really just download and install. Just follow the instruction on the website. And check the readme on githun for how to use it.
If you want aa nice looking webinterface, instead of a commandline interface, you can also download one of the many ready to use frontends. You can find them in the github readme.
I installed it yesterday and the cli is pretty slow (on windows), but the rest api is pretty quick.
Probably. I think that might be the top open source small LLM. I really need to set it up and try it.
It’s really just download and install. Just follow the instruction on the website. And check the readme on githun for how to use it.
If you want aa nice looking webinterface, instead of a commandline interface, you can also download one of the many ready to use frontends. You can find them in the github readme.
I installed it yesterday and the cli is pretty slow (on windows), but the rest api is pretty quick.