Funnily enough, you can use Vibe, Claude and Codex with local models if you configure them so. OpenCode supports it explicitly (while still retaining a cloud option because dev wants to make money)
So this isn’t anything too new, but eh, at least it’s more attention to the self-hosting capability of LLMs for code agents.
The multibillion dollar companies do this too but people find the permission prompts annoying and use the full dumbass mode instead lol
Loki, check my Loki logs!
I suggest using unsloth studio to get a friendly GUI for not just downloading models and running inference but also finetuning and such. Underneath it just uses llama.cpp which is supported by a lot of apps but it also adds other APIs IIRC. You can run claude code, github codex, mistral vibe off either the llama.cpp API or the unsloth API depending on which agent you’re using and they’ve got tutorials for setting those up. Other tools too.
That’s not to say it’s the only one or the best one, but I really like the UI, because it’s both simple and advanced (if you look for it, you can set KV cache type, temperature, etc, but you can also run default settings without ever looking at the advanced stuff).
Would flowers work instead?