

6·
1 month agoYeah essentially the other tools you had to use API keys, and none of them were FOSS, mostly paid only tools.
This lets you self host both the application interface itself (which can also be an IDE) and use a self hosted LLM


Yeah essentially the other tools you had to use API keys, and none of them were FOSS, mostly paid only tools.
This lets you self host both the application interface itself (which can also be an IDE) and use a self hosted LLM


I kinda loved his “you should self host to decentralize from big tech” and “run graphene and Linux to avoid data collection” content, but idk what the local ai stuff is any good for


Tbh I just fanboy any FOSS company like that
Coding is okay, but the flagship free models usually crush whatever and to have decent memory you need hella VRAM Doc analysis is okay if they’re small, Home assistant isn’t bad but kinda overkill with an LLM when you can just set manual automations, Journalling, gaming, music, DJ’ing, elder care, imagine and video generation, are all relatively bad even on flagship models
Quick overview of searches is fine but I’ll use a free flagship model for that, in depth research tends to not be great