minus-squareblarg_dunsen@sh.itjust.workstoSelfhosted@lemmy.world•How my AI Agent views and maintains "our" homelablinkfedilinkEnglisharrow-up4·20 days agoHow are you running a 34B model without a GPU? You must be getting one token an hour! How much RAM do you have in the LLM box? linkfedilink
minus-squareblarg_dunsen@sh.itjust.workstoSelfhosted@lemmy.world•ntfy.sh v2.18.0 was written by AIlinkfedilinkEnglisharrow-up0·4 months agoOh boy, do I have bad news about 90% of the internet for you… linkfedilink
How are you running a 34B model without a GPU? You must be getting one token an hour! How much RAM do you have in the LLM box?