minus-squareWbrJr@lemmy.mltoSelfhosted@lemmy.world•Ollama Server Component RecommendationslinkfedilinkEnglisharrow-up0·3 months agoNot all programs allow usage of multiple gpus as far as I know, some are not capable of splitting the llm in multiple vrams or something linkfedilink
WbrJr@lemmy.ml to Selfhosted@lemmy.worldEnglish · 8 months agoHow to propperly Ansible and selfhost without burning out?plus-squaremessage-squaremessage-square1linkfedilinkarrow-up10
arrow-up10message-squareHow to propperly Ansible and selfhost without burning out?plus-squareWbrJr@lemmy.ml to Selfhosted@lemmy.worldEnglish · 8 months agomessage-square1linkfedilink
Not all programs allow usage of multiple gpus as far as I know, some are not capable of splitting the llm in multiple vrams or something