blarg_dunsen@sh.itjust.workstoSelfhosted@lemmy.world•How my AI Agent views and maintains "our" homelabEnglish21 hoursHow are you running a 34B model without a GPU? You must be getting one token an hour! How much RAM do you have in the LLM box? 4
How are you running a 34B model without a GPU? You must be getting one token an hour! How much RAM do you have in the LLM box?