SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · 23 hours agoWhich specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?message-squaremessage-square14linkfedilinkarrow-up11file-text
arrow-up11message-squareWhich specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · 23 hours agomessage-square14linkfedilinkfile-text
minus-squaremeowmeow@quokk.aulinkfedilinkEnglisharrow-up0·20 hours agoYes, but when you compare it to codex and Claude though, it’s significantly slower. Especially over time. Better crank that AC. I think in a few years we will have current cloud levels running pretty efficiently on current computers.
Yes, but when you compare it to codex and Claude though, it’s significantly slower. Especially over time. Better crank that AC.
I think in a few years we will have current cloud levels running pretty efficiently on current computers.