mr_right@lemmy.dbzer0.com to linuxmemes@lemmy.world · 7 months agoyou don't need more 4GB of RAMlemmy.dbzer0.comimagemessage-square227fedilinkarrow-up11.49Karrow-down139
arrow-up11.45Karrow-down1imageyou don't need more 4GB of RAMlemmy.dbzer0.commr_right@lemmy.dbzer0.com to linuxmemes@lemmy.world · 7 months agomessage-square227fedilink
minus-squarearin@lemmynsfw.comlinkfedilinkarrow-up8·7 months agoJust using local llama takes 32GB ram
minus-squareAdrianTheFrog@lemmy.worldlinkfedilinkEnglisharrow-up2·7 months agodepends on quantization
Just using local llama takes 32GB ram
depends on quantization