Rimu@piefed.social to Programming@programming.devEnglish · 2 days agoRsync author responds to online outrage about his usage of LLMsmedium.comexternal-linkmessage-square167linkfedilinkarrow-up11file-text
arrow-up11external-linkRsync author responds to online outrage about his usage of LLMsmedium.comRimu@piefed.social to Programming@programming.devEnglish · 2 days agomessage-square167linkfedilinkfile-text
Seems like he’s been pushed into using LLMs as a way to cope with the deluge of LLM-generated security reports.
minus-squarelocuester@lemmy.ziplinkfedilinkEnglisharrow-up0·13 hours ago64GB unified memory. I run it (and a lot more) on a dgx spark, but a Mac mini would suffice also. You could prob run 4-bit version on a RTX card with 32g. Maybe even 24g. Like a 5090 or 4090 or such. So much info out there.
minus-squarewewbull@feddit.uklinkfedilinkEnglisharrow-up0·10 hours agoMac Minis top out at 48GB and are 1.8k when configured like that. It’s going to be at least $2k to buy anything that has a hope of running it at a reasonable speed. Running local isn’t free, but at least it’s just a single upfront payment.
minus-squareDarkaga@lemmy.worldlinkfedilinkarrow-up0·8 hours agoThe M4 Pro Mac Mini caps out at 64GB RAM. Whether or not Apple can sell you that SKU right now is a different question with the ongoing DRAM shortage.
64GB unified memory. I run it (and a lot more) on a dgx spark, but a Mac mini would suffice also.
You could prob run 4-bit version on a RTX card with 32g. Maybe even 24g. Like a 5090 or 4090 or such.
So much info out there.
Mac Minis top out at 48GB and are 1.8k when configured like that. It’s going to be at least $2k to buy anything that has a hope of running it at a reasonable speed.
Running local isn’t free, but at least it’s just a single upfront payment.
The M4 Pro Mac Mini caps out at 64GB RAM. Whether or not Apple can sell you that SKU right now is a different question with the ongoing DRAM shortage.