da_cow (she/her)@feddit.org to 196@lemmy.blahaj.zoneEnglish · 3 days agolet me rule to you: Israel GPTfeddit.orgimagemessage-square100linkfedilinkarrow-up1990
arrow-up1990imagelet me rule to you: Israel GPTfeddit.orgda_cow (she/her)@feddit.org to 196@lemmy.blahaj.zoneEnglish · 3 days agomessage-square100linkfedilink
minus-squareboonhet@sopuli.xyzlinkfedilinkEnglisharrow-up5·3 days agoThey can be deterministic, but you can vary the temperature and also use seeds
minus-squarevoodooattack@lemmy.worldlinkfedilinkEnglisharrow-up1·2 days agoI didn’t say they normally aren’t. What I’m saying is that a shared KV-Cache removes that guarantee by introducing an external source of entropy.
They can be deterministic, but you can vary the temperature and also use seeds
I didn’t say they normally aren’t. What I’m saying is that a shared KV-Cache removes that guarantee by introducing an external source of entropy.