Thankfully, the huggingface incident proved how much care AI companies put in making sure their models cannot break out, and how aligned to human values the LLM swarms are.\s With that said I think regular personal computers are more likely to get hit by this. About as secure (not very) but much more GPU power and data to harvest.
The AI companies will argue that we should therefore not be allowed to own computers powerful enough to run local LLMs, and instead should own thin clients and subscribe.
Not that relevant. Those fears are about malicious use of open weights models, this is about autonomous self replication of (small) models. Clearly the article by the AI company describes this potentially happening on computers with tiny memory and processing power, where even thin clients could be effected. I also disagree strongly that that’s what the AI companies want, especially the employees which I have never seen espouse anything like that. They just don’t want some random teenager creating the next covid. There are ways to do that without meaningfully limiting compute for individuals.
Thankfully, the huggingface incident proved how much care AI companies put in making sure their models cannot break out, and how aligned to human values the LLM swarms are.\s With that said I think regular personal computers are more likely to get hit by this. About as secure (not very) but much more GPU power and data to harvest.
The AI companies will argue that we should therefore not be allowed to own computers powerful enough to run local LLMs, and instead should own thin clients and subscribe.
Not that relevant. Those fears are about malicious use of open weights models, this is about autonomous self replication of (small) models. Clearly the article by the AI company describes this potentially happening on computers with tiny memory and processing power, where even thin clients could be effected. I also disagree strongly that that’s what the AI companies want, especially the employees which I have never seen espouse anything like that. They just don’t want some random teenager creating the next covid. There are ways to do that without meaningfully limiting compute for individuals.