AI models may be capable of self-replicating without access to a datacenter
Our experiments suggest that small AI models may be months away from being capable enough to self-replicate on commercial IoT devices, like smart ovens and off-brand Android TV boxes.
Proof2 community threads
Key points
- Get updates on our latest red-teaming research and findings.
- Ever-improving AI capabilities make a longstanding concern increasingly realistic: autonomous replication and adaptation (ARA), which involves a model deploying and propagating itself without human control.
- In this blog post, we show that a distributed botnet of IoT devices—which are cheap and typically poorly defended—could also provide enough compute to run a capable model.
- We largely ignore the cyber exploit element of the replication process (the first two stages above), since earlier papers CyberGym, ExploitBench, and adaptive worms already show that small models are capable of cyber exploits, especially when given the right tools.
Sources (3)
- [1]AI models may be capable of self-replicating without access to a datacenterAnthropic Research · Oct 12, 12:00 AM
Our experiments suggest that small AI models may be months away from being capable enough to self-replicate on commercial IoT devices, like smart ovens and off-brand Android TV boxes.
Get updates on our latest red-teaming research and findings.
- [2]AI models may be capable of self-replicating without access to a datacenterHacker News: LLM threads (40+ points) · Oct 12, 07:25 PM · same content
- [3]AI models may be capable of self-replicating without access to a datacenterHacker News (AI, 100+ points) · Oct 12, 07:25 PM · same content
Extractive summary: sentences quoted from the sources.
Before this
- Oct 11, 2026OrcaRouter Releases OrcaCyber Zero 1.5 Cybersecurity Model With 1M Context
- Oct 10, 2026When the Safety Test Became the Threat: The Machine That Found Its Own Way Out
- Oct 10, 2026Anthropic is cutting off its internal evaluations from the internet
- Oct 9, 2026Learning Representations to Guide Pixel Diffusion Transformers
- Oct 8, 2026Google brings agentic AI to Gemini, starting with businesses
- Oct 8, 2026Show HN: Let your AI agents paint big arrows, boxes and text on your screen
