The Curve Bends You
Since before the transformer, we have warned that the most suicidal thing you could do would be to ask your AI to do your alignment homework, and automate the process.
Proof1 independent outlet
Key points
- That is not the worst possible plan.
- Alignment is complex and interacts deeply with every aspect of the world, and is one of the hardest possible things for an AI to get right even if it means maximally well and is itself functionally aligned.
- Have current AI do automated alignment work and figure it all out, aka ????.
- The bad news is that some people still think this is a plan that, while not great, still has a solid chance of working, with only some small (e.g. 10%) chance of getting us all killed, as opposed to being probably suicidal.
Sources (1)
- [1]The Curve Bends YouDon't Worry About the Vase (Zvi) · Oct 7, 08:31 PM
Since before the transformer, we have warned that the most suicidal thing you could do would be to ask your AI to do your alignment homework, and automate the process.
That is not the worst possible plan.
Extractive summary: sentences quoted from the sources.
Before this
- Oct 7, 2026langchain-ai/langchain langchain-huggingface==1.2.3
- Oct 6, 2026huggingface/transformers v5.19.0: Release v5.19.0
- Oct 6, 2026EmbeddingGemma 2: an open, lightweight multimodal embedding model
- Oct 6, 2026huggingface/diffusers v0.41.0: Diffusers 0.41.0: QwenImage 2.1 pipeline and more
- Oct 5, 2026Why agent swarms could be the next “scaling law”
- Oct 5, 2026LiquidAI/d1-omni-600M
