I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)[P]
ALHR- Adaptive learnable Hierarchical Routing is a static binary tree based system that uses learnable functions to REDUCE the amount of keys used.
Proof1 community thread
Key points
- It takes less memory and SCALES much better VRAM with tokens
Sources (1)
- [1]I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)[P]r/MachineLearning (top, daily) · Oct 10, 06:08 PM
ALHR- Adaptive learnable Hierarchical Routing is a static binary tree based system that uses learnable functions to REDUCE the amount of keys used.
It takes less memory and SCALES much better VRAM with tokens
Extractive summary: sentences quoted from the sources.
Before this
- Oct 10, 2026Is anyone running Qwen3.8 Flash Next with a 1M context?
- Oct 9, 2026Microsoft's Decision-1 model enters the fast-growing AI decision model race
- Oct 8, 2026[AINews] not much happened today
- Oct 8, 2026REMORY: Learning Residual Memory for Context Compaction
- Oct 7, 2026Dual-QK: Sharp Queries and Flat Keys for Prunable 2-bit KV Caches
- Oct 7, 2026Decoupling Logic from Persona: Structural Immunity of Edge LLM Agents to Context Pollution