ResearchResearch paperLarge Language Models · Training & Scaling1 source · Oct 8, 2026

KITE: A Knowledge-Injected Temporal Encoder for Time-Series Event Forecasting

We call this a semantic prior and inject it into a self-supervised event forecaster through two switchable mechanisms, a covariate mechanism and an attention-bias mechanism, each the identity at its null, so one architecture serves every prior type with no per-dataset architecture search.

Key points

  • Forecasting rare, high-cost events in multivariate time-series systems is hard because their precursors are seldom observed, so a purely data-driven model has little to learn from.
  • The engineers who run these systems, however, hold knowledge that precedes such events, information absent from the scarce labels.
  • KITE is a switchable, attributable route to contextual conditioning, and a substrate for scaling toward cross-domain, pretrained time-series foundation world models that carry their governing structure explicitly.

Sources (1)

  • [1]KITE: A Knowledge-Injected Temporal Encoder for Time-Series Event Forecasting
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 8, 09:35 PM
    We call this a semantic prior and inject it into a self-supervised event forecaster through two switchable mechanisms, a covariate mechanism and an attention-bias mechanism, each the identity at its null, so one architecture serves every prior type with no per-dataset architecture search.
    Forecasting rare, high-cost events in multivariate time-series systems is hard because their precursors are seldom observed, so a purely data-driven model has little to learn from.

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 8, 2026Odyssey-3 is a new generative world model that you can try for free
  2. Oct 8, 2026Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction
  3. Oct 8, 2026DreamTrue: Action-Faithful Robot World Model with Counterfactual Post-Training
  4. Oct 8, 2026Memento 3: Model-Based Recursive Self-Improvement through Reflective Rulebooks
  5. Oct 8, 2026OuroWorld: Bringing Any 3D World Alive as Diverse, Endlessly Looping 3D Cinemagraphs
  6. Oct 8, 2026WorldGuide: Goal-Directed Video World Model for Procedural Task Execution

Related