Generative AI

Beyond Mamba SSMs: Parallel Kalman Filters as Scalable Primitives for Language Modelling featured image

Beyond Mamba SSMs: Parallel Kalman Filters as Scalable Primitives for Language Modelling

We show that Kalman filters can be reparameterized for efficient parallel training and introduces GAUSS, a more expressive yet equally scalable state-space layer that outperforms …

Vaisakh Shaj
Read more
Forgetting is Everywhere featured image

Forgetting is Everywhere

We present a unified, algorithm-agnostic theory that defines forgetting as self-inconsistency in a learner’s predictive distribution—quantifying loss of predictive information—and …

Ben Sanati
Read more
Generative World Modelling for Humanoids: 1X World Model Challenge Technical Report featured image

Generative World Modelling for Humanoids: 1X World Model Challenge Technical Report

Technical report detailing our method that won the 1X World Model Challenge 2025.

Riccardo Mereu
Read more
1X World Model Challenge featured image

1X World Model Challenge

Introduction World models equip agents (e.g., humanoid robots) with internal simulators of their environments. By “imagining” the consequences of their actions, agents can plan, …

Aidan Scannell
Read more