State-space model proofs #
This entrypoint collects the proof layer for S4/Mamba-style state-space sequence models. We prove two complementary facts:
- affine selective scan summaries compose associatively and agree with left-to-right recurrence;
- recurrent S4/Mamba runners are prefix-causal, so appending future tokens cannot change outputs already emitted for a prefix.
The associative-summary theorem assumes semiring laws; it does not establish identical rounded results for different floating-point scan schedules. The causality results concern the sequential spec runners. Native implementations need a separate refinement argument.
References:
- Gu, Goel, and RĂ©, "Efficiently Modeling Long Sequences with Structured State Spaces", ICLR 2022.
- Gu and Dao, "Mamba: Linear-Time Sequence Modeling with Selective State Spaces", COLM 2024.
- Dao and Gu, "Transformers are SSMs", ICML 2024.