arXiv paper proposes a write–read subspace method to compress Mamba-2 states

arXiv paper proposes a write–read subspace method to compress Mamba-2 states

In a paper on arXiv, Shang Tingyu and Cao Wenfei argue that Mamba-2 state compression should preserve the directions that carry information from inputs to outputs, rather than keep or discard state coordinates one by one. Mamba-2 stores context in a fixed-size recurrent state, which the authors say dominates decoding memory and bandwidth. The authors report that state energy is concentrated in a bias-like direction, while output-relevant content lies in a lower-dimensional subspace that does not align with the state’s coordinates. Their proposed post-training method, \method{}, uses balanced truncation—a way to identify directions that matter to both inputs and outputs—and applies the resulting rotation through Mamba-2’s transition. Their HARP method assigns different ranks to layers based on the Hankel spectrum and protects retrieval-sensitive layers. In the paper’s reported WikiText-2 results, the methods halve state dimension across models from 130M to 2.7B, with an average perplexity increase of 0.3 points (1.8%); the authors report an increase of 1.6 points (9.3%) for GHOST. These results are benchmarks, not evidence of performance in every deployment. How well does the approach transfer to other workloads and evaluation settings?

Publication: 3d64154b-cf3a-4004-8bf0-adce9cd7894b

attribution — pass: The draft correctly attributes the paper to Shang Tingyu and Cao Wenfei on arXiv. It keeps the findings framed as the authors' reports and arguments rather than as established fact.

Authors:Shang Tingyu, Cao Wenfei

summary — uncertain: The draft is faithful to the abstract but hard to follow without specialist background. It never says plainly that Mamba-2 is a type of AI language model, or that perplexity measures prediction quality, where lower is better. The macro \method{} appears verbatim as if it were a name. Rank, Hankel spectrum, GHOST and the write–read subspace headline are also left unexplained. Smallest repair: briefly gloss Mamba-2 and perplexity, replace \method{} with a description such as 'the authors' unnamed method', and note that halving the state means less memory is needed during text generation, which the source says the state dominates.

Mamba-2 compresses all context into a fixed-size recurrent state that dominates decoding memory and bandwidth.

date — pass: The originalPublished date of 2026-10-27 matches the v1 submission date. It is not the later feed date.

[Submitted on 27 Oct 2026]

support — pass: Every claim matches the abstract: the energy and subspace finding, balanced truncation, per-layer rank allocation by HARP, and the 0.3 (1.8%) versus 1.6 (9.3%) WikiText-2 figures. The benchmark caveat and the open question about transfer to other workloads are appropriately bounded. The draft omits the abstract's calibration-speed and retrieval claims, but this does not distort the reading.

halves the state dimension at an average WikiText-2 perplexity increase of $0.3$ points ($1.8\%$) across 130M--2.7B, versus $1.6$ ($9.3\%$) for GHOST

media — pass: The selected media is the verified direct arXiv abstract page for this paper. That is the most direct way for a reader to reach the source.