llmarchitectureattention
How MiniMax M3 Cheats the Quadratic Wall: Sparse Attention That Feels Like Mamba
MiniMax M3 uses a novel MiniMax Sparse Attention (MSA) with fixed-block partitioning and a lightweight top-k router to achieve near-linear scaling while preserving the sharp, uncompressed recall of a full Transformer — delivering the fluid long-context feel of Mamba-style models for serious agent workloads.
Read