The Rank the Task Demands: A Causal Rank Law for Matrix Memories Trained on Group Composition

A matrix-valued memory represents by spanning: whatever a $d\times d$ state binds or tracks, it holds in the geometry of its column space, and rank is the budget it spends. Prior work treats this budget descriptively (Nazari and Rusch, 2026; Sun et al., 2026) or through hand-built constructions (Nichani et al., 2025); neither answers what a geometric account of learned representations needs answered: when a task’s algebra fixes a minimal representational dimension, does gradient descent recruit exactly that dimension, and is it causally load-bearing?

We answer both halves affirmatively under one discipline: a hard single-state bottleneck (the decoder reads only one matrix $Z$, verified by a gradient blank-out test) and recovery at a cosine-similarity threshold of 0.9 (scoring against the true continuous target, never argmax over a codebook, which would let a rank-1 state recover on the order of $d$ associations (Nichani et al., 2025)). Section 2 includes the provable $K$-pair-binding foundation. The headline is group-composition state tracking, where representation theory supplies the ground truth: across five finite groups spanning the solvable/non-solvable divide, the minimal faithful real representation dimension $d_{\min}$ predicts the recruited rank almost perfectly (Section 3), a matched-dimension solvable/non-solvable pair lands statistically equivalent (Section 4), and a pre-registered force-rank razor (Section 5) checks a geometrically guaranteed similarity ceiling and confirms sufficiency in all five groups: at rank $d_{\min}{-}1$, the maximum cosine similarity is below the $0.9$ threshold ($\sqrt{(d_{\min}{-}1)/d_{\min}}\leq 0.894$), and $d_{\min}$ suffices at four seeds per group in every group, which is not guaranteed a priori. Correcting the target’s padding (Appendix D) recovers the razor’s sufficiency result.

Tasks. In the binding task, each episode presents $K$ key–value pairs. The encoder writes one state $Z\in\mathbb{R}^{d\times d}$. Prediction is the literal unbind $Zk_{j}$. $\mathrm{rec}@0.9$ is the fraction of queries with cosine to the true value above 0.9. The group task is the word problem of a finite group $G$. A word $w=g_{i_{1}}\cdots g_{i_{L}}$ is drawn as a random walk on $G$’s Cayley graph ($L\sim\mathrm{U}\{1,\dots,8\}$). It must map to $\rho_{G}(g_{i_{1}}\cdots g_{i_{L}})$ under a pinned orthogonal reference representation of dimension $d_{\min}(G)$, the minimal faithful real representation dimension. The groups are $S_{3},S_{4},A_{5},S_{5},A_{6}$ with $d_{\min}=2,3,3,4,5$ (Appendix A). The first two are solvable, and the rest are not. Non-solvable word problems are $\mathrm{NC}^{1}$-complete (Barrington, 1989; Barrington and Thérien, 1988). $d_{\min}$ is a different, representation-theoretic axis. The design uses $S_{4}$/$A_{5}$, matched at $d_{\min}=3$ with opposite solvability, as the dissociation pair.

We study learning under direct supervision toward a chosen minimal faithful representation, embedded in a larger matrix. The target specifies this representation; the rank requirements studied here apply to this target and scoring setup, rather than to storage across all possible encodings or decoders.

Model. A Transformer encoder with $d_{\mathrm{state}}$ learned row-reader queries maps each word to a single state $Z(w)\in\mathbb{R}^{d_{\mathrm{state}}\times d_{\mathrm{state}}}$, $d_{\mathrm{state}}=d_{\min}+2$, leaving spare dimensions so over-recruitment is expressible. The target embeds the reference block-diagonally ($\rho_{G}(\cdot)\oplus I_{2}$ in the observational arm, $\rho_{G}(\cdot)\oplus 0$ in the causal-razor arm; Appendix D). The loss is cosine distance. The fixed readout has no learned weights that could launder rank, and the decoder reads only $Z$ (blank-out verified). Convergence bars pinned the per-group step budgets (8k–40k) before any decisional cell ran, as recorded in the design document’s pre-registration.

Instrument. The learned state is defined only up to scale and an orthogonal change of basis (a Schur intertwiner): $Z(w)\approx c\,Q\,[\rho_{G}(w)\oplus\cdot\,]\,Q^{\top}$. We estimate the model’s own dominant $d_{\min}$-subspace $U$ from the SVD of the centered covariance of $Z(w)$ over held-out words. We measure restricted effective rank as the entropy effective rank of $U^{\top}Z(w)U$. We score degauged recovery as cosine after fitting $(c,Q)$ on a fitting split and evaluating on a disjoint split (50 fresh words per cell, 30 to fit and 20 scored, so $\mathrm{rec}@0.9$ moves in steps of 0.05), reported as $\mathrm{rec}@0.9$. Centering is load-bearing (Appendix D). Rank is invariant under the fitted gauge, so a rank-deficient state cannot be degauged into a full-rank one. For force-rank cells, the pre-registration pinned the conservative full-$Q$ Procrustes variant (crosscheck $\mathrm{rec}@0.9$) as the decisional readout. The provable foundation (binding).

The bound is classical (Kohonen, 1972; Anderson, 1972), holding only under exact continuous recovery. On this binding testbed, a companion paper (Larson, 2026a) establishes that gradient descent recruits effective rank tracking $K$. The same paper shows that the recruited rank is causally necessary through a train-time force-rank step at the provable bound. It also shows that the trained operator composes exactly under repeated self-application. The composition-stability probe is periodicity-equivalent to depth 5 under the single 8-cycle target (Liu et al., 2023) (Appendix H). This paper inherits that instrument and carries only the group-composition program.

Per-group mean restricted effective rank lands within 4.9–10.2% of $d_{\min}$ at every group, and all 19 seeds sit inside the pre-registered $[0.7,1.3]\cdot d_{\min}$ band (Figure 1; means and per-seed values in Appendix B).

Spearman correlation between recruited rank and $d_{\min}$ is $\rho=0.9747$, the maximum this design can express, since the $S_{4}$/$A_{5}$ tie caps $\rho$ below 1; under the exact permutation null, $P(\rho\geq 0.8)=8/120\approx 6.7\%$ (0.8 is pre-registered, below the next achievable level 0.87), so by pre-registration this leg is corroborating rather than independently decisive: the band’s upper half is non-binding by construction, and a disclosed length-robustness split is reported alongside it (Appendix D). The dimension-matched pair $S_{4}$/$A_{5}$ is tested directly in Section 4.

The design uses $S_{4}$/$A_{5}$ as its contrast. The groups share $d_{\min}=3$ but lie on opposite sides of the solvability divide, the axis on which expressivity theory separates state-tracking architectures (Merrill et al., 2024; Grazzi et al., 2025; Siems et al., 2025). This matched-dimension comparison tests whether measured effective rank is equivalent across the selected pair despite their opposite solvability. Siems et al. (2025) provide the precursor observation (§5.2): $S_{4}$ and $A_{5}$ both extrapolate with two Householder reflections and keys of size 3. They attribute this to the groups’ embedding in $\mathrm{SO}(3)$, and their PCA of the trained keys is three-dimensional. The present test turns that single-architecture reading into a pre-registered equivalence claim on state rank across the five-group family. Section 5 makes the dimension causal. Because the interesting outcome is a null, the pre-registration specifies an equivalence test rather than a difference test. The comparison uses Welch two-one-sided tests on restricted effective rank at margin $\pm 0.5$ rank-units (half the spacing of the $d_{\min}$ ladder), with $n=5$ seeds per group. The design record fixed a pre-run power simulation before the sweep ran. It confirms that the test reliably rejects equivalence at a true gap of 1.0 rank-units, so a real class effect of one ladder step could not have hidden inside the margin.

The observed difference is $+0.019$ rank-units (se 0.037, df 7.8), and both one-sided tests pass at roughly seven times the critical value ($t=13.06$ and $14.12$ against $t_{\mathrm{crit}}=1.865$): the two one-sided tests declare equivalence. The two groups’ seed clusters are visually coincident in Figure 1 (lower panel). These results establish equivalence of effective rank for this matched-dimension pair within the pre-registered $\pm 0.5$ rank-unit tolerance.

The decisive test intervenes on rank: the encoder’s output is spectrally truncated to rank $k\in\{d_{\min}{-}1,d_{\min},d_{\min}{+}1\}$ throughout training, against the zero-padded target $\rho_{G}(\cdot)\oplus 0$ of rank exactly $d_{\min}$, alongside an unconstrained anchor from the same family. Pre-registered reading: below $d_{\min}$, a sound readout pins recovery to zero by geometry, making that arm an integrity control whose registered trigger (any recovery there) would indicate an instrument leak; the live prediction is that $k\geq d_{\min}$ recovers past $0.9\times$ the anchor’s crosscheck $\mathrm{rec}@0.9$.

Table 1 and Figure 2 show the result on the pre-pinned crosscheck readout. Necessity below $d_{\min}$ is an analytically forced floor: against a $d_{\min}$-tied-unit-singular-value target, the maximum cosine any rank-$(d_{\min}{-}1)$ operator can reach is $\sqrt{(d_{\min}{-}1)/d_{\min}}\leq 0.894$, below the $0.9$ threshold in every group by construction, so $\mathrm{rec}@0.9=0.000$ at $k=d_{\min}{-}1$ follows regardless of training quality; observed cells still reach 86–95% of that ceiling (mean 91%; Appendix D), evidence of near-optimal training under the cap. The zero is noiseless in all four seeds of every group. Sufficiency at $d_{\min}$ carries the causal claim, since no such bound guarantees a rank-exactly-$d_{\min}$ solution is reachable. Every group was run at four seeds, and the pre-registered rule compares the seed-mean of $k{=}d_{\min}$ against the bar fixed from seed 0 before the further seeds ran, never against a bar recomputed from the seeds being judged. $S_{3}$, whose seed-0 cell sat inside the pre-stated $\pm 0.05$ marginality trigger, confirms at seed-mean 0.5625 against the fixed 0.495 bar; $S_{4}$, $A_{5}$, and $A_{6}$ confirm at seed-means 0.6875, 0.6500, and 0.6750 against fixed bars 0.585, 0.630, and 0.585, each clearing its own-seed bar in 4 of 4 seeds; $S_{5}$ confirms at seed-mean 0.7000 against its bar 0.6075, per-seed $k{=}d_{\min}$ 0.700/0.600/0.750/0.750 against anchors 0.750/0.600/0.700/0.650, own-bar clears 4 of 4, and $k{=}d_{\min}{-}1$ at 0.000 in all four seeds; its bar is $0.9\times$ its four-seed anchor mean rather than a seed-0 literal because its 20k step pin was set by a separately pre-registered re-test (Appendix F). Sufficiency therefore holds at four seeds in all five groups (per-seed detail in Appendices E and F). Both marquee groups confirm at $d_{\min}$, meeting the causal criterion. Table 4 adds an instrument-independent reading: on the zero-padded target the unconstrained anchor’s whole-matrix effective rank, taken over the full $d_{\mathrm{state}}\times d_{\mathrm{state}}$ state with no subspace lens, lands at $1.82/2.82/2.83/3.77/4.67$ (four-seed means) against $d_{\min}=2/3/3/4/5$ with two ambient dimensions available, so the recruited rank equals $d_{\min}$ without any restriction to the model’s dominant subspace.

Identity-padding the target confounds the razor by handing every capped arm a free rank-2 loss reduction (Appendix D); the zero-padded target above removes the confound.

Chughtai et al. (2023) reverse-engineers group multiplication via representation theory. Stander et al. (2024) and Wu et al. (2025) dispute and refine that account (coset circuits; verified per-argument equivariance). He et al. (2026) prove that two-layer networks on $g_{1}\star g_{2}$ learn spectral representations with a rank-one alignment of Fourier coefficients. Shutman et al. (2025) frame word learning as a low-rank 3-tensor. All four study the binary operation, not a sequential state, and none relates a learned dimension to $d_{\min}$. On sequential composition, Marchetti et al. (2026) show recurrent networks acquire irreps one at a time with width scaling in the irrep dimensions on cyclic and dihedral groups. Zhang et al. (2026) find on looped transformers that $\mathrm{NC}^{1}$-completeness costs nothing while group order does. Neither measures state rank. Kazanskii (2026) regularizes representation dimensionality on permutation composition to speed grokking, without a necessity threshold. Here, rank itself, not an irrep decomposition, is the measured and manipulated quantity, and the required dimension is fixed in closed form by $d_{\min}$. Nazari and Rusch (2026) and Sun et al. (2026) measure state-rank dynamics in pretrained linear-attention models observationally, with no task algebra fixing a required dimension. They read low rank as under-used capacity, whereas this paper reads it as the rank the task demands. Parnichkun et al. (2025) apply an entropy effective rank to sequence-model memory as a utilization measure. Truong et al. (2026) track spectral-entropy collapse of representation covariances on group tasks. The estimator here is therefore standard, not new. Mishra et al. (2026) train matrix-state RNNs on $S_{3}$ composition without a rank intervention. Grazzi et al. (2025), Siems et al. (2025), Merrill et al. (2024), Shakerinava et al. (2026), and Nowak et al. (2026) characterize which word problems recurrent architectures can express. They sort the problems by solvability and by the depth a subnormal series demands, an axis orthogonal to the one measured here (dimension governs state rank; series length governs depth). Delétang et al. (2023) benchmark sequence architectures across the formal-language hierarchy. The equivalence test instead sorts by representation dimension. A bolt-on-latent negative result (Larson, 2026b) is this result’s counterpart. Nichani et al. (2025) and Barnfield et al. (2026) prove associative-memory capacity under argmax (winner-take-all) decoding, whereas we score cosine similarity against continuous targets and report recovery at a threshold of 0.9. Huh et al. (2024) propose that models trained on different tasks converge to a shared representation; the present law is a narrower, algebra-driven instance of that convergence.

Limitations. All results are on sub-1M-parameter synthetic testbeds, not claims about pretrained language models. Razor cells are four seeds per group; $S_{5}$’s step pin is 20k rather than 8k, set by a pre-registered re-test after the 8k pin failed convergence (Appendix F). $S_{3}$ carries a soft-convergence flag at its own shortest pinned budget (Appendix G), so its confirmation reads directionally. A companion paper (Larson, 2026a) carries the binding-task program (the recruitment grid, force-rank staircase, and composition mechanism) in full; this paper shares no figures or tables with it.