Tracking States or Tracking Cosets? An Algebraic Account of Learned State Tracking
arXiv:2609.29951v1 Announce Type: cross Abstract: State tracking requires composing a sequence of updates, but accuracy alone does not reveal what a model has learned. We study neural networks trained to predict the running product of group elements. We identify quotient solutions in Transformers…