An Exploratory Replica-Overlap Probe of the Grokking Transition

arXiv:2609.25634v1 Announce Type: cross Abstract: We trained 64 independently seeded networks in four configurations, continuing each to sustained convergence or a 40,000-epoch ceiling. We then asked whether an RSB-inspired distribution of pairwise weight overlaps changes across the grokking…

science

Sources