Retrofitting language models to operate over bytes

Nature, Published online: 07 October 2026; doi:10.1038/s41586-026-11111-4 Byteification is a general method for retrofitting large language models to operate over bytes such that they approach the capabilities of subword-based systems and may be better for scientific data.

ai

Sources