ttok 1.0

T2Covered by 1 source · first reported by Simon Willison's Weblog at 09 Oct, 00:34 UTC

Release: ttok 1.0 I released ttok 0.4, ran uv tool upgrade ttok, piped a file into the new version... and realized that it was defaulting to the GPT-4 tokenizer when it should very clearly default to GPT-5/GPT-6 instead! I figured switching the default was a reasonable excuse to finally ship a 1.0…