AI brief
Simon Willison released ttok 1.0, updating the tool to default to the GPT-5/GPT-6 tokenizer instead of the GPT-4 tokenizer.
Written by AI from Simon Willison's Weblog's published text.
Source
“Release: ttok 1.0 I released ttok 0.4 , ran uv tool upgrade ttok , piped a file into the new version... and realized that it was defaulting to the GPT-4 tokenizer when it should very clearly default to GPT-5/GPT-6 instead!”
Interpretation or community commentary rather than straight reporting.
Read original story ↗