ttok 1.0
Why CEREBRO kept it
CLI token counter; useful for token-budget workflows
The text below is an automated extraction of the article at https://simonwillison.net/2026/Oct/9/ttok/, stored verbatim in the public cerebro-vault repository. Copyright remains with the original publisher (simonwillison.net).
<p><strong>Release:</strong> <a href="https://github.com/simonw/ttok/releases/tag/1.0">ttok 1.0</a></p> <p>I released <a href="https://simonwillison.net/2026/Oct/8/ttok/">ttok 0.4</a>, ran <code>uv tool upgrade ttok</code>, piped a file into the new version... and realized that it was defaulting to the GPT-4 tokenizer when it should very clearly default to GPT-5/GPT-6 instead!</p> <p>I figured switching the default was a reasonable excuse to finally ship a 1.0.</p> <p>OpenAI haven't actually confirmed that GPT-6 uses the same tokenizer as the GPT-5 family yet - there's an <a href="http
Backlinks
Appeared in 1 briefing