I’ve been experimenting a bit with Jev as a fuzzy linter that runs after edits in your agent harness: looks very promising so far in my evals. First I converted all of our coding guidelines to tiny r
Why CEREBRO kept it
Agentic linting pattern; novel agent harness application.
The text below is an automated extraction of the article at https://x.com/MichaelThiessen/status/2103831653575544914, stored verbatim in the public cerebro-vault repository. Copyright remains with the original publisher (x.com).
First I converted all of our coding guidelines to tiny r
> Agentic linting pattern; novel agent harness application.
I’ve been experimenting a bit with Jev as a fuzzy linter that runs after edits in your agent harness: looks very promising so far in my evals.
First I converted all of our coding guidelines to tiny rules that are very easy to judge.
Then, only kept the ones that don’t require extra context/files/reasoning. I want it to be a single call, super fast, and Jev isn’t smart enough to handle complex or ambiguous rules.
I then created a synthetic eval that has different kinds of tool calls to exercise and test every one of those rules. Also a held out set that we don’t train on so we don’t accident
Backlinks
Appeared in 1 briefing