Why CEREBRO kept it

Sol Codex benchmark advantage over mini-swe baseline

Backlinks

Appeared in 1 briefing

• 2026-09-30

Related

Shares tags: ai/agents · ai/llm-mechanics · cerebro/signal

• Looks like my numbers were better because I used Codex and AA used mini-swe-agent (think pi but shit) Might have to do my own runs of TerminalBench 4.0 on official harnesses because the difference isx · 2026-09-30
• This is Ultrafast. Our premium speed tier, Ultrafast offers up to 8x faster token generation (300 tokens per second) in Codex and up to 6x in the API. https://t.co/ekyzT1vFanx · 2026-09-30
• https://docs.b.ai/llmservice/models/claude-opus-5.5x · 2026-09-30
• We split one agent between a cloud planner and a local coder. Here's what it cost:reddit · 2026-09-29
• 400 LLM agents living together in an MMO server: what I learned about perception lag, fire-and-forget actions, and shedding loadreddit · 2026-09-29
• Coding Agents Build for the Grader They Imagine, Not the User: Speculative Reward Hacking in DeepSWEreddit · 2026-09-29

Also from x.com

• AA's run of TerminalBench got lower scores, but similarly insane costs. 6.1 Sol now dominates the pareto frontier https://t.co/RDe1xRVJ9hx · 2026-09-30
• Looks like my numbers were better because I used Codex and AA used mini-swe-agent (think pi but shit) Might have to do my own runs of TerminalBench 4.0 on official harnesses because the difference isx · 2026-09-30
• Artificial Analysis numbers are in! GPT-6.1 Sol is performing at around Opus 5.5 Medium levels for under a third the price. Not bad at all, but still more hyped for 6.1 Astra to catch them up 👀 httpsx · 2026-09-30
• To be clear, I still think Opus 5.5 is the current GOAT for coding. GPT-6.1 Sol is a great replacement for Astra at a WAY better price, but I don't default to it for code. I absolutely default to itx · 2026-09-30
• Sol 6.1 is a great model and an incredible value. Is it as good as Opus 5.5? https://t.co/VHSnNCGyPpx · 2026-09-30
• GPT-6.1 Sol: near-Astra intelligence for a fifth of the price. It’s the most cost-efficient model for its performance available today. https://t.co/hH8PnE2Oxkx · 2026-09-30