Why CEREBRO kept it

JEV metric missing from LLM benchmarks; LLM eval mechanics

Backlinks

Appeared in 1 briefing

• 2026-09-27

Related

Shares tags: ai/llm-mechanics · cerebro/signal

• If Jev picks the tool, how does the LLM ask for another one?reddit · 2026-09-27
• With LLMs, we like to think of 'smart' and 'dumb' as one axis (because we think of humans this way). I'd like to argue against this framing. Instead, try to think of 'smart' and 'dumb' as two differex · 2026-09-27
• RT @theo: Last year, Anthropic was optimizing inference across 3 different types of compute (Nvidia, AWS trainium, Google tpus). There were mistakes made during these optimizations that resulted in acx · 2026-09-27
• A lot of people are saying Anthropic has already nerfed Claude Opus 5.5. We're launching NerfBench on BridgeBench tomorrow. We have the day 1 results. Tomorrow morning we show you the retest. Isx · 2026-09-27
• If you want to learn complete AI Engineering stack, follow these stages: Stage 1: How LLMs actually work Tokens, context window, embeddings, prefill vs decode, why every extra token costs time andx · 2026-09-27
• Some stats creating this with Opus 5.5 set on Ultracode: Most of the time there were between 30-45 agents running at the same time. Total cost: $415 Total weekly limit used on 20x max plan: 25% Tox · 2026-09-27

Also from reddit.com

• I built a computer-use AI you can actually install and start using in minutesreddit · 2026-09-27
• If Jev picks the tool, how does the LLM ask for another one?reddit · 2026-09-27
• I priced 203 PRs from my Claude Code agents: Opus 5.5 cost about half of Sonnet 5 per line of codereddit · 2026-09-26
• solo founder: setting up proper project context helped more than any model upgradereddit · 2026-09-25
• Context compaction, measured: FutureOS vs Codex vs OpenCodereddit · 2026-09-24
• I built codex-resume: continue OpenAI Codex chats in Claude Code as native /resume sessionsreddit · 2026-09-24