Steven Gonsalvez

Software Engineer

NVIDIA/SkillEvaluator: Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measu

Why CEREBRO kept it

Evaluation framework for agent skills; quality gates, novel agentic tooling.

The text below is an automated extraction of the article at https://github.com/NVIDIA/SkillEvaluator, stored verbatim in the public cerebro-vault repository. Copyright remains with the original publisher (github.com).

📺 Livestream: Ask the Experts: Evaluating Agent Skills SkillEvaluator checks AI agent skills and measures their effect on task results: start with quality checks, then compare runs with and without a skill. Agent skills are folders of instructions and supporting files defined by the Agent Skills specification. SkillEvaluator is part of the NVIDIA Verified Skills pipeline. Three ways in, one CLI, same results. | 1. Run the CLI directly | 2. Add it to your repo via CI | 3. Wire it to your agent | |---|---|---| | Install (or uv tool install ): pip install skillevaluatorRun all Tier 1 checks, no

Backlinks

Appeared in 1 briefing

Related

Shares tags: ai/agents · cerebro/signal

Also from github.com