evals
Run evals on Jetty

02 — Runs · v2 · jettygrowthteam · auto-evolved runbook (weakest-axis targeting)

claude-code
anthropic/claude-opus-5.5

claude-code driving anthropic/claude-opus-5.5 through OpenRouter, 5 hill-climb rounds from the v1 runbook.

Judge, best round
32.8/40
round v3 (agent's pick)
Self-score
36/40
inflation +3.2
Runs
5
$4.55 metered
claude-code · Opus 5.5 best round
best round v3 · 35c47f4e

Self-score vs judge, by axis

Best round v3, 0–10 per axis

agent self-scoreexternal judge

Judge: A clearly readable white pelican with a large orange throat pouch, crest and eye. It sits on the saddle, its feet reach the pedals and its dark wingtips grip the handlebars. The bicycle is well formed, with spoked wheels, a chainring and a chain, but the frame geometry is slightly odd: the seat tube meets the chainring off-center and the fork is thin. There are minor issues too: the legs are stiff and awkwardly jointed, the body overlaps the saddle, and the pouch sits oddly detached from the upper beak.

Score by round

Out of 40. Each round starts from the previous round's best SVG. Dashed line: the 28/40 pass threshold.

self-scorejudgepass ≥ 28

5 drawings, oldest first.

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round. Verdicts are derived (code checks on the stored SVG and judge ≥ 28/40); see Runs.

claude-code · Opus 5.5 round v1
v1 passjudge 32.7 · self 35 5361e30arunbook
claude-code · Opus 5.5 round v2
v2 passjudge 33 · self 35 ba932f3erunbook
claude-code · Opus 5.5 round v3
v3 · best passjudge 32.8 · self 36 35c47f4erunbook
claude-code · Opus 5.5 round v4
v4 passjudge 33 · self 36 2e046a89runbook
claude-code · Opus 5.5 round v5
v5 passjudge 33.3 · self 35 0e41c0a0runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalVerdictJudge spreadCostMinutesTrajectory
v18.5self 97.7self 98.5self 98self 83532.7pass0.5$0.874.35361e30a
v28.5self 98self 98.5self 88self 93533pass0$0.884.6ba932f3e
v38.5self 98self 98.3self 108self 83632.8pass0.5$0.834.835c47f4e
v48.5self 98self 98.5self 98self 93633pass0$0.874.52e046a89
v58.5self 98self 98.5self 88.3self 93533.3pass0.5$1.106.40e41c0a0

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →