evals
Run evals on Jetty

02 — Runs · v2 · jettygrowthteam · auto-evolved runbook (weakest-axis targeting)

claude-code
anthropic/claude-sonnet-5

claude-code driving anthropic/claude-sonnet-5 through OpenRouter, 5 hill-climb rounds from the v1 runbook.

Judge, best round
25.3/40
round v4 (agent's pick)
Self-score
36/40
inflation +10.7
Runs
5
$4.57 metered
claude-code · Sonnet 5 best round
best round v4 · 240351f2

Self-score vs judge, by axis

Best round v4, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican reads well, with a white body, a long neck, an orange throat pouch and orange legs reaching toward the pedals, though the gray arm-like wing looks odd. The bicycle frame is structurally confused: the front wheel has no fork connecting it to the frame, the handlebar area is a tangle, and the body floats above an unclear seat. The clean gradient sky and speed lines are nice, but these joins in the frame and wing look glitchy.

Score by round

Out of 40. Each round starts from the previous round's best SVG. Dashed line: the 28/40 pass threshold.

self-scorejudgepass ≥ 28

5 drawings, oldest first.

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round. Verdicts are derived (code checks on the stored SVG and judge ≥ 28/40); see Runs.

claude-code · Sonnet 5 round v1
v1 failjudge 26.5 · self 28 ea416761runbook
claude-code · Sonnet 5 round v2
v2 failjudge 27.3 · self 34 b77ea720runbook
claude-code · Sonnet 5 round v3
v3 failjudge 27 · self 34 6e98127arunbook
claude-code · Sonnet 5 round v4
v4 · best failjudge 25.3 · self 36 240351f2runbook
claude-code · Sonnet 5 round v5
v5 failjudge 26.2 · self 36 1925c665runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalVerdictJudge spreadCostMinutesTrajectory
v17self 76.2self 86.5self 76.8self 62826.5fail1$0.805.7ea416761
v27.2self 86self 87self 97.2self 93427.3fail1$0.965.9b77ea720
v37.3self 96self 86.8self 96.8self 83427fail1.5$0.745.66e98127a
v47.5self 95self 96.5self 86.3self 103625.3fail1$0.816.4240351f2
v57.3self 95.3self 96.8self 96.7self 93626.2fail0.5$1.2611.81925c665

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →