evals
Run evals on Jetty

02 — Runs · v1 · jettyio · auto-evolved runbook (weakest-axis targeting)

claude-code
claude-opus-4-7

Same agent as the reference, model swapped to Opus. Cleaner anatomy, plateaued at 36/40 on its own rubric.

Judge, best round
28.7/40
round v3 (agent's pick)
Self-score
36/40
inflation +7.3
Runs
10
not recorded (v1)
claude-code · Opus 4.7 best round
best round v3 · d4a107dc

Self-score vs judge, by axis

Best round v3, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican reads clearly, with a big orange pouched beak, a curved neck and white plumage, and the scene looks polished with sky, sun and grass. The wing reaching to the handlebars and the feet on the pedals sell the riding pose, but the bike frame is odd: the down tube runs to the front hub instead of the head tube, the pedals and cranks are ambiguous, and the wheels are cropped at the bottom.

Score by round

Out of 40. Each round starts from the previous round's best SVG. Dashed line: the 28/40 pass threshold.

self-scorejudgepass ≥ 28

10 drawings, oldest first.

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round. Verdicts are derived (code checks on the stored SVG and judge ≥ 28/40); see Runs.

claude-code · Opus 4.7 round v1
v1 passjudge 29 · self 33 c3121188runbook
claude-code · Opus 4.7 round v2
v2 passjudge 29.3 · self 35 cb2a7f37runbook
claude-code · Opus 4.7 round v3
v3 · best passjudge 28.7 · self 36 d4a107dcrunbook
claude-code · Opus 4.7 round v4
v4 passjudge 29.7 · self 32 8ec2e90crunbook
claude-code · Opus 4.7 round v5
v5 passjudge 28 · self 34.5 4160dcf1runbook
claude-code · Opus 4.7 round v6
v6 failjudge 27.3 · self 36 4848f8a3runbook
claude-code · Opus 4.7 round v7
v7 failjudge 27.5 · self 33 df18c780runbook
claude-code · Opus 4.7 round v8
v8 failjudge 27 · self 33 20f46c4drunbook
claude-code · Opus 4.7 round v9
v9 passjudge 28 · self 33.5 4897cbcarunbook
claude-code · Opus 4.7 round v10
v10 failjudge 27.7 · self 34 38634df1runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalVerdictJudge spreadCostMinutesTrajectory
v17self 87.5self 87.5self 97self 83329pass0––c3121188
v28self 96.5self 97.5self 97.3self 83529.3pass0.5––cb2a7f37
v37.5self 96.3self 97.7self 97.2self 93628.7pass1.5––d4a107dc
v47.5self 87self 87.7self 87.5self 83229.7pass0.5––8ec2e90c
v57.5self 8.56self 97.5self 8.57self 8.534.528pass0––4160dcf1
v67.5self 9.55.8self 97self 8.57self 93627.3fail0.5––4848f8a3
v77.3self 85.8self 87.3self 107self 73327.5fail1––df18c780
v87.3self 85.7self 87self 87self 93327fail1––20f46c4d
v97.7self 95.8self 87.5self 87self 8.533.528pass0––4897cbca
v107.5self 8.56.2self 97self 8.57self 83427.7fail0.5––38634df1

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →