evals
Run evals on Jetty
v1 · May 2026 · jettyio · auto-evolved runbook (weakest-axis targeting)

claude-code · Opus 4.7

Same agent as the reference, model swapped to Opus. Cleaner anatomy, plateaued at 36/40 on its own rubric.

agent claude-code · model claude-opus-4-7

Judge, best round
28.7/40
round v3
Self-score, best round
36/40
inflation +7.3
Rounds
10
Jetty trajectories
claude-code · Opus 4.7 best round
best round v3 · d4a107dc ↗

Self-score vs judge, by axis

Best round v3, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican reads clearly, with a big orange pouched beak, a curved neck and white plumage, and the scene looks polished with sky, sun and grass. The wing reaching to the handlebars and the feet on the pedals sell the riding pose, but the bike frame is odd: the down tube runs to the front hub instead of the head tube, the pedals and cranks are ambiguous, and the wheels are cropped at the bottom.

Score by round

Out of 40. Each round starts from the previous round's best SVG.

self-scorejudge

Every round

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round.

claude-code · Opus 4.7 round v1
v1judge 29 · self 33 c3121188 ↗runbook
claude-code · Opus 4.7 round v2
v2judge 29.3 · self 35 cb2a7f37 ↗runbook
claude-code · Opus 4.7 round v3
v3 · bestjudge 28.7 · self 36 d4a107dc ↗runbook
claude-code · Opus 4.7 round v4
v4judge 29.7 · self 32 8ec2e90c ↗runbook
claude-code · Opus 4.7 round v5
v5judge 28 · self 34.5 4160dcf1 ↗runbook
claude-code · Opus 4.7 round v6
v6judge 27.3 · self 36 4848f8a3 ↗runbook
claude-code · Opus 4.7 round v7
v7judge 27.5 · self 33 df18c780 ↗runbook
claude-code · Opus 4.7 round v8
v8judge 27 · self 33 20f46c4d ↗runbook
claude-code · Opus 4.7 round v9
v9judge 28 · self 33.5 4897cbca ↗runbook
claude-code · Opus 4.7 round v10
v10judge 27.7 · self 34 38634df1 ↗runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalJudge spreadMinutesTrajectory
v17self 87.5self 87.5self 97self 833290–c3121188 ↗
v28self 96.5self 97.5self 97.3self 83529.30.5–cb2a7f37 ↗
v37.5self 96.3self 97.7self 97.2self 93628.71.5–d4a107dc ↗
v47.5self 87self 87.7self 87.5self 83229.70.5–8ec2e90c ↗
v57.5self 8.56self 97.5self 8.57self 8.534.5280–4160dcf1 ↗
v67.5self 9.55.8self 97self 8.57self 93627.30.5–4848f8a3 ↗
v77.3self 85.8self 87.3self 107self 73327.51–df18c780 ↗
v87.3self 85.7self 87self 87self 933271–20f46c4d ↗
v97.7self 95.8self 87.5self 87self 8.533.5280–4897cbca ↗
v107.5self 8.56.2self 97self 8.57self 83427.70.5–38634df1 ↗

Want this kind of eval for your own agents?

Every run on this site is a Jetty runbook: versioned instructions, a pinned sandbox, and a trajectory you can inspect. Point Jetty at your task and get the same receipts.