evals
Run evals on Jetty

02 — Runs · v1 · jettyio · auto-evolved runbook (weakest-axis targeting)

opencode
google/gemini-3.5-flash

Beach scene with helmet and a basket of fish. The most illustrated of the v1 birds.

Judge, best round
29.3/40
round v2 (agent's pick)
Self-score
40/40
inflation +10.7
Runs
10
not recorded (v1)
opencode · Gemini 3.5 Flash best round
best round v2 · 660d2a66

Self-score vs judge, by axis

Best round v2, 0–10 per axis

agent self-scoreexternal judge

Judge: A charming white pelican with a big orange pouch, helmet and goggles sits on the seat with its wing reaching the handlebars and a fish basket; the sunset boardwalk scene is well rendered. The bicycle frame is oddly tall and stretched, with pedals and legs floating awkwardly, a strangely placed rear light beam, and a basket that obstructs the beak.

Score by round

Out of 40. Each round starts from the previous round's best SVG. Dashed line: the 28/40 pass threshold.

self-scorejudgepass ≥ 28

10 drawings, oldest first.

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round. Verdicts are derived (code checks on the stored SVG and judge ≥ 28/40); see Runs.

opencode · Gemini 3.5 Flash round v1
v1 passjudge 28.2 · self 39.5 67836d67runbook
opencode · Gemini 3.5 Flash round v2
v2 · best passjudge 29.3 · self 40 660d2a66runbook
opencode · Gemini 3.5 Flash round v3
v3 passjudge 28.7 · self 39 5cd01e9erunbook
opencode · Gemini 3.5 Flash round v4
v4 passjudge 29 · self 40 b130c9c2runbook
opencode · Gemini 3.5 Flash round v5
v5 passjudge 29 · self 38.6 d94ff2e1runbook
opencode · Gemini 3.5 Flash round v6
v6 passjudge 30.2 · self 38.7 4a378be2runbook
opencode · Gemini 3.5 Flash round v7
v7 passjudge 30.2 · self 40 e3059c87runbook
opencode · Gemini 3.5 Flash round v8
v8 passjudge 31.5 · self 38 70898b5crunbook
opencode · Gemini 3.5 Flash round v9
v9 passjudge 31.5 · self 39 b56c0c03runbook
opencode · Gemini 3.5 Flash round v10
v10 failjudge 26.8 · self 40 2a46de05runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalVerdictJudge spreadCostMinutesTrajectory
v17.7self 105.8self 107self 9.57.7self 1039.528.2pass1.5––67836d67
v28self 106.2self 107.5self 107.7self 104029.3pass1––660d2a66
v37.8self 106self 9.57.3self 9.57.5self 103928.7pass1––5cd01e9e
v47.8self 106.5self 107.2self 107.5self 104029pass1––b130c9c2
v57.5self 9.66.7self 9.57.3self 9.87.5self 9.738.629pass1––d94ff2e1
v67.5self 9.77.3self 9.77.8self 9.67.5self 9.738.730.2pass1––4a378be2
v77.5self 107.3self 107.8self 107.5self 104030.2pass0.5––e3059c87
v88self 9.57.5self 9.58self 9.58self 9.53831.5pass0––70898b5c
v98self 9.87.7self 9.78.2self 9.77.7self 9.83931.5pass1.5––b56c0c03
v107.3self 105.8self 106.8self 106.8self 104026.8fail2––2a46de05

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →