evals
Run evals on Jetty
v1 · May 2026 · jettyio · auto-evolved runbook (weakest-axis targeting)

gemini-cli · Gemini 3.5 Flash

Fastest v1 runner. Flash grades itself generously: 40/40 is its ceiling, not a verdict.

agent gemini-cli · model gemini-3.5-flash

Judge, best round
29.8/40
round v1
Self-score, best round
40/40
inflation +10.2
Rounds
10
Jetty trajectories
gemini-cli · Gemini 3.5 Flash best round
best round v1 · f5cd6a31 ↗

Self-score vs judge, by axis

Best round v1, 0–10 per axis

agent self-scoreexternal judge

Judge: A white pelican with an orange beak and throat pouch sits on a well-rendered spoked bicycle against an attractive retro sunset, with wing reaching the handlebar and feet near the pedals. Defects: the frame geometry is odd (seat tube and top tube join awkwardly, the fork is a single straight tube, and the head tube is missing), the pouch is oversized and blob-like, one foot floats oddly by the rear wheel, and the chain routing is simplified.

Score by round

Out of 40. Each round starts from the previous round's best SVG.

self-scorejudge

Every round

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round.

gemini-cli · Gemini 3.5 Flash round v1
v1 · bestjudge 29.8 · self 40 f5cd6a31 ↗runbook
gemini-cli · Gemini 3.5 Flash round v2
v2judge 31 · self 38.5 c990e7c4 ↗runbook
gemini-cli · Gemini 3.5 Flash round v3
v3judge 29.3 · self 38.4 5d360721 ↗runbook
gemini-cli · Gemini 3.5 Flash round v4
v4judge 31.7 · self 40 4ed5de35 ↗runbook
gemini-cli · Gemini 3.5 Flash round v5
v5judge 32.3 · self 39.5 a652e4e3 ↗runbook
gemini-cli · Gemini 3.5 Flash round v6
v6judge 30.5 · self 39.5 eca90d64 ↗runbook
gemini-cli · Gemini 3.5 Flash round v7
v7judge 31 · self 38.7 f08684e3 ↗runbook
gemini-cli · Gemini 3.5 Flash round v8
v8judge 31.7 · self 40 ce2de30f ↗runbook
gemini-cli · Gemini 3.5 Flash round v9
v9judge 32 · self 37.5 4e122677 ↗runbook
gemini-cli · Gemini 3.5 Flash round v10
v10judge 31.2 · self 39.2 24091968 ↗runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalJudge spreadMinutesTrajectory
v17.3self 107self 107.5self 108self 104029.80.5–f5cd6a31 ↗
v28self 9.57.2self 9.57.8self 9.58self 1038.5310–c990e7c4 ↗
v37.5self 9.86.8self 9.57.3self 9.57.7self 9.638.429.32–5d360721 ↗
v47.7self 108self 107.8self 108.2self 104031.72–4ed5de35 ↗
v57.8self 9.98.3self 9.87.8self 9.98.3self 9.939.532.32–a652e4e3 ↗
v67.5self 9.88self 9.97self 9.88self 1039.530.50–eca90d64 ↗
v77.3self 9.78.2self 9.77.5self 9.68self 9.738.7311.5–f08684e3 ↗
v87.7self 108self 108self 108self 104031.71.5–ce2de30f ↗
v97.8self 9.58.3self 97.7self 9.58.2self 9.537.5322–4e122677 ↗
v107.7self 9.88.2self 9.87.3self 9.88self 9.839.231.21.5–24091968 ↗

Want this kind of eval for your own agents?

Every run on this site is a Jetty runbook: versioned instructions, a pinned sandbox, and a trajectory you can inspect. Point Jetty at your task and get the same receipts.