evals
Run evals on Jetty

02 — Runs · v2 · jettygrowthteam · auto-evolved runbook (weakest-axis targeting)

opencode
google/gemini-3.8-flash

opencode driving google/gemini-3.8-flash through OpenRouter, 1 hill-climb rounds from the v1 runbook.

Judge, best round
32.8/40
round v1 (agent's pick)
Self-score
38.5/40
inflation +5.7
Runs
1
not metered
opencode · Gemini 3.8 Flash best round
best round v1 · 225e57cd

Self-score vs judge, by axis

Best round v1, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican is strong: a long orange bill with a large gradient pouch, a white body, and dark wingtips gripping the handlebar. The scene is attractive, with sky, sun, road and a lighthouse. The bicycle has odd geometry: a strange curved rear fender and stay, a chainguard that obscures the crank, and a seat hidden under the body. The legs reach the pedals but look awkward and stiff.

Score by round

Out of 40. Each round starts from the previous round's best SVG. Dashed line: the 28/40 pass threshold.

self-scorejudgepass ≥ 28

Stopped after round 1. Two attempts failed on OpenRouter errors mid-run (8a7cebda: 502 provider_unavailable; 6a4f0590: 504 upstream idle timeout), so per the benchmark rule (two infrastructure failures) the lineage was dropped.

1 drawings, oldest first.

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round. Verdicts are derived (code checks on the stored SVG and judge ≥ 28/40); see Runs.

opencode · Gemini 3.8 Flash round v1
v1 · best passjudge 32.8 · self 38.5 225e57cdrunbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalVerdictJudge spreadCostMinutesTrajectory
v18.7self 9.57.7self 9.58self 108.5self 9.538.532.8pass0.5not metered11.7225e57cd

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →