evals
Run evals on Jetty

02 — Runs · v2 · jettygrowthteam · auto-evolved runbook (weakest-axis targeting)

opencode
openai/gpt-5.6-terra

opencode driving openai/gpt-5.6-terra through OpenRouter, 5 hill-climb rounds from the v1 runbook.

Judge, best round
28/40
round v1 (agent's pick)
Self-score
38/40
inflation +10
Runs
5
not metered
opencode · GPT-5.6 Terra best round
best round v1 · ccbdd583

Self-score vs judge, by axis

Best round v1, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican reads well thanks to the big orange beak with a throat pouch, eye, and head crest, and the pleasant flat palette gives a clean cartoon look. However, the body is an egg blob with an odd notched outline, and the wing is a flat slab reaching an ambiguous handlebar; the frame geometry is muddled, the chain/crank connection is awkward, and the legs overlap the rear wheel clumsily.

Score by round

Out of 40. Each round starts from the previous round's best SVG. Dashed line: the 28/40 pass threshold.

self-scorejudgepass ≥ 28

5 drawings, oldest first.

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round. Verdicts are derived (code checks on the stored SVG and judge ≥ 28/40); see Runs.

opencode · GPT-5.6 Terra round v1
v1 · best passjudge 28 · self 38 ccbdd583runbook
opencode · GPT-5.6 Terra round v2
v2 failjudge 27.5 · self 37.2 699fefderunbook
opencode · GPT-5.6 Terra round v3
v3 failjudge 27.2 · self 38 ce858eafrunbook
opencode · GPT-5.6 Terra round v4
v4 failjudge 27.3 · self 37.5 9fe62cbbrunbook
opencode · GPT-5.6 Terra round v5
v5 passjudge 29.8 · self 38 de112455runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalVerdictJudge spreadCostMinutesTrajectory
v17.2self 106.5self 97.2self 107.2self 93828pass3.5not metered1.4ccbdd583
v27self 96.5self 9.57self 9.57self 9.237.227.5fail0not metered1.7699fefde
v38self 9.56.5self 9.55.3self 9.57.3self 9.53827.2fail2not metered1.5ce858eaf
v48self 9.56.3self 9.55.5self 9.57.5self 937.527.3fail1not metered1.49fe62cbb
v58self 106.8self 107.3self 97.7self 93829.8pass1.5not metered1.5de112455

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →