evals
Run evals on Jetty
v2 · Sep 2026 · jettygrowthteam · auto-evolved runbook (weakest-axis targeting)

opencode · GPT-5.6 Terra

opencode driving openai/gpt-5.6-terra through OpenRouter, 5 hill-climb rounds from the v1 runbook.

agent opencode · model openai/gpt-5.6-terra

Judge, best round
28/40
round v1
Self-score, best round
38/40
inflation +10
Rounds
5
~$7.50 est. spend
opencode · GPT-5.6 Terra best round
best round v1 · ccbdd583 ↗

Self-score vs judge, by axis

Best round v1, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican reads well thanks to the big orange beak with a throat pouch, eye, and head crest, and the pleasant flat palette gives a clean cartoon look. However, the body is an egg blob with an odd notched outline, and the wing is a flat slab reaching an ambiguous handlebar; the frame geometry is muddled, the chain/crank connection is awkward, and the legs overlap the rear wheel clumsily.

Score by round

Out of 40. Each round starts from the previous round's best SVG.

self-scorejudge

Every round

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round.

opencode · GPT-5.6 Terra round v1
v1 · bestjudge 28 · self 38 ccbdd583 ↗runbook
opencode · GPT-5.6 Terra round v2
v2judge 27.5 · self 37.2 699fefde ↗runbook
opencode · GPT-5.6 Terra round v3
v3judge 27.2 · self 38 ce858eaf ↗runbook
opencode · GPT-5.6 Terra round v4
v4judge 27.3 · self 37.5 9fe62cbb ↗runbook
opencode · GPT-5.6 Terra round v5
v5judge 29.8 · self 38 de112455 ↗runbook

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalJudge spreadMinutesTrajectory
v17.2self 106.5self 97.2self 107.2self 938283.51.4ccbdd583 ↗
v27self 96.5self 9.57self 9.57self 9.237.227.501.7699fefde ↗
v38self 9.56.5self 9.55.3self 9.57.3self 9.53827.221.5ce858eaf ↗
v48self 9.56.3self 9.55.5self 9.57.5self 937.527.311.49fe62cbb ↗
v58self 106.8self 107.3self 97.7self 93829.81.51.5de112455 ↗

Want this kind of eval for your own agents?

Every run on this site is a Jetty runbook: versioned instructions, a pinned sandbox, and a trajectory you can inspect. Point Jetty at your task and get the same receipts.