evals
Create your eval

02 — Runs · v2 · jettygrowthteam · auto-evolved runbook (weakest-axis targeting)

claude-code
anthropic/claude-haiku-5.5

claude-code driving anthropic/claude-haiku-5.5 through OpenRouter, 5 hill-climb rounds from the v1 runbook.

Judge, best round
28/40
round v1 (agent's pick)
Self-score
29/40
inflation +1
Runs
5
$0.14 metered
claude-code · Haiku 5.5 best round
best round v1 · 10ad0a5a

Self-score vs judge, by axis

Best round v1, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican reads clearly: a long orange beak, a large pink pouch, a white body, and a gray wing stretched toward the handlebars, though the neck and body shapes are somewhat crude. The bicycle has spoked wheels, a frame, a seat, a crank and a chain, but the frame geometry is odd: the rear stays sit oddly low, the fork is thin, and the handlebars attach awkwardly. The bird sits on the seat and its legs reach the pedals convincingly, and the clean flat colors give a pleasant overall look.

Score by round

Out of 40. Each round starts from the previous round's best SVG. Dashed line: the 28/40 pass threshold.

self-scorejudgepass ≥ 28

5 drawings, oldest first.

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round. Verdicts are derived (code checks on the stored SVG and judge ≥ 28/40); see Runs.

claude-code · Haiku 5.5 round v1
v1 · best failjudge 28 · self 29 10ad0a5a
claude-code · Haiku 5.5 round v2
v2 passjudge 28.8 · self 29 88a41720
claude-code · Haiku 5.5 round v3
v3 passjudge 28.2 · self 29 2bb59acd
claude-code · Haiku 5.5 round v4
v4 failjudge 26.2 · self 29 6dbc05e0
claude-code · Haiku 5.5 round v5
v5 failjudge 26.2 · self 27 eefa700a

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalVerdictJudge spreadCostMinutesTrajectory
v17self 76.8self 87.3self 76.8self 72928fail1.5$0.03*2.310ad0a5a
v27.5self 77self 87.3self 77self 72928.8pass0.5$0.04*1.788a41720
v37.2self 77self 87.2self 76.8self 72928.2pass2.5$0.02*1.42bb59acd
v47self 86self 86.7self 66.5self 72926.2fail0.5$0.02*1.36dbc05e0
v56.8self 76.5self 86.3self 66.5self 62726.2fail1$0.02*1.3eefa700a

Ready to stop guessing if your outputs are good?

Create your eval Book a 15-minute walkthrough
Connect your agent to Jetty →