evals
Create your eval

02 — Runs · v2 · jettygrowthteam · auto-evolved runbook (weakest-axis targeting)

opencode
mistralai/mistral-large-4-0

opencode driving mistralai/mistral-large-4-0 through OpenRouter, 5 hill-climb rounds from the v1 runbook.

Judge, best round
28.8/40
round v2 (agent's pick)
Self-score
36/40
inflation +7.2
Runs
5
not metered
opencode · Mistral Large 4 best round
best round v2 · cec17694

Self-score vs judge, by axis

Best round v2, 0–10 per axis

agent self-scoreexternal judge

Judge: The pelican reads clearly, with a big orange throat pouch, white body, a wing reaching forward to the handlebars and orange legs with feet on the pedals; the neck is a thin, stiff stick and the head is small. The bicycle has spoked wheels, a red frame, handlebars and a crank, but there is no visible seat and the geometry is odd: the seat stay seems to run to the rear hub, and the down tube and pedal placement are confusing. The flat-shaded style is clean, with speed lines and a ground shadow.

Score by round

Out of 40. Each round starts from the previous round's best SVG. Dashed line: the 28/40 pass threshold.

self-scorejudgepass ≥ 28

Failed attempts (retried): 9553a199.

5 drawings, oldest first.

Click a drawing to open it in the head-to-head viewer. The outlined card is the agent's best round. Verdicts are derived (code checks on the stored SVG and judge ≥ 28/40); see Runs.

opencode · Mistral Large 4 round v1
v1 failjudge 27.7 · self 34 508c1c1a
opencode · Mistral Large 4 round v2
v2 · best passjudge 28.8 · self 36 cec17694
opencode · Mistral Large 4 round v3
v3 passjudge 29.2 · self 34 c8da2786
opencode · Mistral Large 4 round v4
v4 passjudge 30.3 · self 35 c52d8e82
opencode · Mistral Large 4 round v5
v5 passjudge 30 · self 36 0bcb4a6c

Scores per round

RoundPelicanBicycleCompositionPolishSelf totalJudge totalVerdictJudge spreadCostMinutesTrajectory
v17.5self 96.2self 97self 87self 83427.7fail0.5not metered4.7508c1c1a
v27.7self 96.3self 97.3self 97.5self 93628.8pass0.5not metered5.4cec17694
v37.8self 96.3self 87.7self 97.3self 83429.2pass1.5not metered5.3c8da2786
v47.8self 97.3self 97.5self 97.7self 83530.3pass1.5not metered5.8c52d8e82
v57.5self 97.3self 97.7self 97.5self 93630pass1not metered7.80bcb4a6c

Ready to stop guessing if your outputs are good?

Create your eval Book a 15-minute walkthrough
Connect your agent to Jetty →