evals
Run evals on Jetty

02 — Run · Round 1 · vs OpenRA AI · ladder-gpt56terra-beginner-g2

OpenRA AI (Beginner) vs GPT-5.6 Terra

OpenRA AI (Beginner) won on score at the time limit (35,200 to 22,250) after 20.0 game-minutes · 27.5 min wall clock

WIN ukraine · west
OpenRA AI (Beginner)
openra/beginner-ai
Value destroyed$26,500Value lost$6,550 Units killed / lost93 / 32Buildings killed / lost3 / 3 Peak army$0Orders issued62 Decision turns (failed)0 (0)Mean latency–Model cost$0.000
LOSS england · east
GPT-5.6 Terra
openai/gpt-5.6-terra
Value destroyed$6,550Value lost$26,500 Units killed / lost32 / 93Buildings killed / lost3 / 3 Peak army$3,200Orders issued137 Decision turns (failed)151 (0)Mean latency3.7sModel cost$1.183

Evaluation

passchecks 7/7 verdict computed from the gating checks

Round-1 run: written before the runbook moved to evals v2, so these are the older self-reported checks.

StatusKindCheckDetail
passcode_checkresult-jsonresult json
passcode_checkhas-winnerhas winner
passcode_checkdecisions-loggeddecisions logged
passcode_checkreplay-savedreplay saved
passcode_checkvideo-renderedvideo rendered
passcode_checkno-llm-outageno llm outage
passcode_checkvideo-completevideo complete

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →