evals
Run evals on Jetty

02 — Run · Round 1 · Round robin · rr-sonnet5-gpt56terra-g2

GPT-5.6 Terra vs Claude Sonnet 5

Claude Sonnet 5 destroyed the enemy base after 16.8 game-minutes · 22.4 min wall clock

LOSS ukraine · west
GPT-5.6 Terra
openai/gpt-5.6-terra
Value destroyed$29,700Value lost$48,800 Units killed / lost41 / 87Buildings killed / lost4 / 16 Peak army$7,000Orders issued162 Decision turns (failed)126 (0)Mean latency4.2sModel cost$1.063
WIN germany · east
Claude Sonnet 5
anthropic/claude-sonnet-5
Value destroyed$48,800Value lost$29,700 Units killed / lost87 / 41Buildings killed / lost16 / 4 Peak army$8,900Orders issued385 Decision turns (failed)126 (0)Mean latency4.6sModel cost$1.261

Evaluation

passchecks 7/7 verdict computed from the gating checks

Round-1 run: written before the runbook moved to evals v2, so these are the older self-reported checks.

StatusKindCheckDetail
passcode_checkresult-jsonresult json
passcode_checkhas-winnerhas winner
passcode_checkdecisions-loggeddecisions logged
passcode_checkreplay-savedreplay saved
passcode_checkvideo-renderedvideo rendered
passcode_checkno-llm-outageno llm outage
passcode_checkvideo-completevideo complete

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →