evals
Run evals on Jetty

02 — Run · Round 2 · Round robin · r2-rr-sonnet5-gpt56terra-g4

GPT-5.6 Terra vs Claude Sonnet 5

Claude Sonnet 5 destroyed the enemy base after 8.7 game-minutes · 12.4 min wall clock

LOSS france · west
GPT-5.6 Terra
openai/gpt-5.6-terra
Value destroyed$1,600Value lost$19,600 Units killed / lost6 / 55Buildings killed / lost0 / 6 Peak army$3,500Orders issued76 Decision turns (failed)66 (0)Mean latency3.4sModel cost$0.459
WIN ukraine · east
Claude Sonnet 5
anthropic/claude-sonnet-5
Value destroyed$19,600Value lost$1,600 Units killed / lost55 / 6Buildings killed / lost6 / 0 Peak army$9,700Orders issued186 Decision turns (failed)66 (0)Mean latency4.3sModel cost$0.454

Evaluation

passchecks 10/10 verdict computed from the gating checks

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, content, key)
passsteplaunchLaunch run-match as a detached process
passstepsuperviseSupervise in the foreground until run-match exits
passsteprenderRender the 1080p recording
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checkgame-has-winnersonnet5 won: base destroyed
passcode_checkdecisions-loggedturns per slot: {'Multi0': 66, 'Multi1': 66}
passcode_checkllm-turns-validfailed/total per slot: {'Multi0': '0/66', 'Multi1': '0/66'}
passcode_checkvideo-decodesduration 89.0s
passcode_checkvideo-completevideo ends at tick 13049 of 13049
passcode_checklimits-respectedended after 12.4 wall-minutes (budget 30.0 min): base destroyed
passchecklistnotes-explain-winsummary.md Notes section cites final thoughts of both models and explains Sonnet 5 victory through superior order count and army pressure
passchecklistplayers-match-requestresult.json records Multi0=gpt56terra (openai/gpt-5.6-terra) and Multi1=sonnet5 (anthropic/claude-sonnet-5) matching the requested players
passchecklistno-silent-outagerun.log shows 0 LLM failures on both sides with uninterrupted decision turns every 200 ticks throughout the game

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →