evals
Run evals on Jetty

02 — Run · Round 2 · Round robin · r2-rr-gpt56terra-gpt56luna-g4

GPT-5.6 Luna vs GPT-5.6 Terra

GPT-5.6 Terra destroyed the enemy base after 6.1 game-minutes · 7.8 min wall clock

LOSS germany · west
GPT-5.6 Luna
openai/gpt-5.6-luna
Value destroyed$3,100Value lost$10,800 Units killed / lost18 / 17Buildings killed / lost1 / 6 Peak army$1,900Orders issued92 Decision turns (failed)46 (0)Mean latency3.1sModel cost$0.036
WIN france · east
GPT-5.6 Terra
openai/gpt-5.6-terra
Value destroyed$10,800Value lost$3,100 Units killed / lost17 / 18Buildings killed / lost6 / 1 Peak army$4,000Orders issued55 Decision turns (failed)46 (0)Mean latency3.3sModel cost$0.320

Evaluation

passchecks 10/10 verdict computed from the gating checks

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, content, key)
passsteplaunchLaunch run-match as a detached process
passstepsuperviseSupervise in the foreground until run-match exits
passsteprenderRender the 1080p recording
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checkgame-has-winnergpt56terra won: base destroyed
passcode_checkdecisions-loggedturns per slot: {'Multi0': 46, 'Multi1': 46}
passcode_checkllm-turns-validfailed/total per slot: {'Multi0': '0/46', 'Multi1': '0/46'}
passcode_checkvideo-decodesduration 63.2s
passcode_checkvideo-completevideo ends at tick 9171 of 9171
passcode_checklimits-respectedended after 7.8 wall-minutes (budget 30.0 min): base destroyed
passchecklistnotes-explain-winNotes section explains GPT-5.6 Terra win by base destruction, citing both models final thoughts and economic strategy
passchecklistplayers-match-requestresult.json shows gpt56luna as Multi0 (west) and gpt56terra as Multi1 (east), matching the requested parameters
passchecklistno-silent-outagerun.log shows continuous decision turns from tick 201 to 9001 with zero LLM failures for either model across 46 calls each

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →