evals
Run evals on Jetty

02 — Run · Round 2 · Round robin · r2-rr-jev-gpt56terra-g2

GPT-5.6 Terra vs Jev Router

GPT-5.6 Terra destroyed the enemy base after 9.5 game-minutes · 15.2 min wall clock

WIN russia · west
GPT-5.6 Terra
openai/gpt-5.6-terra
Value destroyed$8,300Value lost$7,300 Units killed / lost25 / 55Buildings killed / lost4 / 0 Peak army$6,750Orders issued96 Decision turns (failed)72 (0)Mean latency3.8sModel cost$0.570
LOSS russia · east
Jev Router
typesafe/jev-router
Value destroyed$7,300Value lost$8,300 Units killed / lost55 / 25Buildings killed / lost0 / 4 Peak army$2,000Orders issued112 Decision turns (failed)72 (0)Mean latency5.3sModel cost$0.166

Evaluation

passchecks 10/10 verdict computed from the gating checks

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, content, key)
passsteplaunchLaunch run-match as a detached process
passstepsuperviseSupervise in the foreground until run-match exits
passsteprenderRender the 1080p recording
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checkgame-has-winnergpt56terra won: base destroyed
passcode_checkdecisions-loggedturns per slot: {'Multi0': 72, 'Multi1': 72}
passcode_checkllm-turns-validfailed/total per slot: {'Multi0': '0/72', 'Multi1': '0/72'}
passcode_checkvideo-decodesduration 96.7s
passcode_checkvideo-completevideo ends at tick 14201 of 14201
passcode_checklimits-respectedended after 15.2 wall-minutes (budget 30.0 min): base destroyed
passchecklistnotes-explain-winNotes section cites final thoughts from both models and explains Terras economic dominance and JevRouters loss of economy
passchecklistplayers-match-requestresult.json records gpt56terra (openai/gpt-5.6-terra) as Multi0 and jev (typesafe/jev-router) as Multi1 matching --a and --b
passchecklistno-silent-outagerun.log shows 72 clean decision turns per player with 0 failures and no gaps; all turns logged at 1.6s-8.5s latency

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →