evals
Run evals on Jetty

02 — Run · Round 2 · Round robin · r2-rr-sonnet5-gpt56luna-g4

GPT-5.6 Luna vs Claude Sonnet 5

Claude Sonnet 5 destroyed the enemy base after 5.4 game-minutes · 6.7 min wall clock

LOSS france · west
GPT-5.6 Luna
openai/gpt-5.6-luna
Value destroyed$0Value lost$9,500 Units killed / lost0 / 15Buildings killed / lost0 / 5 Peak army$2,300Orders issued58 Decision turns (failed)41 (0)Mean latency3.0sModel cost$0.031
WIN russia · east
Claude Sonnet 5
anthropic/claude-sonnet-5
Value destroyed$9,600Value lost$100 Units killed / lost16 / 1Buildings killed / lost5 / 0 Peak army$5,100Orders issued111 Decision turns (failed)41 (1)Mean latency4.2sModel cost$0.265

Evaluation

passchecks 10/10 verdict computed from the gating checks

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, content, key)
passsteplaunchLaunch run-match as a detached process
passstepsuperviseSupervise in the foreground until run-match exits
passsteprenderRender the 1080p recording
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checkgame-has-winnersonnet5 won: base destroyed
passcode_checkdecisions-loggedturns per slot: {'Multi0': 41, 'Multi1': 41}
passcode_checkllm-turns-validfailed/total per slot: {'Multi0': '0/41', 'Multi1': '0/41'}
passcode_checkvideo-decodesduration 55.8s
passcode_checkvideo-completevideo ends at tick 8062 of 8062
passcode_checklimits-respectedended after 6.7 wall-minutes (budget 30.0 min): base destroyed
passchecklistnotes-explain-winNotes section explains infantry-rush win citing final thoughts from both gpt56luna and sonnet5
passchecklistplayers-match-requestresult.json shows gpt56luna (Multi0/west) and sonnet5 (Multi1/east) matching requested players
passchecklistno-silent-outagerun.log shows continuous turn-by-turn progress with 0 LLM failures on both sides across 41 turns each

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →