evals
Create your eval

02 — Run · Round 2 · Round robin · r2-rr-jev-gpt6luna-g2

GPT-6 Luna vs Jev Router

Jev Router destroyed the enemy base after 11.5 game-minutes · 15.6 min wall clock

LOSS ukraine · west
GPT-6 Luna
openai/gpt-6-luna
Value destroyed$9,750Value lost$24,700 Units killed / lost35 / 29Buildings killed / lost2 / 9 Peak army$5,750Orders issued46 Decision turns (failed)87 (0)Mean latency3.3sModel cost$0.032
WIN russia · east
Jev Router
typesafe/jev-router
Value destroyed$24,700Value lost$9,750 Units killed / lost29 / 35Buildings killed / lost9 / 2 Peak army$5,900Orders issued156 Decision turns (failed)87 (15)Mean latency5.6sModel cost$0.173

Evaluation

passchecks 10/10 verdict computed from the gating checks

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, content, key)
passsteplaunchLaunch run-match as a detached process
passstepsuperviseSupervise in the foreground until run-match exits
passsteprenderRender the 1080p recording
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checkgame-has-winnerjev won: base destroyed
passcode_checkdecisions-loggedturns per slot: {'Multi0': 87, 'Multi1': 87}
passcode_checkllm-turns-validfailed/total per slot: {'Multi0': '0/87', 'Multi1': '8/87'}
passcode_checkvideo-decodesduration 117.3s
passcode_checkvideo-completevideo ends at tick 17296 of 17296
passcode_checklimits-respectedended after 15.6 wall-minutes (budget 30.0 min): base destroyed
passchecklistnotes-explain-winsummary.md Notes section cites final thoughts from both GPT-6 Luna and Jev Router explaining the decisive army-size and economic disparity
passchecklistplayers-match-requestresult.json records Multi0=gpt6luna (openai/gpt-6-luna) and Multi1=jev (typesafe/jev-router) matching the requested west=gpt6luna east=jev
passchecklistno-silent-outageJev Router had 8 LLM failures out of 87 turns (9.2%); GPT-6 Luna had 0 failures; no long silent stretches in run.log

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Create your eval Book a 15-minute walkthrough
Connect your agent to Jetty →