evals
Run evals on Jetty

02 — Run · Round 2 · Round robin · r2-rr-jev-gpt56terra-g3

Jev Router vs GPT-5.6 Terra

Jev Router destroyed the enemy base after 14.6 game-minutes · 21.8 min wall clock

WIN russia · west
Jev Router
typesafe/jev-router
Value destroyed$36,800Value lost$10,300 Units killed / lost114 / 45Buildings killed / lost10 / 3 Peak army$12,600Orders issued218 Decision turns (failed)110 (4)Mean latency5.7sModel cost$0.211
LOSS ukraine · east
GPT-5.6 Terra
openai/gpt-5.6-terra
Value destroyed$10,300Value lost$36,800 Units killed / lost45 / 114Buildings killed / lost3 / 10 Peak army$4,050Orders issued144 Decision turns (failed)110 (0)Mean latency3.9sModel cost$0.897

Evaluation

passchecks 10/10 verdict computed from the gating checks

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, content, key)
passsteplaunchLaunch run-match as a detached process
passstepsuperviseSupervise in the foreground until run-match exits
passsteprenderRender the 1080p recording
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checkgame-has-winnerjev won: base destroyed
passcode_checkdecisions-loggedturns per slot: {'Multi0': 110, 'Multi1': 110}
passcode_checkllm-turns-validfailed/total per slot: {'Multi0': '1/110', 'Multi1': '0/110'}
passcode_checkvideo-decodesduration 148.1s
passcode_checkvideo-completevideo ends at tick 21909 of 21909
passcode_checklimits-respectedended after 21.8 wall-minutes (budget 30.0 min): base destroyed
passchecklistnotes-explain-winsummary.md Notes section cites final thoughts of both players and explains how Jev Router overcame an early deficit to destroy GPT Terra base
passchecklistplayers-match-requestresult.json records Multi0=jev (typesafe/jev-router) and Multi1=gpt56terra (openai/gpt-5.6-terra) matching the requested players
passchecklistno-silent-outagerun.log shows continuous tick-by-tick progress with 1 LLM failure out of 220 total calls and no long stretches of failed turns

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →