evals
Run evals on Jetty

02 — Run · Round 2 · Round robin · r2-rr-jev-sonnet5-g3

Jev Router vs Claude Sonnet 5

Jev Router destroyed the enemy base after 11.5 game-minutes · 17.9 min wall clock

WIN ukraine · west
Jev Router
typesafe/jev-router
Value destroyed$29,700Value lost$6,350 Units killed / lost51 / 23Buildings killed / lost13 / 0 Peak army$6,300Orders issued143 Decision turns (failed)87 (2)Mean latency5.1sModel cost$0.179
LOSS france · east
Claude Sonnet 5
anthropic/claude-sonnet-5
Value destroyed$6,350Value lost$29,700 Units killed / lost23 / 51Buildings killed / lost0 / 13 Peak army$4,500Orders issued255 Decision turns (failed)87 (0)Mean latency5.1sModel cost$0.595

Evaluation

passchecks 10/10 verdict computed from the gating checks

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, content, key)
passsteplaunchLaunch run-match as a detached process
passstepsuperviseSupervise in the foreground until run-match exits
passsteprenderRender the 1080p recording
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checkgame-has-winnerjev won: base destroyed
passcode_checkdecisions-loggedturns per slot: {'Multi0': 87, 'Multi1': 87}
passcode_checkllm-turns-validfailed/total per slot: {'Multi0': '0/87', 'Multi1': '0/87'}
passcode_checkvideo-decodesduration 117.2s
passcode_checkvideo-completevideo ends at tick 17277 of 17277
passcode_checklimits-respectedended after 17.9 wall-minutes (budget 30.0 min): base destroyed
passchecklistnotes-explain-winNotes section quotes final thoughts from both Jev Router and Claude Sonnet 5, explaining the decisive economic collapse that ended the game
passchecklistplayers-match-requestresult.json confirms Multi0=jev (typesafe/jev-router) and Multi1=sonnet5 (anthropic/claude-sonnet-5) matching the requested players
passchecklistno-silent-outagerun.log shows continuous turn lines with no gaps; both slots had 87 calls and 0 failures

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →