evals
Run evals on Jetty

02 — Run · Round 2 · Round robin · r2-rr-jev-sonnet5-g1

Jev Router vs Claude Sonnet 5

Claude Sonnet 5 destroyed the enemy base after 6.9 game-minutes · 10.1 min wall clock

LOSS germany · west
Jev Router
typesafe/jev-router
Value destroyed$3,100Value lost$10,900 Units killed / lost7 / 19Buildings killed / lost0 / 5 Peak army$2,600Orders issued81 Decision turns (failed)52 (0)Mean latency5.1sModel cost$0.127
WIN germany · east
Claude Sonnet 5
anthropic/claude-sonnet-5
Value destroyed$11,100Value lost$3,300 Units killed / lost21 / 9Buildings killed / lost5 / 0 Peak army$8,500Orders issued174 Decision turns (failed)52 (0)Mean latency3.9sModel cost$0.354

Evaluation

passchecks 10/10 verdict computed from the gating checks

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, content, key)
passsteplaunchLaunch run-match as a detached process
passstepsuperviseSupervise in the foreground until run-match exits
passsteprenderRender the 1080p recording
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checkgame-has-winnersonnet5 won: base destroyed
passcode_checkdecisions-loggedturns per slot: {'Multi0': 52, 'Multi1': 52}
passcode_checkllm-turns-validfailed/total per slot: {'Multi0': '0/52', 'Multi1': '0/52'}
passcode_checkvideo-decodesduration 71.3s
passcode_checkvideo-completevideo ends at tick 10398 of 10398
passcode_checklimits-respectedended after 10.1 wall-minutes (budget 30.0 min): base destroyed
passchecklistnotes-explain-winsummary.md Notes section explains Sonnet 5 victory via base destruction citing both players final thoughts
passchecklistplayers-match-requestresult.json records jev=typesafe/jev-router and sonnet5=anthropic/claude-sonnet-5 as requested
passchecklistno-silent-outagerun.log shows continuous per-tick progress with 0 LLM failures on both sides across all 52 turns

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →