evals
Run evals on Jetty

02 — Run · Round 1 · Round robin · rr-jev-sonnet5-g2

Claude Sonnet 5 vs Jev Router

Jev Router destroyed the enemy base after 5.0 game-minutes · 9.1 min wall clock

LOSS russia · west
Claude Sonnet 5
anthropic/claude-sonnet-5
Value destroyed$100Value lost$12,700 Units killed / lost1 / 2Buildings killed / lost0 / 12 Peak army$0Orders issued47 Decision turns (failed)38 (0)Mean latency5.2sModel cost$0.236
WIN germany · east
Jev Router
typesafe/jev-router
Value destroyed$12,700Value lost$100 Units killed / lost2 / 1Buildings killed / lost12 / 0 Peak army$2,600Orders issued66 Decision turns (failed)38 (0)Mean latency4.6sModel cost$0.081

Evaluation

passchecks 7/7 verdict computed from the gating checks

Round-1 run: written before the runbook moved to evals v2, so these are the older self-reported checks.

StatusKindCheckDetail
passcode_checkresult-jsonresult json
passcode_checkhas-winnerhas winner
passcode_checkdecisions-loggeddecisions logged
passcode_checkreplay-savedreplay saved
passcode_checkvideo-renderedvideo rendered
passcode_checkno-llm-outageno llm outage
passcode_checkvideo-completevideo complete

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →