evals
Run evals on Jetty

02 — Run · Round 1 · Round robin · rr-jev-gpt56terra-g4

GPT-5.6 Terra vs Jev Router

GPT-5.6 Terra destroyed the enemy base after 7.1 game-minutes · 11.6 min wall clock

WIN germany · west
GPT-5.6 Terra
openai/gpt-5.6-terra
Value destroyed$12,600Value lost$4,900 Units killed / lost26 / 33Buildings killed / lost6 / 0 Peak army$5,400Orders issued107 Decision turns (failed)53 (0)Mean latency3.7sModel cost$0.407
LOSS russia · east
Jev Router
typesafe/jev-router
Value destroyed$4,900Value lost$12,600 Units killed / lost33 / 26Buildings killed / lost0 / 6 Peak army$1,800Orders issued102 Decision turns (failed)53 (1)Mean latency6.0sModel cost$0.148

Evaluation

passchecks 7/7 verdict computed from the gating checks

Round-1 run: written before the runbook moved to evals v2, so these are the older self-reported checks.

StatusKindCheckDetail
passcode_checkresult-jsonresult json
passcode_checkhas-winnerhas winner
passcode_checkdecisions-loggeddecisions logged
passcode_checkreplay-savedreplay saved
passcode_checkvideo-renderedvideo rendered
passcode_checkno-llm-outageno llm outage
passcode_checkvideo-completevideo complete

Decision timeline

What each model saw as its situation and what it ordered, every 8 game-seconds. Click a turn to jump the video there.

Ready to stop guessing if your outputs are good?

Get Started Book a 15-minute walkthrough
Connect your agent to Jetty →