02 — Runs
Every run,
with its evaluation.
Every game with its video, decisions and the verdict Jetty computed.
Round 2 · 30-minute wall-clock budget per game · runbook v2.0.0 (evals v2)
23 runs · 23/23 with a passing evaluation · model spend $11.00 · 3.9 sandbox-hours
| Run | Stage | West | East | Winner | Evaluation | Game min | Wall min | Model cost | Jetty run ID |
|---|---|---|---|---|---|---|---|---|---|
| r2-rr-gpt56terra-gpt56luna-g4 | Round robin | GPT-5.6 Luna | GPT-5.6 Terra | GPT-5.6 Terra | passchecks 10/10 | 6.1 | 7.8 | $0.36 | 07fd5299 |
| r2-rr-gpt56terra-gpt56luna-g3 | Round robin | GPT-5.6 Terra | GPT-5.6 Luna | GPT-5.6 Terra | passchecks 10/10 | 7.8 | 10.2 | $0.50 | 77076920 |
| r2-rr-gpt56terra-gpt56luna-g2 | Round robin | GPT-5.6 Luna | GPT-5.6 Terra | GPT-5.6 Terra | passchecks 10/10 | 5.9 | 7.7 | $0.36 | 7caea988 |
| r2-rr-sonnet5-gpt56luna-g1 | Round robin | Claude Sonnet 5 | GPT-5.6 Luna | Claude Sonnet 5 | passchecks 10/10 | 6.1 | 8.6 | $0.34 | 7fa30839 |
| r2-rr-sonnet5-gpt56terra-g4 | Round robin | GPT-5.6 Terra | Claude Sonnet 5 | Claude Sonnet 5 | passchecks 10/10 | 8.7 | 12.4 | $0.91 | fc8c2b35 |
| r2-rr-gpt56terra-gpt56luna-g1 | Round robin | GPT-5.6 Terra | GPT-5.6 Luna | GPT-5.6 Terra | passchecks 10/10 | 4.7 | 6.0 | $0.28 | 53107caf |
| r2-rr-sonnet5-gpt56luna-g4 | Round robin | GPT-5.6 Luna | Claude Sonnet 5 | Claude Sonnet 5 | passchecks 10/10 | 5.4 | 6.7 | $0.30 | a816405d |
| r2-rr-sonnet5-gpt56luna-g3 | Round robin | Claude Sonnet 5 | GPT-5.6 Luna | Claude Sonnet 5 | passchecks 10/10 | 7.2 | 10.1 | $0.43 | 67220f81 |
| r2-rr-sonnet5-gpt56luna-g2 | Round robin | GPT-5.6 Luna | Claude Sonnet 5 | Claude Sonnet 5 | passchecks 10/10 | 5.9 | 7.8 | $0.32 | a5fa0d15 |
| r2-rr-sonnet5-gpt56terra-g3 | Round robin | Claude Sonnet 5 | GPT-5.6 Terra | GPT-5.6 Terra | passchecks 10/10 | 4.8 | 7.3 | $0.50 | c243bf0a |
| r2-rr-sonnet5-gpt56terra-g2 | Round robin | GPT-5.6 Terra | Claude Sonnet 5 | Claude Sonnet 5 | passchecks 10/10 | 11.7 | 16.8 | $1.32 | bcce8dad |
| r2-rr-sonnet5-gpt56terra-g1 | Round robin | Claude Sonnet 5 | GPT-5.6 Terra | GPT-5.6 Terra | passchecks 10/10 | 6.1 | 8.4 | $0.61 | 410f87f9 |
| r2-rr-jev-gpt56luna-g4 | Round robin | GPT-5.6 Luna | Jev Router | Jev Router | passchecks 10/10 | 5.1 | 7.9 | $0.11 | a5d0f3fc |
| r2-rr-jev-gpt56luna-g3 | Round robin | Jev Router | GPT-5.6 Luna | Jev Router | passchecks 10/10 | 5.4 | 7.9 | $0.10 | 9e9a7d94 |
| r2-rr-jev-gpt56luna-g2 | Round robin | GPT-5.6 Luna | Jev Router | Jev Router | passchecks 10/10 | 4.9 | 6.6 | $0.08 | c5d4707d |
| r2-rr-jev-gpt56luna-g1 | Round robin | Jev Router | GPT-5.6 Luna | Jev Router | passchecks 10/10 | 5.6 | 8.3 | $0.12 | 3531a1f4 |
| r2-rr-jev-gpt56terra-g4 | Round robin | GPT-5.6 Terra | Jev Router | Jev Router | passchecks 10/10 | 9.3 | 14.9 | $0.62 | 6d4b5d06 |
| r2-rr-jev-gpt56terra-g3 | Round robin | Jev Router | GPT-5.6 Terra | Jev Router | passchecks 10/10 | 14.6 | 21.8 | $1.11 | eda9e5a6 |
| r2-rr-jev-gpt56terra-g2 | Round robin | GPT-5.6 Terra | Jev Router | GPT-5.6 Terra | passchecks 10/10 | 9.5 | 15.2 | $0.74 | 9872e42e |
| r2-rr-jev-sonnet5-g4 | Round robin | Claude Sonnet 5 | Jev Router | Claude Sonnet 5 | passchecks 10/10 | 5.6 | 8.5 | $0.35 | 55fe7dbc |
| r2-rr-jev-sonnet5-g3 | Round robin | Jev Router | Claude Sonnet 5 | Jev Router | passchecks 10/10 | 11.5 | 17.9 | $0.77 | 188481ef |
| r2-rr-jev-sonnet5-g2 | Round robin | Claude Sonnet 5 | Jev Router | Jev Router | passchecks 10/10 | 5.0 | 7.2 | $0.29 | dcf50a3a |
| r2-rr-jev-sonnet5-g1 | Round robin | Jev Router | Claude Sonnet 5 | Claude Sonnet 5 | passchecks 10/10 | 6.9 | 10.1 | $0.48 | 80bb2b04 |
Thumbnails
Round robin · 6.1 game-min · 7.8 wall-min
GPT-5.6 Luna vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Round robin · 7.8 game-min · 10.2 wall-min
GPT-5.6 Terra vs GPT-5.6 Luna
GPT-5.6 Terra destroyed the enemy base
Round robin · 5.9 game-min · 7.7 wall-min
GPT-5.6 Luna vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Round robin · 6.1 game-min · 8.6 wall-min
Claude Sonnet 5 vs GPT-5.6 Luna
Claude Sonnet 5 destroyed the enemy base
Round robin · 8.7 game-min · 12.4 wall-min
GPT-5.6 Terra vs Claude Sonnet 5
Claude Sonnet 5 destroyed the enemy base
Round robin · 4.7 game-min · 6.0 wall-min
GPT-5.6 Terra vs GPT-5.6 Luna
GPT-5.6 Terra destroyed the enemy base
Round robin · 5.4 game-min · 6.7 wall-min
GPT-5.6 Luna vs Claude Sonnet 5
Claude Sonnet 5 destroyed the enemy base
Round robin · 7.2 game-min · 10.1 wall-min
Claude Sonnet 5 vs GPT-5.6 Luna
Claude Sonnet 5 destroyed the enemy base
Round robin · 5.9 game-min · 7.8 wall-min
GPT-5.6 Luna vs Claude Sonnet 5
Claude Sonnet 5 destroyed the enemy base
Round robin · 4.8 game-min · 7.3 wall-min
Claude Sonnet 5 vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Round robin · 11.7 game-min · 16.8 wall-min
GPT-5.6 Terra vs Claude Sonnet 5
Claude Sonnet 5 destroyed the enemy base
Round robin · 6.1 game-min · 8.4 wall-min
Claude Sonnet 5 vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Round robin · 5.1 game-min · 7.9 wall-min
GPT-5.6 Luna vs Jev Router
Jev Router destroyed the enemy base
Round robin · 5.4 game-min · 7.9 wall-min
Jev Router vs GPT-5.6 Luna
Jev Router destroyed the enemy base
Round robin · 4.9 game-min · 6.6 wall-min
GPT-5.6 Luna vs Jev Router
Jev Router destroyed the enemy base
Round robin · 5.6 game-min · 8.3 wall-min
Jev Router vs GPT-5.6 Luna
Jev Router destroyed the enemy base
Round robin · 9.3 game-min · 14.9 wall-min
GPT-5.6 Terra vs Jev Router
Jev Router destroyed the enemy base
Round robin · 14.6 game-min · 21.8 wall-min
Jev Router vs GPT-5.6 Terra
Jev Router destroyed the enemy base
Round robin · 9.5 game-min · 15.2 wall-min
GPT-5.6 Terra vs Jev Router
GPT-5.6 Terra destroyed the enemy base
Round robin · 5.6 game-min · 8.5 wall-min
Claude Sonnet 5 vs Jev Router
Claude Sonnet 5 destroyed the enemy base
Round robin · 11.5 game-min · 17.9 wall-min
Jev Router vs Claude Sonnet 5
Jev Router destroyed the enemy base
Round robin · 5.0 game-min · 7.2 wall-min
Claude Sonnet 5 vs Jev Router
Jev Router destroyed the enemy base
Round robin · 6.9 game-min · 10.1 wall-min
Jev Router vs Claude Sonnet 5
Claude Sonnet 5 destroyed the enemy base
Round 1 (archived) · 20 runs
Round 1 · 20-game-minute cap per game · runbook v1.1.0
20 runs · 20/20 with a passing evaluation · model spend $15.39 · 4.9 sandbox-hours
| Run | Stage | West | East | Winner | Evaluation | Game min | Wall min | Model cost | Jetty run ID |
|---|---|---|---|---|---|---|---|---|---|
| ladder-gpt56terra-normal-g2 | vs OpenRA AI | OpenRA AI (Normal) | GPT-5.6 Terra | OpenRA AI (Normal) | passchecks 7/7 | 14.0 | 17.2 | $0.87 | 244c97ee |
| ladder-gpt56terra-normal-g1 | vs OpenRA AI | GPT-5.6 Terra | OpenRA AI (Normal) | OpenRA AI (Normal) | passchecks 7/7 | 10.4 | 12.7 | $0.57 | 11382375 |
| ladder-gpt56terra-medium-g2 | vs OpenRA AI | OpenRA AI (Medium) | GPT-5.6 Terra | OpenRA AI (Medium) | passchecks 7/7 | 5.8 | 8.1 | $0.30 | 25bbbda1 |
| ladder-gpt56terra-medium-g1 | vs OpenRA AI | GPT-5.6 Terra | OpenRA AI (Medium) | OpenRA AI (Medium) | passchecks 7/7 | 10.8 | 14.6 | $0.64 | cb9f4fa0 |
| ladder-gpt56terra-easy-g2 | vs OpenRA AI | OpenRA AI (Easy) | GPT-5.6 Terra | OpenRA AI (Easy) | passchecks 7/7 | 16.1 | 24.3 | $0.95 | 59c1de0e |
| ladder-gpt56terra-easy-g1 | vs OpenRA AI | GPT-5.6 Terra | OpenRA AI (Easy) | OpenRA AI (Easy) | passchecks 7/7 | 20.0 | 26.9 | $1.28 | 8799ebb9 |
| ladder-gpt56terra-beginner-g2 | vs OpenRA AI | OpenRA AI (Beginner) | GPT-5.6 Terra | OpenRA AI (Beginner) | passchecks 7/7 | 20.0 | 27.5 | $1.18 | 30e5721d |
| ladder-gpt56terra-beginner-g1 | vs OpenRA AI | GPT-5.6 Terra | OpenRA AI (Beginner) | OpenRA AI (Beginner) | passchecks 7/7 | 20.0 | 22.8 | $1.21 | 76ee5949 |
| rr-sonnet5-gpt56terra-g3 | Round robin | Claude Sonnet 5 | GPT-5.6 Terra | GPT-5.6 Terra | passchecks 7/7 | 5.3 | 8.2 | $0.53 | 8d343c33 |
| rr-sonnet5-gpt56terra-g2 | Round robin | GPT-5.6 Terra | Claude Sonnet 5 | Claude Sonnet 5 | passchecks 7/7 | 16.8 | 22.4 | $2.32 | fc358032 |
| rr-jev-sonnet5-g4 | Round robin | Claude Sonnet 5 | Jev Router | Claude Sonnet 5 | passchecks 7/7 | 13.2 | 20.8 | $1.00 | 542bd7d9 |
| rr-jev-sonnet5-g2 | Round robin | Claude Sonnet 5 | Jev Router | Jev Router | passchecks 7/7 | 5.0 | 9.1 | $0.32 | 563b10ca |
| rr-sonnet5-gpt56terra-g4 | Round robin | GPT-5.6 Terra | Claude Sonnet 5 | GPT-5.6 Terra | passchecks 7/7 | 9.2 | 13.7 | $1.05 | b35404b4 |
| rr-sonnet5-gpt56terra-g1 | Round robin | Claude Sonnet 5 | GPT-5.6 Terra | GPT-5.6 Terra | passchecks 7/7 | 7.8 | 12.2 | $0.85 | 0bde81b2 |
| rr-jev-gpt56terra-g4 | Round robin | GPT-5.6 Terra | Jev Router | GPT-5.6 Terra | passchecks 7/7 | 7.1 | 11.6 | $0.56 | 6bafdc73 |
| rr-jev-gpt56terra-g3 | Round robin | Jev Router | GPT-5.6 Terra | GPT-5.6 Terra | passchecks 7/7 | 5.2 | 7.8 | $0.36 | 8197bf3a |
| rr-jev-gpt56terra-g1 | Round robin | Jev Router | GPT-5.6 Terra | GPT-5.6 Terra | passchecks 7/7 | 5.7 | 8.1 | $0.39 | 84bd0579 |
| rr-jev-gpt56terra-g2 | Round robin | GPT-5.6 Terra | Jev Router | Jev Router | passchecks 7/7 | 6.0 | 8.9 | $0.39 | 3bb0113c |
| rr-jev-sonnet5-g3 | Round robin | Jev Router | Claude Sonnet 5 | Jev Router | passchecks 7/7 | 5.6 | 7.7 | $0.34 | 54daab2e |
| rr-jev-sonnet5-g1 | Round robin | Jev Router | Claude Sonnet 5 | Jev Router | passchecks 7/7 | 4.9 | 7.8 | $0.27 | ccd61be6 |
Thumbnails
vs OpenRA AI · 14.0 game-min · 17.2 wall-min
OpenRA AI (Normal) vs GPT-5.6 Terra
OpenRA AI (Normal) destroyed the enemy base
vs OpenRA AI · 10.4 game-min · 12.7 wall-min
GPT-5.6 Terra vs OpenRA AI (Normal)
OpenRA AI (Normal) destroyed the enemy base
vs OpenRA AI · 5.8 game-min · 8.1 wall-min
OpenRA AI (Medium) vs GPT-5.6 Terra
OpenRA AI (Medium) destroyed the enemy base
vs OpenRA AI · 10.8 game-min · 14.6 wall-min
GPT-5.6 Terra vs OpenRA AI (Medium)
OpenRA AI (Medium) destroyed the enemy base
vs OpenRA AI · 16.1 game-min · 24.3 wall-min
OpenRA AI (Easy) vs GPT-5.6 Terra
OpenRA AI (Easy) destroyed the enemy base
vs OpenRA AI · 20.0 game-min · 26.9 wall-min
GPT-5.6 Terra vs OpenRA AI (Easy)
OpenRA AI (Easy) won on score at the time limit (73,450 to 38,850)
vs OpenRA AI · 20.0 game-min · 27.5 wall-min
OpenRA AI (Beginner) vs GPT-5.6 Terra
OpenRA AI (Beginner) won on score at the time limit (35,200 to 22,250)
vs OpenRA AI · 20.0 game-min · 22.8 wall-min
GPT-5.6 Terra vs OpenRA AI (Beginner)
OpenRA AI (Beginner) won on score at the time limit (34,750 to 27,700)
Round robin · 5.3 game-min · 8.2 wall-min
Claude Sonnet 5 vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Round robin · 16.8 game-min · 22.4 wall-min
GPT-5.6 Terra vs Claude Sonnet 5
Claude Sonnet 5 destroyed the enemy base
Round robin · 13.2 game-min · 20.8 wall-min
Claude Sonnet 5 vs Jev Router
Claude Sonnet 5 destroyed the enemy base
Round robin · 5.0 game-min · 9.1 wall-min
Claude Sonnet 5 vs Jev Router
Jev Router destroyed the enemy base
Round robin · 9.2 game-min · 13.7 wall-min
GPT-5.6 Terra vs Claude Sonnet 5
GPT-5.6 Terra destroyed the enemy base
Round robin · 7.8 game-min · 12.2 wall-min
Claude Sonnet 5 vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Round robin · 7.1 game-min · 11.6 wall-min
GPT-5.6 Terra vs Jev Router
GPT-5.6 Terra destroyed the enemy base
Round robin · 5.2 game-min · 7.8 wall-min
Jev Router vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Round robin · 5.7 game-min · 8.1 wall-min
Jev Router vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Round robin · 6.0 game-min · 8.9 wall-min
GPT-5.6 Terra vs Jev Router
Jev Router destroyed the enemy base
Round robin · 5.6 game-min · 7.7 wall-min
Jev Router vs Claude Sonnet 5
Jev Router destroyed the enemy base
Round robin · 4.9 game-min · 7.8 wall-min
Jev Router vs Claude Sonnet 5
Jev Router destroyed the enemy base
Pilot cup (archived) · 10 runs
Pilot cup · 14-game-minute cap, run locally before Jetty · runbook local script
10 runs · 0/0 with a passing evaluation · model spend $5.47 · 2.3 sandbox-hours
| Run | Stage | West | East | Winner | Evaluation | Game min | Wall min | Model cost | Jetty run ID |
|---|---|---|---|---|---|---|---|---|---|
| cup1-final-g3 | Pilot cup | Jev Router | Claude Sonnet 5 | Jev Router | unknown | 14.0 | 25.6 | $0.85 | local |
| cup1-final-g2 | Pilot cup | Claude Sonnet 5 | Jev Router | Jev Router | unknown | 12.4 | 18.9 | $0.61 | local |
| cup1-third-g2 | Pilot cup | GPT-5.6 Terra | Gemini 3.8 Flash | GPT-5.6 Terra | unknown | 5.9 | 6.2 | $0.46 | local |
| cup1-third-g1 | Pilot cup | Gemini 3.8 Flash | GPT-5.6 Terra | GPT-5.6 Terra | unknown | 4.5 | 5.1 | $0.35 | local |
| cup1-final-g1 | Pilot cup | Jev Router | Claude Sonnet 5 | Claude Sonnet 5 | unknown | 7.3 | 12.1 | $0.37 | local |
| cup1-sf1-g3 | Pilot cup | Jev Router | GPT-5.6 Terra | Jev Router | unknown | 8.8 | 14.2 | $0.49 | local |
| cup1-sf1-g2 | Pilot cup | GPT-5.6 Terra | Jev Router | Jev Router | unknown | 14.0 | 28.1 | $0.84 | local |
| cup1-sf2-g2 | Pilot cup | Gemini 3.8 Flash | Claude Sonnet 5 | Claude Sonnet 5 | unknown | 7.7 | 9.3 | $0.60 | local |
| cup1-sf2-g1 | Pilot cup | Claude Sonnet 5 | Gemini 3.8 Flash | Claude Sonnet 5 | unknown | 5.2 | 6.2 | $0.38 | local |
| cup1-sf1-g1 | Pilot cup | Jev Router | GPT-5.6 Terra | GPT-5.6 Terra | unknown | 8.8 | 15.0 | $0.53 | local |
Thumbnails
Pilot cup · 14.0 game-min · 25.6 wall-min
Jev Router vs Claude Sonnet 5
Jev Router won on score at the time limit (38,100 to 32,450)
Pilot cup · 12.4 game-min · 18.9 wall-min
Claude Sonnet 5 vs Jev Router
Jev Router destroyed the enemy base
Pilot cup · 5.9 game-min · 6.2 wall-min
GPT-5.6 Terra vs Gemini 3.8 Flash
GPT-5.6 Terra destroyed the enemy base
Pilot cup · 4.5 game-min · 5.1 wall-min
Gemini 3.8 Flash vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base
Pilot cup · 7.3 game-min · 12.1 wall-min
Jev Router vs Claude Sonnet 5
Claude Sonnet 5 destroyed the enemy base
Pilot cup · 8.8 game-min · 14.2 wall-min
Jev Router vs GPT-5.6 Terra
Jev Router destroyed the enemy base
Pilot cup · 14.0 game-min · 28.1 wall-min
GPT-5.6 Terra vs Jev Router
Jev Router won on score at the time limit (48,150 to 33,800)
Pilot cup · 7.7 game-min · 9.3 wall-min
Gemini 3.8 Flash vs Claude Sonnet 5
Claude Sonnet 5 destroyed the enemy base
Pilot cup · 5.2 game-min · 6.2 wall-min
Claude Sonnet 5 vs Gemini 3.8 Flash
Claude Sonnet 5 destroyed the enemy base
Pilot cup · 8.8 game-min · 15.0 wall-min
Jev Router vs GPT-5.6 Terra
GPT-5.6 Terra destroyed the enemy base