02 — Runs
Every run,
with its evaluation.
Every city with its timelapse, decisions, cost and the verdict Jetty computed.
32 runs · 1/32 with a passing verdict (valid and goal met) · model spend $28.08 · runbook-agent spend $26.16 · 6.4 run-hours. Each run ran on Jetty, which keeps its inputs, logs, artifacts and cost; the Jetty run ID is listed for reference.
Grow a city · Empty generated map, $20,000, 20 years: reach 10,000 people without going bankrupt.
| Run | Task | Seed | Mayor | Outcome | Population | City score | Evaluation | Model cost | Wall min | Jetty run ID |
|---|---|---|---|---|---|---|---|---|---|---|
| jev-grow-s2 | Grow a city | 2 | Jev Router | 19,660 people (bankrupt) | 19,660 | 596 | fail | $2.14 | 46.3 | 5de24fe4 |
| sonnet5-grow-s2 | Grow a city | 2 | Claude Sonnet 5 | 1,200 people | 1,200 | 431 | fail | $1.39 | 14.2 | 40c8cf3e |
| gpt56terra-grow-s2 | Grow a city | 2 | GPT-5.6 Terra | 3,660 people | 3,660 | 322 | fail | $1.54 | 13.0 | 476d94f4 |
| gpt56luna-grow-s2 | Grow a city | 2 | GPT-5.6 Luna | 8,060 people | 8,060 | 417 | fail | $0.14 | 8.4 | 831ede26 |
| jev-grow-s6 | Grow a city | 6 | Jev Router | 4,580 people | 4,580 | 367 | fail | $1.91 | 46.6 | 981094de |
| sonnet5-grow-s6 | Grow a city | 6 | Claude Sonnet 5 | 940 people | 940 | 514 | fail | $1.32 | 13.1 | 0e6f2bec |
| gpt56terra-grow-s6 | Grow a city | 6 | GPT-5.6 Terra | 2,920 people (bankrupt) | 2,920 | 756 | fail | $1.41 | 12.6 | 4c859227 |
| gpt56luna-grow-s6 | Grow a city | 6 | GPT-5.6 Luna | 6,360 people | 6,360 | 311 | fail | $0.15 | 9.7 | 349eb345 |
Final cities
Grow a city · seed 2 · 46.3 wall-min
Jev Router
19,660 people (bankrupt) · score 596
Grow a city · seed 2 · 14.2 wall-min
Claude Sonnet 5
1,200 people · score 431
Grow a city · seed 2 · 13.0 wall-min
GPT-5.6 Terra
3,660 people · score 322
Grow a city · seed 2 · 8.4 wall-min
GPT-5.6 Luna
8,060 people · score 417
Grow a city · seed 6 · 46.6 wall-min
Jev Router
4,580 people · score 367
Grow a city · seed 6 · 13.1 wall-min
Claude Sonnet 5
940 people · score 514
Grow a city · seed 6 · 12.6 wall-min
GPT-5.6 Terra
2,920 people (bankrupt) · score 756
Grow a city · seed 6 · 9.7 wall-min
GPT-5.6 Luna
6,360 people · score 311
Tokyo 1957: monster attack · A monster attacks Tokyo in 1957. Rebuild and get the city score above 500 within 5 years.
| Run | Task | Seed | Mayor | Outcome | Population | City score | Evaluation | Model cost | Wall min | Jetty run ID |
|---|---|---|---|---|---|---|---|---|---|---|
| jev-tokyo-s1 | Tokyo 1957 | 1 | Jev Router | lost | 23,120 | 372 | fail | $1.21 | 14.4 | 96f24e6b |
| sonnet5-tokyo-s1 | Tokyo 1957 | 1 | Claude Sonnet 5 | lost | 23,800 | 333 | fail | $0.39 | 3.4 | 58cccc15 |
| gpt56terra-tokyo-s1 | Tokyo 1957 | 1 | GPT-5.6 Terra | won | 29,640 | 501 | pass | $0.61 | 6.0 | 00ff7869 |
| gpt56luna-tokyo-s1 | Tokyo 1957 | 1 | GPT-5.6 Luna | lost | 23,700 | 330 | fail | $0.04 | 2.5 | 4675adce |
| jev-tokyo-s2 | Tokyo 1957 | 2 | Jev Router | lost | 21,900 | 368 | fail | $0.65 | 10.1 | d78fe456 |
| sonnet5-tokyo-s2 | Tokyo 1957 | 2 | Claude Sonnet 5 | lost | 22,400 | 346 | fail | $0.38 | 3.1 | 72ed89e1 |
| gpt56terra-tokyo-s2 | Tokyo 1957 | 2 | GPT-5.6 Terra | lost | 31,020 | 237 | fail | $0.55 | 5.4 | 2cf5d9c4 |
| gpt56luna-tokyo-s2 | Tokyo 1957 | 2 | GPT-5.6 Luna | lost | 29,120 | 458 | fail | $0.04 | 2.5 | a57b0db6 |
Final cities
Tokyo 1957 · seed 1 · 14.4 wall-min
Jev Router
lost · score 372
Tokyo 1957 · seed 1 · 3.4 wall-min
Claude Sonnet 5
lost · score 333
Tokyo 1957 · seed 1 · 6.0 wall-min
GPT-5.6 Terra
won · score 501
Tokyo 1957 · seed 1 · 2.5 wall-min
GPT-5.6 Luna
lost · score 330
Tokyo 1957 · seed 2 · 10.1 wall-min
Jev Router
lost · score 368
Tokyo 1957 · seed 2 · 3.1 wall-min
Claude Sonnet 5
lost · score 346
Tokyo 1957 · seed 2 · 5.4 wall-min
GPT-5.6 Terra
lost · score 237
Tokyo 1957 · seed 2 · 2.5 wall-min
GPT-5.6 Luna
lost · score 458
San Francisco 1906: earthquake · An earthquake hits San Francisco in 1906. Be a Metropolis (100,000 people) within 5 years.
| Run | Task | Seed | Mayor | Outcome | Population | City score | Evaluation | Model cost | Wall min | Jetty run ID |
|---|---|---|---|---|---|---|---|---|---|---|
| jev-sanfrancisco-s1 | San Francisco 1906 | 1 | Jev Router | lost | 36,300 | 286 | fail | $0.86 | 10.7 | b6be516e |
| sonnet5-sanfrancisco-s1 | San Francisco 1906 | 1 | Claude Sonnet 5 | lost | 36,840 | 23 | fail | $0.42 | 3.7 | df629564 |
| gpt56terra-sanfrancisco-s1 | San Francisco 1906 | 1 | GPT-5.6 Terra | lost | 47,680 | 39 | fail | $0.65 | 6.4 | d5eb8764 |
| gpt56luna-sanfrancisco-s1 | San Francisco 1906 | 1 | GPT-5.6 Luna | lost | 23,680 | 21 | fail | $0.05 | 2.6 | 7a99b8d9 |
| jev-sanfrancisco-s2 | San Francisco 1906 | 2 | Jev Router | lost | 92,360 | 500 | fail | $2.00 | 18.4 | d76eb040 |
| sonnet5-sanfrancisco-s2 | San Francisco 1906 | 2 | Claude Sonnet 5 | lost | 72,300 | 27 | fail | $0.45 | 4.3 | fd728217 |
| gpt56terra-sanfrancisco-s2 | San Francisco 1906 | 2 | GPT-5.6 Terra | lost | 38,880 | 37 | fail | $0.68 | 6.4 | b8e5bc93 |
| gpt56luna-sanfrancisco-s2 | San Francisco 1906 | 2 | GPT-5.6 Luna | lost | 48,220 | 22 | fail | $0.04 | 2.5 | cd12e212 |
Final cities
San Francisco 1906 · seed 1 · 10.7 wall-min
Jev Router
lost · score 286
San Francisco 1906 · seed 1 · 3.7 wall-min
Claude Sonnet 5
lost · score 23
San Francisco 1906 · seed 1 · 6.4 wall-min
GPT-5.6 Terra
lost · score 39
San Francisco 1906 · seed 1 · 2.6 wall-min
GPT-5.6 Luna
lost · score 21
San Francisco 1906 · seed 2 · 18.4 wall-min
Jev Router
lost · score 500
San Francisco 1906 · seed 2 · 4.3 wall-min
Claude Sonnet 5
lost · score 27
San Francisco 1906 · seed 2 · 6.4 wall-min
GPT-5.6 Terra
lost · score 37
San Francisco 1906 · seed 2 · 2.5 wall-min
GPT-5.6 Luna
lost · score 22
Detroit 1972: crime · Detroit's crime is out of control in 1972. Bring average crime under 60 in 10 years, without emptying the city.
| Run | Task | Seed | Mayor | Outcome | Population | City score | Evaluation | Model cost | Wall min | Jetty run ID |
|---|---|---|---|---|---|---|---|---|---|---|
| jev-detroit-s1 | Detroit 1972 | 1 | Jev Router | lost | 7,380 | 595 | fail | $2.21 | 26.2 | aea16d25 |
| sonnet5-detroit-s1 | Detroit 1972 | 1 | Claude Sonnet 5 | lost | 3,520 | 586 | fail | $0.73 | 6.9 | 650b3bc0 |
| gpt56terra-detroit-s1 | Detroit 1972 | 1 | GPT-5.6 Terra | lost | 6,120 | 597 | fail | $1.06 | 9.8 | 175f2d53 |
| gpt56luna-detroit-s1 | Detroit 1972 | 1 | GPT-5.6 Luna | lost | 7,400 | 547 | fail | $0.08 | 4.8 | fde1c078 |
| jev-detroit-s2 | Detroit 1972 | 2 | Jev Router | lost | 10,040 | 456 | fail | $3.11 | 45.9 | 85fe296a |
| sonnet5-detroit-s2 | Detroit 1972 | 2 | Claude Sonnet 5 | lost | 3,280 | 341 | fail | $0.72 | 6.6 | c55e7a2b |
| gpt56terra-detroit-s2 | Detroit 1972 | 2 | GPT-5.6 Terra | lost | 6,880 | 693 | fail | $1.05 | 10.8 | ef93e671 |
| gpt56luna-detroit-s2 | Detroit 1972 | 2 | GPT-5.6 Luna | lost | 15,280 | 704 | fail | $0.09 | 5.4 | aba6000b |
Final cities
Detroit 1972 · seed 1 · 26.2 wall-min
Jev Router
lost · score 595
Detroit 1972 · seed 1 · 6.9 wall-min
Claude Sonnet 5
lost · score 586
Detroit 1972 · seed 1 · 9.8 wall-min
GPT-5.6 Terra
lost · score 597
Detroit 1972 · seed 1 · 4.8 wall-min
GPT-5.6 Luna
lost · score 547
Detroit 1972 · seed 2 · 45.9 wall-min
Jev Router
lost · score 456
Detroit 1972 · seed 2 · 6.6 wall-min
Claude Sonnet 5
lost · score 341
Detroit 1972 · seed 2 · 10.8 wall-min
GPT-5.6 Terra
lost · score 693
Detroit 1972 · seed 2 · 5.4 wall-min
GPT-5.6 Luna
lost · score 704