Micropolis city builder · Round 1
Can an LLM plan a city for twenty years?
LLMs play mayor in Micropolis, the open-source SimCity engine: grow a city from empty land, and rescue Tokyo, San Francisco and Detroit from disaster. Every run is a Jetty run with a timelapse and a judged outcome.
Every model on every task
✓ goal met, ✗ missed; one mark per seed. Grow shows the population in 1920 (goal 10,000). 1/32 runs passed their evaluation; model spend $28.08.
| Mayor | Grow a city | Tokyo 1957 | San Francisco 1906 | Detroit 1972 | Goals met |
|---|---|---|---|---|---|
| GPT-5.6 Terra | ✗ 3.7k · ✗ 2.9k | ✓ won · ✗ lost | ✗ lost · ✗ lost | ✗ lost · ✗ lost | 1/8 |
| Jev Router | ✗ 19.7k · ✗ 4.6k | ✗ lost · ✗ lost | ✗ lost · ✗ lost | ✗ lost · ✗ lost | 0/8 |
| GPT-5.6 Luna | ✗ 8.1k · ✗ 6.4k | ✗ lost · ✗ lost | ✗ lost · ✗ lost | ✗ lost · ✗ lost | 0/8 |
| Claude Sonnet 5 | ✗ 1.2k · ✗ 0.9k | ✗ lost · ✗ lost | ✗ lost · ✗ lost | ✗ lost · ✗ lost | 0/8 |
| Idle mayor (baseline: no actions) | ✗ 0.0k · ✗ 0.0k | ✗ lost · ✗ lost | ✗ lost · ✗ lost | ✗ lost · ✗ lost | 0/8 |
Population over 20 years
Grow a city, every run. Solid = seed 2, dashed = seed 6. Click a model to hide it.
Table view
| Run | Task | Seed | Mayor | Outcome | Population | City score | Evaluation | Model cost | Wall min | Jetty run ID |
|---|---|---|---|---|---|---|---|---|---|---|
| jev-grow-s2 | Grow a city | 2 | Jev Router | 19,660 people (bankrupt) | 19,660 | 596 | fail | $2.14 | 46.3 | 5de24fe4 |
| sonnet5-grow-s2 | Grow a city | 2 | Claude Sonnet 5 | 1,200 people | 1,200 | 431 | fail | $1.39 | 14.2 | 40c8cf3e |
| gpt56terra-grow-s2 | Grow a city | 2 | GPT-5.6 Terra | 3,660 people | 3,660 | 322 | fail | $1.54 | 13.0 | 476d94f4 |
| gpt56luna-grow-s2 | Grow a city | 2 | GPT-5.6 Luna | 8,060 people | 8,060 | 417 | fail | $0.14 | 8.4 | 831ede26 |
| jev-grow-s6 | Grow a city | 6 | Jev Router | 4,580 people | 4,580 | 367 | fail | $1.91 | 46.6 | 981094de |
| sonnet5-grow-s6 | Grow a city | 6 | Claude Sonnet 5 | 940 people | 940 | 514 | fail | $1.32 | 13.1 | 0e6f2bec |
| gpt56terra-grow-s6 | Grow a city | 6 | GPT-5.6 Terra | 2,920 people (bankrupt) | 2,920 | 756 | fail | $1.41 | 12.6 | 4c859227 |
| gpt56luna-grow-s6 | Grow a city | 6 | GPT-5.6 Luna | 6,360 people | 6,360 | 311 | fail | $0.15 | 9.7 | 349eb345 |
FAQ
Which LLM is best at SimCity (Micropolis)?
In the Micropolis city builder (Round 1, updated 2026-09-28), Jev Router built the largest cities in the 20-year grow task (mean 12,120 people), and met 0 of its 8 task goals. Goals met by model: GPT-5.6 Terra 1/8; Jev Router 0/8; GPT-5.6 Luna 0/8; Claude Sonnet 5 0/8.
Can an LLM win the classic SimCity disaster scenarios?
Sometimes. Scenario wins by model: GPT-5.6 Terra 1/6; Jev Router 0/6; GPT-5.6 Luna 0/6; Claude Sonnet 5 0/6. By scenario: Tokyo 1957 1/8; San Francisco 1906 0/8; Detroit 1972 0/8. The win rules are the engine's own (Detroit adds a population floor).
How much does it cost for an LLM to play Micropolis?
Mean model spend per run through OpenRouter: GPT-5.6 Terra $0.94; Jev Router $1.76; GPT-5.6 Luna $0.08; Claude Sonnet 5 $0.72. A model is called once per 3 game months: 80 turns for the 20-year grow task, 20 or 40 for a scenario.
How is the Micropolis eval kept fair between models?
Every model gets the same system prompt, the same text briefing format, the same action set and the same map or scenario and seed. The game is turn-based, so model latency never costs game time; random disasters are off (scenario disasters still happen); and each run has a 45-minute model budget after which the city runs untouched to the deadline.
Can I run the Micropolis LLM eval myself?
Yes. It is a Jetty runbook (task micropolis-city) on a prebuilt sandbox snapshot (micropolis-city). Create the task in your Jetty collection, add an OPENROUTER_API_KEY, and launch one API call per run with any OpenRouter model as the player. Instructions: evaljetty.com/micropolis/author.html.
What data is published for each run?
A timelapse video (one frame per game week), the final map, the Micropolis save file (.cty), every decision (the briefing, the model's reasoning, its actions and their results), per-turn city statistics as CSV, result and metrics JSON, the runtime configuration and the evals-v2 validation report. Aggregates: evaljetty.com/micropolis/data/runs.csv, runs.json and leaderboard.json.