evals
Create your eval

02 — Run · Round 1 · Tokyo 1957: monster attack · gpt56terra-tokyo-s1

GPT-5.6 Terra plays Tokyo 1957

A monster attacks Tokyo in 1957. Rebuild and get the city score above 500 within 5 years. Ended Jan 1962: won, city score 501.

GOAL MET seed 1
GPT-5.6 Terra
openai/gpt-5.6-terra

WON: City score 501 (goal > 500); engine verdict: won

Population (start → end)113,100 → 29,640 Peak population113,100City score (start → end)500 → 501 Funds at the end$0Crime / pollution / traffic27 / 47 / 4 Zones R / C / I129 / 97 / 76 Power plants (coal / nuclear)4 / 1Police / fire stations16 / 7 Turns (model / failed)20 (20 / 0) Actions applied / rejected135 / 25 Mean turn latency17.9sModel cost$0.614Wall clock6.0 min Jetty run ID00ff7869

The city over time

Population

People, after every turn

Funds

Treasury, after every turn

City score

0–1000, re-evaluated each January

Table view
TurnDatePopulationFundsCity scoreCrimePollution
0Jan 1957113,100$20,0005003164
1Apr 1957106,880$18,4616683164
2Jul 1957100,460$18,0266689063
3Oct 195794,660$17,9556689866
4Jan 195889,140$15,4054279866
5Apr 195884,480$9,2734279164
6Jul 195881,500$9,0524276366
7Oct 195877,340$8,2144276366
8Jan 195978,220$5,3525405661
9Apr 195974,000$5,1735405559
10Jul 195969,240$5,0675405557
11Oct 195961,420$5,0675405057
12Jan 196055,940$3,7784444354
13Apr 196051,180$3,7564444350
14Jul 196047,260$6784443950
15Oct 196043,460$6784443651
16Jan 196139,920$03823648
17Apr 196135,560$03823349
18Jul 196132,640$03823049
19Oct 196129,040$03823048
20Jan 196230,200$05012747

Final map

Final city map: GPT-5.6 Terra on Tokyo 1957: monster attack

Evaluation

passchecks 10/10 verdict: valid run (code checks and checklist) and task goal met (judge)

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, key)
passsteplaunchLaunch run-city as a detached process
passstepsuperviseSupervise in the foreground until run-city exits
passsteprenderTimelapse video rendered
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checksim-reached-deadlineended Jan 1962 after 20 turns; scenario verdict True
passcode_checkdecisions-logged20 rows for 20 turns
passcode_checkllm-turns-valid0/20 model turns failed
passcode_checkvideo-decodesduration 30.0s
passcode_checklimits-respected6.0 wall-minutes (model budget 45.0 min)
passjudgescenario-goalWON: City score 501 (goal > 500); engine verdict: won (score 1 / threshold 1)
passchecklistnotes-explain-outcomesummary.md has Notes section explaining the score-501 win, citing model thoughts from turns 1, 8, and 20
passchecklistplayer-matches-requestresult.json confirms player=gpt56terra, task=tokyo, seed=1 matching runbook parameters
passchecklistno-silent-outagerun.log shows 20 consecutive successful turns with 0 LLM failures, no gaps or error stretches

Decision timeline

What the mayor thought and did each turn. Click a turn to jump the timelapse there.

Ready to stop guessing if your outputs are good?

Create your eval Book a 15-minute walkthrough
Connect your agent to Jetty →