evals
Create your eval

02 — Run · Round 1 · Detroit 1972: crime · gpt56terra-detroit-s2

GPT-5.6 Terra plays Detroit 1972

Detroit's crime is out of control in 1972. Bring average crime under 60 in 10 years, without emptying the city. Ended Jan 1982: lost, city score 693.

GOAL MISSED seed 2
GPT-5.6 Terra
openai/gpt-5.6-terra

LOST: Average crime 56 (goal < 60), population 6,880 (floor 25,000); engine verdict: won

Population (start → end)76,160 → 6,880 Peak population76,160City score (start → end)285 → 693 Funds at the end$0Crime / pollution / traffic56 / 48 / 0 Zones R / C / I141 / 70 / 90 Power plants (coal / nuclear)2 / 3Police / fire stations6 / 2 Turns (model / failed)40 (40 / 0) Actions applied / rejected193 / 13 Mean turn latency16.1sModel cost$1.050Wall clock10.8 min Jetty run IDef93e671

The city over time

Population

People, after every turn

Funds

Treasury, after every turn

City score

0–1000, re-evaluated each January

Table view
TurnDatePopulationFundsCity scoreCrimePollution
0Jan 197276,160$20,0002859264
1Apr 197272,440$15,8295399264
2Jul 197270,800$13,2695399362
3Oct 197266,120$9,6795396963
4Jan 197361,700$4,8614826963
5Apr 197356,580$4,8304825765
6Jul 197351,140$4,3154824857
7Oct 197346,800$4,3154824857
8Jan 197442,960$3,5644004355
9Apr 197437,240$3,3304004158
10Jul 197433,460$3,3304004154
11Oct 197430,740$3,3304003754
12Jan 197527,160$2,2373423452
13Apr 197524,140$2,2373423449
14Jul 197522,020$2,2373423149
15Oct 197519,660$2,2223422947
16Jan 197617,160$2,2073302946
17Apr 197614,960$2,2073302846
18Jul 197614,720$2,2023302646
19Oct 197614,760$1,6873302646
20Jan 197713,540$1,4953672645
21Apr 197711,720$1,4053675745
22Jul 197710,040$1,4053675746
23Oct 19778,920$1,4053675548
24Jan 19787,920$6183295348
25Apr 19787,380$6183295351
26Jul 19786,040$6033295147
27Oct 19785,440$5433294948
28Jan 19794,860$03244948
29Apr 19794,600$03244945
30Jul 19794,260$03244951
31Oct 19794,260$03244951
32Jan 19804,100$04804851
33Apr 19804,040$04804850
34Jul 19803,920$04804854
35Oct 19803,580$04804854
36Jan 19816,400$07404745
37Apr 19818,280$07404748
38Jul 19818,640$07405248
39Oct 19817,780$07405647
40Jan 19826,840$06935648

Final map

Final city map: GPT-5.6 Terra on Detroit 1972: crime

Evaluation

failchecks 9/10 verdict: valid run (code checks and checklist) and task goal met (judge)

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, key)
passsteplaunchLaunch run-city as a detached process
passstepsuperviseSupervise in the foreground until run-city exits
passsteprenderTimelapse video rendered
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checksim-reached-deadlineended Jan 1982 after 40 turns; scenario verdict True
passcode_checkdecisions-logged40 rows for 40 turns
passcode_checkllm-turns-valid0/40 model turns failed
passcode_checkvideo-decodesduration 36.9s
passcode_checklimits-respected10.8 wall-minutes (model budget 45.0 min)
failjudgescenario-goalLOST: Average crime 56 (goal < 60), population 6,880 (floor 25,000); engine verdict: won (score 0 / threshold 1)
passchecklistnotes-explain-outcomeNotes section added citing model thoughts from turns 1, 15, 28 and 40 explaining fiscal collapse and population loss
passchecklistplayer-matches-requestresult.json confirms player=gpt56terra model=openai/gpt-5.6-terra task=detroit seed=2 matching all requested parameters
passchecklistno-silent-outagerun.log shows 0 LLM failures across all 40 turns with no gaps or retries

Decision timeline

What the mayor thought and did each turn. Click a turn to jump the timelapse there.

Ready to stop guessing if your outputs are good?

Create your eval Book a 15-minute walkthrough
Connect your agent to Jetty →