evals
Create your eval

02 — Run · Round 1 · Detroit 1972: crime · gpt56luna-detroit-s1

GPT-5.6 Luna plays Detroit 1972

Detroit's crime is out of control in 1972. Bring average crime under 60 in 10 years, without emptying the city. Ended Jan 1982: lost, city score 547.

GOAL MISSED seed 1
GPT-5.6 Luna
openai/gpt-5.6-luna

LOST: Average crime 24 (goal < 60), population 7,400 (floor 25,000); engine verdict: won

Population (start → end)76,160 → 7,400 Peak population76,160City score (start → end)285 → 547 Funds at the end$1Crime / pollution / traffic24 / 45 / 0 Zones R / C / I160 / 67 / 94 Power plants (coal / nuclear)2 / 3Police / fire stations16 / 7 Turns (model / failed)40 (40 / 0) Actions applied / rejected188 / 40 Mean turn latency7.0sModel cost$0.084Wall clock4.8 min Jetty run IDfde1c078

The city over time

Population

People, after every turn

Funds

Treasury, after every turn

City score

0–1000, re-evaluated each January

Table view
TurnDatePopulationFundsCity scoreCrimePollution
0Jan 197276,160$20,0002859267
1Apr 197273,380$18,3445399267
2Jul 197270,720$16,59853910764
3Oct 197264,740$15,72353910760
4Jan 197359,880$12,27346210760
5Apr 197354,900$10,2714628254
6Jul 197350,000$10,2094627755
7Oct 197347,140$9,1744627755
8Jan 197443,700$5,9983976554
9Apr 197437,680$5,4833975448
10Jul 197433,100$5,4783975448
11Oct 197429,140$5,4003974848
12Jan 197525,640$3,5033334347
13Apr 197523,360$2,9993334349
14Jul 197521,240$2,9993333649
15Oct 197518,740$2,8713333349
16Jan 197617,020$03253346
17Apr 197615,620$03253047
18Jul 197614,120$03252947
19Oct 197612,720$03252945
20Jan 197712,980$114122744
21Apr 197712,040$114122744
22Jul 197710,020$114122747
23Oct 19778,780$114122546
24Jan 19787,880$1933332346
25Apr 19788,240$133332346
26Jul 197811,040$133332546
27Oct 197810,360$133332550
28Jan 19798,080$2164342550
29Apr 19797,040$124342653
30Jul 19796,000$124342452
31Oct 19795,500$124342452
32Jan 19807,880$126062256
33Apr 198012,500$26062248
34Jul 198012,420$26062251
35Oct 198011,520$26062851
36Jan 19819,860$3156872748
37Apr 19818,560$66872746
38Jul 19818,220$16872646
39Oct 19817,740$16872446
40Jan 19827,240$15472445

Final map

Final city map: GPT-5.6 Luna on Detroit 1972: crime

Evaluation

failchecks 9/10 verdict: valid run (code checks and checklist) and task goal met (judge)

StatusKindCheckDetail
passstepenvironmentEnvironment check (snapshot, engine, key)
passsteplaunchLaunch run-city as a detached process
passstepsuperviseSupervise in the foreground until run-city exits
passsteprenderTimelapse video rendered
passstepnotesAppend Notes to summary.md
passcode_checkoutputs-existall present
passcode_checksim-reached-deadlineended Jan 1982 after 40 turns; scenario verdict True
passcode_checkdecisions-logged40 rows for 40 turns
passcode_checkllm-turns-valid0/40 model turns failed
passcode_checkvideo-decodesduration 36.9s
passcode_checklimits-respected4.8 wall-minutes (model budget 45.0 min)
failjudgescenario-goalLOST: Average crime 24 (goal < 60), population 7,400 (floor 25,000); engine verdict: won (score 0 / threshold 1)
passchecklistnotes-explain-outcomeNotes section added citing model thoughts from turns 1, 28, and 40 explaining the crime-vs-population trade-off
passchecklistplayer-matches-requestresult.json confirms player=gpt56luna model=openai/gpt-5.6-luna task=detroit seed=1 matching requested parameters
passchecklistno-silent-outagerun.log shows 0 failed model turns across all 40 turns with continuous per-turn logging

Decision timeline

What the mayor thought and did each turn. Click a turn to jump the timelapse there.

Ready to stop guessing if your outputs are good?

Create your eval Book a 15-minute walkthrough
Connect your agent to Jetty →