gpt-5.5 `raw-v1`

Provider: openai · Run at 2026-04-28 · Submission 14649a4c

CaSS 35.0%

CBS 0.0% v1: 0 by design

Coverage 5%

Cost $4.90

Tokens (in/out) 1.72M / 60.3k

Cost circuit-breaker tripped. $4.00 cap exceeded at $4.90 estimated — tripped at task 0020 (fountain-with-pool); 0 task(s) marked did_not_run and excluded from the CaSS denominator.

Diagnostic row, not ranked. legacy task-set provenance; 20 task(s) missing canary/hash

Tier breakdown

The 3-dimension diagnostic matrix for this baseline. CBS can read 0 while the conservative v1 validator has low definitive coverage — that's expected for v1.

Tier	BOM pass	Scope pass	Buildability	CaSS	CBS	Coverage	n
trivial	100.0%	75.0%	0.0%	75.0%	0.0%	25%	4
easy	100.0%	25.0%	—	25.0%	0.0%	0%	4
medium	100.0%	50.0%	—	50.0%	0.0%	0%	4
hard	100.0%	25.0%	—	25.0%	0.0%	0%	4
stretch	100.0%	0.0%	—	0.0%	0.0%	0%	4

Per-task results

All 20 tasks attempted by this baseline. Click a task to see the same row from every model's perspective.

#	Slug	Tier	CaSS	BOM	Scope	Build	Ref sim	Iter	Tokens	Duration	Status	3D
0001	flat-plate-5x7	trivial	0	1	0	incon.	0.000	4	18.3k	1m30s		—
0002	flat-plate-5x5	trivial	1	1	1	0	0.500	5	9.8k	30.5s	pass	—
0003	staggered-column-2x2	trivial	1	1	1	incon.	0.000	3	10.7k	12.7s	pass	—
0004	hollow-frame-8x8	trivial	1	1	1	incon.	0.000	3	7.3k	1m00s	pass	—
0005	small-table	easy	0	1	0	incon.	0.000	4	6.9k	29.6s		—
0006	step-pyramid	easy	1	1	1	incon.	0.400	4	8.2k	23.5s	pass	—
0007	simple-gate	easy	0	1	0	incon.	0.000	3	20.1k	22.8s		—
0008	picture-frame	easy	0	1	0	incon.	0.042	10	78.5k	2m48s		—
0009	minifig-chair	medium	1	1	1	incon.	0.000	3	23.4k	32.1s	pass	—
0010	bookshelf-3-shelf	medium	0	1	0	incon.	0.000	6	127.9k	1m59s		—
0011	simple-bridge	medium	0	1	0	incon.	0.210	4	20.7k	43.3s		—
0012	square-lantern	medium	1	1	1	incon.	0.143	6	74.6k	1m52s	pass	—
0013	farm-tractor	hard	1	1	1	incon.	0.046	12	254.0k	3m10s	pass	—
0014	rolling-cart	hard	0	1	0	incon.	0.000	9	92.5k	1m57s		—
0015	drawbridge	hard	0	1	0	incon.	0.000	5	30.1k	1m24s		—
0016	slatted-bench	hard	0	1	0	incon.	0.000	5	49.6k	1m24s		—
0017	small-house	stretch	0	1	0	incon.	0.204	15	293.8k	3m22s		—
0018	small-lighthouse	stretch	0	1	0	incon.	0.000	9	66.6k	1m60s		—
0019	garden-shed	stretch	0	1	0	incon.	0.173	11	196.0k	4m28s		—
0020	fountain-with-pool	stretch	0	1	0	incon.	0.061	8	391.2k	1m60s		—

Submitted BOMs

The final BOM the model emitted on each task it attempted.

#0001 flat-plate-5x7 trivial CaSS 0

Red 5x7 bonded flat surface

part_num	color_id	qty
`78329`	4	7
`3023`	4	6
total pieces		13

#0002 flat-plate-5x5 trivial CaSS 1

Flat Red 5x5 Surface

part_num	color_id	qty
`78329`	4	5
total pieces		5

#0003 staggered-column-2x2 trivial CaSS 1

2x2x13 staggered red column

part_num	color_id	qty
`3004`	4	26
total pieces		26

#0004 hollow-frame-8x8 trivial CaSS 1

8x8 Hollow Square Frame

part_num	color_id	qty
`3460`	4	4
`3666`	4	4
total pieces		8

#0005 small-table easy CaSS 0

Minifigure-Clearance Table

part_num	color_id	qty
`3031`	70	1
`14716`	70	4
total pieces		5

#0006 step-pyramid easy CaSS 1

Tan Step Pyramid

part_num	color_id	qty
`3958`	19	1
`3031`	19	1
`3022`	19	1
total pieces		3

#0007 simple-gate easy CaSS 0

Simple Red Gate

part_num	color_id	qty
`3005`	4	10
`3009`	4	1
total pieces		11

#0008 picture-frame easy CaSS 0

Desk Picture Frame

part_num	color_id	qty
`3032`	15	1
`3036`	70	1
`3460`	70	2
`3710`	70	2
`3034`	70	1
`3937`	70	2
`3938`	70	2
`3004`	70	2
total pieces		13

#0009 minifig-chair medium CaSS 1

Minifigure Chair

part_num	color_id	qty
`3005`	70	8
`3021`	70	1
`3004`	70	1
total pieces		10

#0010 bookshelf-3-shelf medium CaSS 0

Small Brown Bookshelf

part_num	color_id	qty
`3032`	6	3
`3009`	6	6
`3622`	6	12
total pieces		21

#0011 simple-bridge medium CaSS 0

Small Footbridge

part_num	color_id	qty
`3003`	71	8
`3029`	70	1
`3004`	70	12
total pieces		21

#0012 square-lantern medium CaSS 1

4x4 Dark Grey Lantern

part_num	color_id	qty
`3031`	72	2
`3005`	72	20
`3004`	72	12
total pieces		34

#0013 farm-tractor hard CaSS 1

Small Green Farm Tractor

part_num	color_id	qty
`3034`	2	1
`3020`	2	2
`3021`	2	1
`3022`	2	1
`3003`	2	1
`3004`	2	2
`2877`	2	1
`2412a`	0	1
`21445`	0	4
`56904`	15	2
`58090`	0	2
`56902`	71	2
`11209`	0	2
`2717`	0	1
`3829c01`	0	1
total pieces		24

#0014 rolling-cart hard CaSS 0

Open Top Rolling Cart

part_num	color_id	qty
`3033`	4	1
`3008`	4	2
`3010`	4	2
`61252`	0	1
`2484c01`	4	4
`6014a`	14	4
`6015`	0	4
total pieces		18

#0015 drawbridge hard CaSS 0

Small Castle Drawbridge

part_num	color_id	qty
`41539`	71	1
`3003`	71	10
`3032`	70	1
`2429`	71	1
`2430`	70	1
total pieces		14

#0016 slatted-bench hard CaSS 0

Wood Slat Park Bench

part_num	color_id	qty
`60479`	70	4
`60479`	308	4
`14716`	72	4
`3005`	72	4
`3010`	72	4
`3039`	72	2
total pieces		22

#0017 small-house stretch CaSS 0

6x8 White House

part_num	color_id	qty
`3867`	2	1
`3010`	15	24
`3004`	15	36
`30179`	15	1
`5466`	70	1
`6160`	15	1
`57895`	47	1
`3039`	4	20
total pieces		85

#0018 small-lighthouse stretch CaSS 0

Small Lighthouse

part_num	color_id	qty
`3958`	71	3
`92947`	4	6
`92947`	15	6
`3633`	0	4
`4864a`	47	4
`6141`	14	1
`4032a`	71	2
`3942a`	4	1
total pieces		27

#0019 garden-shed stretch CaSS 0

Small Garden Shed

part_num	color_id	qty
`3867`	2	1
`3010`	28	32
`3004`	28	12
`3622`	28	4
`60596`	28	1
`40241`	6	1
`60592`	19	1
`60601`	47	1
`3030`	72	2
`3832`	72	1
`3004`	72	4
`7077`	484	1
`3741`	10	1
`24866`	4	3
total pieces		65

#0020 fountain-with-pool stretch CaSS 0

10x10 Garden Fountain

part_num	color_id	qty
`3033`	71	1
`3030`	71	1
`6111`	71	2
`3008`	71	2
`3069b`	41	32
`3941`	71	4
`3960`	71	1
`3062b`	41	4
total pieces		47

Run metadata

Submission ID	`14649a4c-e5de-4abc-a010-229dfd709adb`
Protocol	`raw-v1`
Protocol hash	`sha256:ec6641f2d101a9de13bfca90229cdb93b49f1bd9369f3f1e7587f41b33c4c69c`
Run at	`2026-04-28T15:21:36.567Z`
Total duration	32m08s
Adapter health	`ok`

gpt-5.5 raw-v1