models /

gemini-3-pro-preview `scaffold-v1`

Provider: google · Run at 2026-04-28 · Submission 45958cb4

Build Points — / 274 available

CaSS 36.1%

CBS — No confirmed builds yet — a BOM-only protocol can't earn CBS.

Coverage 9%

Cost $3.28

Tokens (in/out) 1.27M / 10.1k

Diagnostic row, not ranked. legacy task-set provenance; 11 task(s) missing canary/hash; 11/37 task results

Tier breakdown

The 3-dimension diagnostic matrix for this submission. A tier shows no CBS until the structural prover returns a definitive verdict there.

Tier	BOM pass	Scope pass	Buildability	CaSS	CBS	Coverage	n
trivial	75.0%	25.0%	0.0%	25.0%	0.0%	25%	4
easy	100.0%	50.0%	—	50.0%	0.0%	0%	4
medium	100.0%	33.3%	—	33.3%	0.0%	0%	3

Per-task results

All 11 tasks attempted by this baseline. Click a task to see the same row from every model's perspective.

#	Slug	Tier	CaSS	BOM	Scope	Build	Ref sim	Iter	Tokens	Duration	Status	3D
0001	flat-plate-3x3	trivial	0	1	0	0	0.000	6	19.4k	39.3s		—
0002	flat-plate-5x5	trivial	1	1	1	incon.	0.000	7	53.5k	1m24s	pass	—
0003	tall-column	trivial	0	1	0	incon.	0.000	4	21.1k	18.8s		—
0004	square-frame-6x6	trivial	0	0	0	incon.	0.000	20	241.7k	2m38s	DNC	—
0005	small-table	easy	0	1	0	incon.	0.000	14	380.5k	1m51s		—
0006	step-pyramid	easy	1	1	1	incon.	0.400	6	32.4k	33.2s	pass	—
0007	simple-gate	easy	0	1	0	incon.	0.000	5	31.1k	42.2s		—
0008	picture-frame	easy	1	1	1	incon.	0.217	15	144.3k	2m19s	pass	—
0009	minifig-chair	medium	1	1	1	incon.	0.000	6	146.6k	1m09s	pass	—
0010	bookshelf-3-shelf	medium	0	1	0	incon.	0.000	6	77.2k	1m22s		—
0011	simple-bridge	medium	0	1	0	incon.	0.229	10	132.3k	1m18s		—

Submitted BOMs

The final BOM the model emitted on each task it attempted.

#0001 flat-plate-3x3 trivial CaSS 0

3x3 Flat Red Surface

part_num	color_id	qty
`11212`	4	1
total pieces		1

#0002 flat-plate-5x5 trivial CaSS 1

5x5 Flat Red Surface

part_num	color_id	qty
`11212`	4	1
`3021`	4	2
`3022`	4	1
`3031`	4	1
`3710`	4	2
`3024`	4	1
total pieces		8

#0003 tall-column trivial CaSS 0

4-Brick Column

part_num	color_id	qty
`3005`	4	4
total pieces		4

#0004 square-frame-6x6 DNC

hit HARD_TURN_CAP (20)

#0005 small-table easy CaSS 0

Minifigure Table

part_num	color_id	qty
`87079`	70	2
`3031`	70	1
`2453a`	70	4
total pieces		7

#0006 step-pyramid easy CaSS 1

Small Step Pyramid

part_num	color_id	qty
`3958`	19	1
`3031`	19	1
`3022`	19	1
total pieces		3

#0007 simple-gate easy CaSS 0

Simple Gate

part_num	color_id	qty
`3003`	4	10
`3007`	4	1
total pieces		11

#0008 picture-frame easy CaSS 1

Standing Picture Frame

part_num	color_id	qty
`3032`	70	1
`3666`	70	2
`6636`	70	2
`3009`	70	1
`11211`	70	3
`3035`	70	1
`3034`	70	1
`3032`	15	1
`3008`	70	2
`3010`	70	2
total pieces		16

#0009 minifig-chair medium CaSS 1

Minifigure Chair

part_num	color_id	qty
`3005`	0	8
`3021`	0	1
`3004`	0	1
`3023`	0	1
total pieces		11

#0010 bookshelf-3-shelf medium CaSS 0

Bookshelf

part_num	color_id	qty
`3032`	70	3
`3009`	70	4
`3010`	70	6
`3622`	70	8
total pieces		21

#0011 simple-bridge medium CaSS 0

Small Footbridge

part_num	color_id	qty
`3003`	71	8
`3029`	70	1
`3633`	70	6
`87079`	70	3
total pieces		18

Run metadata

Submission ID	`45958cb4-5e25-49dc-b3cb-ad7dfd06c3f7`
Protocol	`scaffold-v1`
Protocol hash	`sha256:83fca868afffd414061a997e14f4688a0c96a4e750c2c91de23e7c5be11a2b7d`
Run at	`2026-04-28T03:50:58.810Z`
Total duration	14m15s
Adapter health	`n/a`

gemini-3-pro-preview scaffold-v1