BrickAGI benchmark

models /

claude-opus-4-8-coordinator scaffold-assembly-v1

Provider: anthropic · Run at 2026-06-08 · Submission b1a9c0de

Build Points 2,631 / 2,631 available
CaSS 100.0%
CBS 100.0%
Coverage 100%
Cost $0
Tokens (in/out) 0 / 0
Diagnostic row, not ranked. legacy task-set provenance

Tier breakdown

The 3-dimension diagnostic matrix for this submission. A tier shows no CBS until the structural prover returns a definitive verdict there.

Tier BOM pass Scope pass Buildability CaSS CBS Coverage n
trivial 100.0% 100.0% 100.0% 100.0% 100.0% 100% 4
easy 100.0% 100.0% 100.0% 100.0% 100.0% 100% 4
medium 100.0% 100.0% 100.0% 100.0% 100.0% 100% 9
hard 100.0% 100.0% 100.0% 100.0% 100.0% 100% 7
stretch 100.0% 100.0% 100.0% 100.0% 100.0% 100% 4
expert 100.0% 100.0% 100.0% 100.0% 100.0% 100% 4
master 100.0% 100.0% 100.0% 100.0% 100.0% 100% 5

Per-task results

All 37 tasks attempted by this baseline. Click a task to see the same row from every model's perspective.

# Slug Tier CaSS BOM Scope Build Ref sim Iter Tokens Duration Status 3D
0001 flat-plate-5x7 trivial 1 1 1 1 0.400 1 0 0ms pass 3D
0002 flat-plate-5x5 trivial 1 1 1 1 1.000 1 0 0ms pass 3D
0003 staggered-column-2x2 trivial 1 1 1 1 1.000 1 0 0ms pass 3D
0004 hollow-frame-8x8 trivial 1 1 1 1 1.000 1 0 0ms pass 3D
0005 small-table easy 1 1 1 1 0.000 1 0 0ms pass 3D
0006 step-pyramid easy 1 1 1 1 1.000 1 0 0ms pass 3D
0007 simple-gate easy 1 1 1 1 1.000 1 0 0ms pass 3D
0008 picture-frame easy 1 1 1 1 0.250 1 0 0ms pass 3D
0009 minifig-chair medium 1 1 1 1 0.833 1 0 0ms pass 3D
0010 bookshelf-3-shelf medium 1 1 1 1 0.538 1 0 0ms pass 3D
0011 simple-bridge medium 1 1 1 1 1.000 1 0 0ms pass 3D
0012 square-lantern medium 1 1 1 1 1.000 1 0 0ms pass 3D
0013 farm-tractor hard 1 1 1 1 0.387 1 0 0ms pass 3D
0014 rolling-cart hard 1 1 1 1 0.667 1 0 0ms pass 3D
0015 drawbridge hard 1 1 1 1 1.000 1 0 0ms pass 3D
0016 slatted-bench hard 1 1 1 1 0.386 1 0 0ms pass 3D
0017 small-house stretch 1 1 1 1 0.176 1 0 0ms pass 3D
0018 small-lighthouse stretch 1 1 1 1 0.140 1 0 0ms pass 3D
0019 garden-shed stretch 1 1 1 1 0.011 1 0 0ms pass 3D
0020 fountain-with-pool stretch 1 1 1 1 0.144 1 0 0ms pass 3D
0021 grand-bridge expert 1 1 1 1 1.000 1 0 0ms pass 3D
0022 manor-house expert 1 1 1 1 1.000 1 0 0ms pass 3D
0023 clock-tower expert 1 1 1 1 1.000 1 0 0ms pass 3D
0024 grand-fountain expert 1 1 1 1 1.000 1 0 0ms pass 3D
0025 mosaic-smiley master 1 1 1 1 1.000 1 0 0ms pass 3D
0026 voxel-tree master 1 1 1 1 1.000 1 0 0ms pass 3D
0027 grand-mosaic-sunset master 1 1 1 1 1.000 1 0 0ms pass 3D
0028 mega-voxel-rocket master 1 1 1 1 1.000 1 0 0ms pass 3D
0029 colossal-mosaic-grid master 1 1 1 1 1.000 1 0 0ms pass 3D
0030 bonded-plate-7x7 medium 1 1 1 1 1.000 1 0 0ms pass 3D
0031 bonded-platform-9x5 medium 1 1 1 1 1.000 1 0 0ms pass 3D
0032 frame-6x6 medium 1 1 1 1 1.000 1 0 0ms pass 3D
0033 grand-table-6x6 medium 1 1 1 1 1.000 1 0 0ms pass 3D
0034 great-pyramid-8x8 medium 1 1 1 1 1.000 1 0 0ms pass 3D
0035 wide-gate hard 1 1 1 1 1.000 1 0 0ms pass 3D
0036 throne hard 1 1 1 1 1.000 1 0 0ms pass 3D
0037 tall-column-2x2 hard 1 1 1 1 1.000 1 0 0ms pass 3D

Submitted BOMs

The final BOM the model emitted on each task it attempted.

#0001 flat-plate-5x7 trivial CaSS 1

Flat plate 5x7 (red, bonded two-layer)
part_num color_id qty
3032 4 2
3666 4 2
78329 4 2
total pieces 6

#0002 flat-plate-5x5 trivial CaSS 1

Bonded Red 5x5 Flat Plate
part_num color_id qty
78329 4 10
total pieces 10

#0003 staggered-column-2x2 trivial CaSS 1

Staggered 2x2 Column (13 bricks tall)
part_num color_id qty
3004 15 26
total pieces 26

#0004 hollow-frame-8x8 trivial CaSS 1

hollow-frame-8x8
part_num color_id qty
3460 15 2
3666 15 2
3023 15 4
total pieces 8

#0005 small-table easy CaSS 1

Small Table
part_num color_id qty
3005 70 12
3031 70 1
total pieces 13

#0006 step-pyramid easy CaSS 1

Egyptian Step Pyramid
part_num color_id qty
3032 19 1
3795 19 1
3031 19 1
3022 19 1
total pieces 4

#0007 simple-gate easy CaSS 1

Simple Gate
part_num color_id qty
3005 15 10
3666 15 1
total pieces 11

#0008 picture-frame easy CaSS 1

standing picture frame (vertical, backboard-mounted)
part_num color_id qty
3033 70 1
3032 15 1
3010 70 2
3009 70 2
3036 70 1
3005 70 6
total pieces 13

#0009 minifig-chair medium CaSS 1

Minifig Chair
part_num color_id qty
3022 4 1
3005 4 8
3004 4 1
total pieces 10

#0010 bookshelf-3-shelf medium CaSS 1

3-shelf bookshelf (brown)
part_num color_id qty
3004 70 18
3795 70 3
3710 70 9
total pieces 30

#0011 simple-bridge medium CaSS 1

Simple stone footbridge
part_num color_id qty
3003 71 8
3035 71 1
3020 71 2
3032 71 2
3005 71 12
total pieces 25

#0012 square-lantern medium CaSS 1

Square Lantern
part_num color_id qty
3031 72 2
3010 72 8
3005 72 4
total pieces 14

#0013 farm-tractor hard CaSS 1

Farm Tractor (green)
part_num color_id qty
3035 2 1
30157 2 2
56145 0 2
92402 0 2
4624 0 2
3641 0 2
3003 2 2
3022 2 3
3795 2 2
3020 2 1
3023 2 1
4079 2 1
3062b 2 1
total pieces 22

#0014 rolling-cart hard CaSS 1

Rolling Cart
part_num color_id qty
3032 70 1
30157 70 2
4624 70 4
3641 0 4
3010 70 4
3009 70 4
4623 70 1
total pieces 20

#0015 drawbridge hard CaSS 1

Castle Drawbridge
part_num color_id qty
3004 71 10
3795 71 1
3937 71 1
3830 70 1
3020 70 1
3710 70 1
total pieces 15

#0016 slatted-bench hard CaSS 1

Slatted Park Bench
part_num color_id qty
3029 70 1
3010 70 8
3710 70 32
3710 308 12
3028 70 1
3622 70 2
3024 308 4
total pieces 60

#0017 small-house stretch CaSS 1

Small House
part_num color_id qty
92438 15 1
3004 15 65
3005 15 26
60596 70 1
60616 70 1
60593 15 1
3037 4 12
3460 4 8
3020 15 12
3022 15 6
total pieces 133

#0018 small-lighthouse stretch CaSS 1

Small Lighthouse
part_num color_id qty
3032 71 60
3795 71 60
3031 71 1
3941 4 6
3941 15 6
3031 4 1
3062b 15 4
3005 47 4
6233 4 1
total pieces 143

#0019 garden-shed stretch CaSS 1

Garden Shed
part_num color_id qty
92438 72 4
3004 69 10
3622 69 4
3009 69 12
3008 69 5
60596 70 1
60616 70 1
60593 69 1
6065 28 1
3024 69 108
total pieces 147

#0020 fountain-with-pool stretch CaSS 1

Garden Fountain with Pool
part_num color_id qty
3030 71 1
3033 71 1
3010 71 8
3004 71 20
3941 71 4
4032b 71 1
3062b 43 6
3460 43 6
3623 43 4
3024 71 99
total pieces 150

#0021 grand-bridge expert CaSS 1

Grand Bonded Bridge
part_num color_id qty
3003 71 15
3005 71 28
3020 71 10
3832 71 2
total pieces 55

#0022 manor-house expert CaSS 1

manor house: two-bay enclosed white shell, hinged door, 3 windows, sloped roof
part_num color_id qty
91405 71 1
3622 15 5
3009 15 22
3005 15 5
3008 15 34
3004 15 7
3010 15 5
3020 15 30
60596 70 1
60616 70 1
60593 15 3
3037 4 56
3038 4 15
3039 4 17
total pieces 202

#0023 clock-tower expert CaSS 1

tall clock tower (grey base, red/white round shaft, clock/lamp room, cone roof)
part_num color_id qty
41539 71 2
3958 71 1
3031 71 1
3941 4 10
3941 15 10
3062b 72 64
3062b 71 72
3024 71 20
3031 72 1
3024 72 12
3005 47 8
3022 14 1
6233 4 1
total pieces 203

#0024 grand-fountain expert CaSS 1

grand fountain with 14x14 pool (light bluish gray + trans-light-blue)
part_num color_id qty
3033 71 1
3032 71 1
41539 71 1
3036 71 1
2445 71 6
3010 71 24
3004 71 4
3031 43 9
3941 71 6
4032b 71 1
3062b 71 1
3062b 43 8
3022 71 176
3023 71 8
3022 43 20
total pieces 267

#0025 mosaic-smiley master CaSS 1

mosaic-smiley-reference
part_num color_id qty
60479 15 2
3710 15 6
78329 15 4
3666 14 3
3460 14 2
3623 15 4
4477 14 1
3023 15 4
60479 14 4
3024 15 12
3710 14 6
3023 0 7
3023 14 6
3623 14 4
3024 0 2
60479 72 16
3710 72 16
total pieces 99

#0026 voxel-tree master CaSS 1

voxel tree (brown trunk + green crown)
part_num color_id qty
3022 2 9
3022 70 3
3023 2 4
total pieces 16

#0027 grand-mosaic-sunset master CaSS 1

grand-mosaic-sunset-reference
part_num color_id qty
3023 0 1
3023 14 2
3023 25 4
3023 72 3
3023 322 1
3024 0 13
3024 14 5
3024 25 10
3024 72 13
3024 191 9
3024 226 7
3024 322 3
3460 0 3
3460 14 5
3460 25 1
3460 72 2
3460 191 9
3460 226 1
3623 0 5
3623 14 1
3623 25 5
3623 72 9
3666 0 27
3666 1 24
3666 14 4
3666 25 3
3666 72 6
3666 226 4
3666 322 1
3710 14 2
3710 25 3
4477 0 2
4477 14 1
4477 25 2
4477 72 1
4477 191 9
4477 322 1
60479 0 103
60479 1 76
60479 14 16
60479 25 19
60479 72 12
60479 191 25
60479 226 4
60479 322 42
78329 0 3
78329 14 11
78329 25 1
78329 72 10
78329 226 2
78329 322 1
total pieces 527

#0028 mega-voxel-rocket master CaSS 1

mega-voxel-rocket (reference)
part_num color_id qty
11212 4 2
11212 71 2
3020 4 4
3021 4 4
3022 4 5
3022 14 2
3022 15 4
3023 1 2
3023 4 4
3023 25 1
3024 4 1
3024 15 16
3024 25 4
3024 71 2
3031 4 2
3031 15 8
3031 71 6
3623 25 2
3710 25 1
3710 71 2
total pieces 74

#0029 colossal-mosaic-grid master CaSS 1

colossal-mosaic-grid reference
part_num color_id qty
3023 1 4
3023 4 6
3023 14 4
3023 15 12
3024 1 52
3024 4 80
3024 14 24
3024 15 36
3460 1 2
3460 4 4
3460 14 2
3460 15 18
3623 15 12
3666 1 54
3666 4 84
3666 14 26
3666 15 16
3710 0 120
3710 1 2
3710 4 4
3710 14 2
3710 15 8
4477 1 2
4477 4 4
4477 14 2
4477 15 16
60479 0 40
60479 1 4
60479 4 6
60479 14 4
60479 15 88
78329 15 8
91405 15 25
total pieces 771

#0030 bonded-plate-7x7 medium CaSS 1

7x7 flat red plate (two-layer bonded reference)
part_num color_id qty
3958 4 2
3666 4 4
3024 4 2
total pieces 8

#0031 bonded-platform-9x5 medium CaSS 1

9x5 bonded red platform (two-layer crossing-seam reference)
part_num color_id qty
3032 4 2
3666 4 2
11212 4 2
3021 4 2
total pieces 8

#0032 frame-6x6 medium CaSS 1

6x6 hollow square frame with corner-bonding layer (white)
part_num color_id qty
3666 15 2
3710 15 2
3023 15 4
total pieces 8

#0033 grand-table-6x6 medium CaSS 1

Grand Table 6x6
part_num color_id qty
3958 19 1
3005 70 16
total pieces 17

#0034 great-pyramid-8x8 medium CaSS 1

great step pyramid (tan, 3 layers: 8x8 base -> 6x6 mid -> 4x4 top)
part_num color_id qty
3035 19 2
3958 19 1
3031 19 1
total pieces 4

#0035 wide-gate hard CaSS 1

wide gate (light bluish gray, two 6-brick 2x2 pillars, 2x10 lintel + cap)
part_num color_id qty
3003 71 12
3832 71 2
total pieces 14

#0036 throne hard CaSS 1

throne (red, 3x3 seat on four corner legs, tall brick backrest)
part_num color_id qty
3005 4 12
11212 4 1
3004 4 9
total pieces 22

#0037 tall-column-2x2 hard CaSS 1

Tall masonry column 2x2 x 9 courses
part_num color_id qty
3004 15 18
total pieces 18

Run metadata

Submission IDb1a9c0de-1f41-4ddd-8aaa-coordfull14
Protocolscaffold-assembly-v1
Protocol hashsha256:394f2d859fafd42d0ac144c5f251e68ea2e7f4c06da48bf733e1c2505055ee9c
Run at2026-06-08T00:00:00Z
Total duration0ms
Adapter healthn/a