models /
claude-opus-4-7 scaffold-v1
Provider: anthropic ·
Run at 2026-04-28 ·
Submission e15198d2
Build Points — / 172 available
CaSS 37.5%
CBS — No confirmed builds yet — a BOM-only protocol can't earn CBS.
Coverage 13%
Cost $8.48
Tokens (in/out) 449.9k / 23.1k
Diagnostic row, not ranked. legacy task-set provenance; 8 task(s) missing canary/hash; 8/37 task results
Tier breakdown
The 3-dimension diagnostic matrix for this submission. A tier shows no CBS until the structural prover returns a definitive verdict there.
| Tier | BOM pass | Scope pass | Buildability | CaSS | CBS | Coverage | n |
|---|---|---|---|---|---|---|---|
| trivial | 100.0% | 50.0% | 0.0% | 50.0% | 0.0% | 25% | 4 |
| easy | 100.0% | 25.0% | — | 25.0% | 0.0% | 0% | 4 |
Per-task results
All 8 tasks attempted by this baseline. Click a task to see the same row from every model's perspective.
| # | Slug | Tier | CaSS | BOM | Scope | Build | Ref sim | Iter | Tokens | Duration | Status | 3D |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0001 | flat-plate-3x3 | trivial | 0 | 1 | 0 | 0 | 0.000 | 4 | 15.7k | 28.2s | — | |
| 0002 | flat-plate-5x5 | trivial | 1 | 1 | 1 | incon. | 0.500 | 4 | 36.7k | 1m27s | pass | — |
| 0003 | tall-column | trivial | 0 | 1 | 0 | incon. | 0.000 | 3 | 11.1k | 18.8s | — | |
| 0004 | square-frame-6x6 | trivial | 1 | 1 | 1 | incon. | 0.000 | 5 | 28.1k | 1m08s | pass | — |
| 0005 | small-table | easy | 0 | 1 | 0 | incon. | 0.000 | 4 | 19.9k | 44.0s | — | |
| 0006 | step-pyramid | easy | 1 | 1 | 1 | incon. | 0.400 | 7 | 47.1k | 50.5s | pass | — |
| 0007 | simple-gate | easy | 0 | 1 | 0 | incon. | 0.000 | 4 | 42.5k | 51.2s | — | |
| 0008 | picture-frame | easy | 0 | 1 | 0 | incon. | 0.043 | 9 | 272.0k | 4m20s | — |
Submitted BOMs
The final BOM the model emitted on each task it attempted.
#0001 flat-plate-3x3 trivial CaSS 0
| part_num | color_id | qty |
|---|---|---|
11212 | 4 | 1 |
| total pieces | 1 | |
#0002 flat-plate-5x5 trivial CaSS 1
| part_num | color_id | qty |
|---|---|---|
3031 | 4 | 1 |
3710 | 4 | 1 |
78329 | 4 | 6 |
| total pieces | 8 | |
#0003 tall-column trivial CaSS 0
| part_num | color_id | qty |
|---|---|---|
3005 | 4 | 4 |
| total pieces | 4 | |
#0004 square-frame-6x6 trivial CaSS 1
| part_num | color_id | qty |
|---|---|---|
3666 | 4 | 4 |
3710 | 4 | 4 |
| total pieces | 8 | |
#0005 small-table easy CaSS 0
| part_num | color_id | qty |
|---|---|---|
14716 | 70 | 4 |
3031 | 70 | 1 |
| total pieces | 5 | |
#0006 step-pyramid easy CaSS 1
| part_num | color_id | qty |
|---|---|---|
3958 | 19 | 1 |
3031 | 19 | 1 |
3022 | 19 | 1 |
| total pieces | 3 | |
#0007 simple-gate easy CaSS 0
| part_num | color_id | qty |
|---|---|---|
3005 | 4 | 10 |
3009 | 4 | 1 |
| total pieces | 11 | |
#0008 picture-frame easy CaSS 0
| part_num | color_id | qty |
|---|---|---|
3036 | 6 | 1 |
3009 | 6 | 2 |
3005 | 6 | 2 |
3622 | 6 | 2 |
3010 | 6 | 2 |
3666 | 6 | 2 |
3032 | 15 | 1 |
| total pieces | 12 | |
Run metadata
| Submission ID | e15198d2-1170-483c-94c5-15ab3c873ec5 |
|---|---|
| Protocol | scaffold-v1 |
| Protocol hash | sha256:83fca868afffd414061a997e14f4688a0c96a4e750c2c91de23e7c5be11a2b7d |
| Run at | 2026-04-28T01:51:34.114Z |
| Total duration | 10m07s |
| Adapter health | n/a |