BrickAGI benchmark

models /

claude-opus-4-7 raw-v1

Provider: anthropic · Run at 2026-04-28 · Submission 43941bdf

Build Points — / 845 available
CaSS 0.0%
CBS — No confirmed builds yet — a BOM-only protocol can't earn CBS.
Coverage 0%
Cost $0
Tokens (in/out) 0 / 0
Diagnostic row, not ranked. legacy task-set provenance; 20 task(s) missing canary/hash; 20/37 task results; no scoreable per-task data

Tier breakdown

The 3-dimension diagnostic matrix for this submission. A tier shows no CBS until the structural prover returns a definitive verdict there.

Tier BOM pass Scope pass Buildability CaSS CBS Coverage n
trivial 0.0% 0.0% — 0.0% 0.0% 0% 4
easy 0.0% 0.0% — 0.0% 0.0% 0% 4
medium 0.0% 0.0% — 0.0% 0.0% 0% 4
hard 0.0% 0.0% — 0.0% 0.0% 0% 4
stretch 0.0% 0.0% — 0.0% 0.0% 0% 4

Per-task results

All 20 tasks attempted by this baseline. Click a task to see the same row from every model's perspective.

# Slug Tier CaSS BOM Scope Build Ref sim Iter Tokens Duration Status 3D
0001 flat-plate-3x3 trivial 0 0 0 incon. 0.000 1 0 165ms DNC —
0002 flat-plate-5x5 trivial 0 0 0 incon. 0.000 1 0 69ms DNC —
0003 tall-column trivial 0 0 0 incon. 0.000 1 0 60ms DNC —
0004 square-frame-6x6 trivial 0 0 0 incon. 0.000 1 0 48ms DNC —
0005 small-table easy 0 0 0 incon. 0.000 1 0 87ms DNC —
0006 step-pyramid easy 0 0 0 incon. 0.000 1 0 295ms DNC —
0007 simple-gate easy 0 0 0 incon. 0.000 1 0 2.7s DNC —
0008 picture-frame easy 0 0 0 incon. 0.000 1 0 57ms DNC —
0009 minifig-chair medium 0 0 0 incon. 0.000 1 0 74ms DNC —
0010 bookshelf-3-shelf medium 0 0 0 incon. 0.000 1 0 159ms DNC —
0011 simple-bridge medium 0 0 0 incon. 0.000 1 0 46ms DNC —
0012 square-lantern medium 0 0 0 incon. 0.000 1 0 52ms DNC —
0013 farm-tractor hard 0 0 0 incon. 0.000 1 0 53ms DNC —
0014 rolling-cart hard 0 0 0 incon. 0.000 1 0 49ms DNC —
0015 drawbridge hard 0 0 0 incon. 0.000 1 0 25.5s DNC —
0016 slatted-bench hard 0 0 0 incon. 0.000 1 0 48ms DNC —
0017 small-house stretch 0 0 0 incon. 0.000 1 0 131ms DNC —
0018 small-lighthouse stretch 0 0 0 incon. 0.000 1 0 55ms DNC —
0019 garden-shed stretch 0 0 0 incon. 0.000 1 0 50ms DNC —
0020 fountain-with-pool stretch 0 0 0 incon. 0.000 1 0 52ms DNC —

Submitted BOMs

The final BOM the model emitted on each task it attempted.

#0001 flat-plate-3x3 DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3aKJy5W89hLfhoaZp"}

#0002 flat-plate-5x5 DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3aiNWJyf8L8S9ECvu"}

#0003 tall-column DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3avXb1wzXRA88hgN3"}

#0004 square-frame-6x6 DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3bAf4ooAXS9w2xSqp"}

#0005 small-table DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3bUm8vp3SgYFBJHfZ"}

#0006 step-pyramid DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3ceD5FKNgcnWmBSDd"}

#0007 simple-gate DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3dEBaBRTuWNzKFHJ8"}

#0008 picture-frame DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3pc3n8JXcUgS6m7t1"}

#0009 minifig-chair DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3ptQdBtaDXc8EF2EV"}

#0010 bookshelf-3-shelf DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3qBXJ1Gq5P1x2t7kN"}

#0011 simple-bridge DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3qqhz6L9KLwj1rvFn"}

#0012 square-lantern DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3r3MxbHHk26bRxqFZ"}

#0013 farm-tractor DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3rGGCcPe3M4mXJE4K"}

#0014 rolling-cart DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS3rVQT1gA9j7Ty38nW"}

#0015 drawbridge DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS5grXHUmEj3dKhNeYV"}

#0016 slatted-bench DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS5jgBkmrwSiSzvUdSt"}

#0017 small-house DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS5kBCGUjwee4doVgJs"}

#0018 small-lighthouse DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS5kTpFNtUx43dbcNem"}

#0019 garden-shed DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS5kgTbGfJQNdBWiTmN"}

#0020 fountain-with-pool DNC

adapter error: Anthropic 400: {"type":"error","error":{"type":"invalid_request_error","message":"Your credit balance is too low to access the Anthropic API. Please go to Plans & Billing to upgrade or purchase credits."},"request_id":"req_011CaVS5ku6zeqgHBXRa34rC"}

Run metadata

Submission ID43941bdf-3560-4bfd-8a72-ec3e9bbace5d
Protocolraw-v1
Protocol hashsha256:ec6641f2d101a9de13bfca90229cdb93b49f1bd9369f3f1e7587f41b33c4c69c
Run at2026-04-28T03:08:10.706Z
Total duration29.8s
Adapter healthn/a