← All benchmarks

RWE-bench

Agents · 2026-10-28

Xplore's private Real World Engineering Bench: 20 engineering design tasks (9 mechanical, 6 aerospace, 5 electrical), such as designing a fatigue-limited diesel crankshaft in CAD, routing a DDR3 memory interface on a populated production board, or meshing and solving turbine-vane CFD, each written by a domain engineer with a reference solution. Agents work in a sandbox with professional CAD and CAE tools for up to 24 hours per run, and a deterministic verifier that runs physics solvers, with no LLM or human grading, passes a design only if it meets every requirement in the brief. Each model runs up to five times per task in its developer's coding agent; the average pass rate is the share of passing runs averaged over the tasks.

Top models (higher is better)