Welcome to the real world. Today weโre introducing FrontierEE Bench, the first benchmark to test frontier models on electrical engineering tasks at a physical lab bench.
Real-world engineering benchmarks should involve real hardware. At our lab, models control instrumentation, run experiments on physical hardware, and decide what to test next.
The best models scored 36.7% across a range of EE domains including mixed-signal circuits, power systems, & electromechanics.