Technology / WORLD

NVIDIA describes NeMo Gym evaluation for a chip-design agent

In a development benchmark reported by NVIDIA, Siemens EDA cut agent turns from 155 to 53 while raising the composite verification score from about 55% to 95%.

Reading sizeSources ↓Share story ↗
Conceptual illustration of technology, processors and connected information.Illustration
Symbolic illustration

NVIDIA said Siemens EDA used NeMo Gym to test Liberty files generated by its Fuse EDA AI agent during standard-cell characterization. A verifier checked cell and operating-condition coverage, file validity, and whether timing and power values met tolerance. The team reviewed failures in those checks and iteratively changed the agent's skills and Model Context Protocol tool descriptions.

In the development benchmark NVIDIA reported, the composite verification score rose from about 55% to 95%, agent turns fell from 155 to 53 and output tokens declined from about 81,000 to 29,000. The setup covered 229 cells and 36 process conditions from the open GF180MCU process design kit, while agent-tuning runs evaluated two cells; the team conducted about 25 iterations. These are NVIDIA and Siemens' results on representative tasks, not a general measure of chip-design productivity.

Data

Key figures

Measured changes for the Siemens EDA agent

Approximate score and workflow counts reported by NVIDIA for its standard-cell-characterization benchmark.

Composite verification score, before
≈55 percent
2026-10-14 · Observed
Composite verification score, after
≈95 percent
2026-10-14 · Observed
Agent turns, before
155 count
2026-10-14 · Observed
Agent turns, after
53 count
2026-10-14 · Observed
Output tokens, before
≈81,000 count
2026-10-14 · Observed
Output tokens, after
≈29,000 count
2026-10-14 · Observed
Methodology

Before-and-after values reported in NVIDIA's 14 October 2026 Siemens EDA case study after refining agent skills and MCP tool descriptions. The benchmark used 229 standard cells and 36 PVT corners from the GF180MCU PDK; agent-tuning rollouts evaluated two cells. Results are vendor-reported development-benchmark figures for representative tasks.

Updated:

Structured coverage

Subjects and places

Subject proposals

Taxonomy version: IPTC Media Topics 2026-Q2

Continue reading