ProgramGym builds 1,648 verifiable training environments for coding agents

Researchers from Xiamen University and other institutions introduced ProgramGym, a framework for training coding agents to inspect a program’s behavior and reproduce it from scratch. In the preprint submitted to arXiv on October 9, Program-Env creates training environments with executable reference programs, isolated sandboxes, usage documentation and black-box tests. The authors report building 1,648 environments in C, C++, Go and Rust. Program-Agent then separates analysis, implementation and review into distinct roles, with compilation checks and recovery checkpoints between iterations.

On ProgramBench, the authors report that fine-tuning Qwen3.8-27B on trajectories from the generated environments raised its test-pass result from 34.87% to 42.84%. With Program-Agent, the base model scored 55.71% and the fine-tuned version 56.25%. The paper defines test pass as a macro-average of task-level pass rates, so these figures do not mean every task was solved. The results concern the authors’ program-reproduction tasks and stated tool setup; they are not a measure of general coding ability.