ProgramGym: Scaling Training Environments for Long-Horizon Program Reproduction Agents
To address these challenges, we introduce ProgramGym, a framework consisting of Program-Env and Program-Agent for scalable training environments of long-horizon program reproduction agents.
ProofPaper ↗
Key points
- Coding agents are increasingly used to build programs from scratch as software engineers do rather than to resolve issues within a repository or to generate a repository from a given requirements document.
- Using this novel pipeline, we obtain 1,648 training environments spanning C, C++, Go, and Rust.
- Experiments on ProgramBench show that both Program-Env and Program-Agent improve performance on program reproduction.
- We will release the ProgramGym to support further research on coding agents that build programs from scratch.
Sources (2)
- [1]ProgramGym: Scaling Training Environments for Long-Horizon Program Reproduction AgentsarXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 9, 11:09 AM
To address these challenges, we introduce ProgramGym, a framework consisting of Program-Env and Program-Agent for scalable training environments of long-horizon program reproduction agents.
Coding agents are increasingly used to build programs from scratch as software engineers do rather than to resolve issues within a repository or to generate a repository from a given requirements document.
- [2]ProgramGym: Scaling Training Environments for Long-Horizon Program Reproduction AgentsHugging Face Daily Papers · Oct 9, 12:00 AM · same content
Extractive summary: sentences quoted from the sources.
Before this
- Oct 8, 2026Understanding Jev, the new model everyone is talking about
- Oct 8, 2026Beyond Imitation: A Framework and Benchmark for LLM-Assisted Peer Review
- Oct 8, 2026ConwayResearch/Underdog-Saluki-27B-1.0
- Oct 8, 2026SuperNav: An Agentic Navigation System for Any Task in Any Scene
- Oct 8, 2026VibeEdit: Image Editing with Canvas Instructions
- Oct 8, 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models
