{"article_url":"https://newsverum.com/fr/news/programgym-training-environments-coding-agents-arxiv-2026","block":{"columns":[{"key":"configuration","label":{"ar":"النموذج وإطار التشغيل","de":"Modell und Ausführungsrahmen","en":"Model and harness","es":"Modelo y configuración","fr":"Modèle et cadre","pt":"Modelo e estrutura","tr":"Model ve düzenek"},"language":"en","type":"text"},{"key":"test_pass","label":{"ar":"اجتياز الاختبارات (%)","de":"Tests bestanden (%)","en":"Tests Passed (%)","es":"Pruebas superadas (%)","fr":"Tests réussis (%)","pt":"Testes aprovados (%)","tr":"Test geçme (%)"},"type":"number","unit":"percent"}],"description":{"ar":"معدلات اجتياز الاختبارات لتركيبات النموذج وإطار الوكيل التي أبلغ عنها المؤلفون.","de":"Berichtete Test-Pass-Raten für die Modell- und Agentengerüst-Kombinationen der Autoren.","en":"Test-pass rates reported for the authors’ model and agent-scaffold pairings.","es":"Tasas de pruebas superadas comunicadas para las combinaciones de modelo y estructura de agente.","fr":"Taux de réussite rapportés pour les associations modèle et cadre d’agent des auteurs.","pt":"Taxas de aprovação em testes informadas para as combinações de modelo e estrutura de agente dos autores.","tr":"Yazarların model ve ajan-iskeleti eşleştirmeleri için bildirdiği test-geçme oranları."},"id":"programbench-test-pass","methodology":{"ar":"يعرّف ProgramBench هذا المقياس بأنه المتوسط الكلي لمعدلات اجتياز الاختبارات لكل مهمة. تثبت مقارنة Program-Env استخدام Claude Code؛ وتقارن نتيجة Program-Agent النموذج نفسه مع Claude Code أو Program-Agent. ولا يعني ذلك حل المهام بالكامل.","de":"ProgramBench definiert diesen Wert als Makromittel der Test-Pass-Raten pro Aufgabe. Beim Program-Env-Vergleich bleibt Claude Code gleich; beim Program-Agent-Vergleich wird dasselbe Modell mit Claude Code oder Program-Agent kombiniert. Die Aufgaben gelten damit nicht als vollständig gelöst.","en":"ProgramBench defines this metric as the macro-average of task-level test-pass rates. The Program-Env comparison holds Claude Code fixed; the Program-Agent comparison pairs the same model with Claude Code or Program-Agent. The tasks are not thereby fully solved.","es":"ProgramBench define esta métrica como el promedio macro de las tasas por tarea. La comparación de Program-Env mantiene Claude Code fijo; la de Program-Agent compara el mismo modelo con Claude Code o Program-Agent. Esto no significa que las tareas estén resueltas por completo.","fr":"ProgramBench définit cette mesure comme la moyenne macro des taux de réussite par tâche. La comparaison Program-Env maintient Claude Code fixe; celle de Program-Agent compare le même modèle avec Claude Code ou Program-Agent. Cela ne signifie pas que les tâches sont entièrement résolues.","pt":"O ProgramBench define essa métrica como a média macro das taxas de aprovação por tarefa. A comparação do Program-Env mantém o Claude Code fixo; a comparação do Program-Agent combina o mesmo modelo com Claude Code ou Program-Agent. Isso não significa que as tarefas tenham sido totalmente resolvidas.","tr":"ProgramBench ölçütü görev başına test-geçme oranlarının makro ortalamasıdır. Program-Env için Claude Code sabit tutulur; Program-Agent karşılaştırmasında aynı modelin Claude Code ve Program-Agent eşleştirmeleri yer alır. Bu görevler tümden çözülmüş sayılmaz."},"rowTranslations":[{"configuration":{"ar":"Qwen3.8-27B مع Claude Code، قبل الضبط الدقيق على مسارات Program-Env","de":"Qwen3.8-27B + Claude Code, vor dem Fine-Tuning mit Program-Env-Verläufen","en":"Qwen3.8-27B + Claude Code, before fine-tuning on Program-Env trajectories","es":"Qwen3.8-27B + Claude Code, antes del ajuste fino con trayectorias de Program-Env","fr":"Qwen3.8-27B + Claude Code, avant réglage fin sur les trajectoires Program-Env","pt":"Qwen3.8-27B + Claude Code, antes do ajuste fino com trajetórias do Program-Env","tr":"Qwen3.8-27B + Claude Code, sem ajuste fino nas trajetórias do Program-Env"}},{"configuration":{"ar":"Qwen3.8-27B-SFT مع Claude Code، بعد الضبط الدقيق على مسارات Program-Env","de":"Qwen3.8-27B-SFT + Claude Code, nach dem Fine-Tuning mit Program-Env-Verläufen","en":"Qwen3.8-27B-SFT + Claude Code, after fine-tuning on Program-Env trajectories","es":"Qwen3.8-27B-SFT + Claude Code, tras el ajuste fino con trayectorias de Program-Env","fr":"Qwen3.8-27B-SFT + Claude Code, après réglage fin sur les trajectoires Program-Env","pt":"Qwen3.8-27B-SFT + Claude Code, após ajuste fino com trajetórias do Program-Env","tr":"Qwen3.8-27B-SFT + Claude Code, após ajuste fino nas trajetórias do Program-Env"}},{"configuration":{"ar":"Qwen3.8-27B مع Program-Agent، النموذج الأساسي نفسه","de":"Qwen3.8-27B + Program-Agent, dasselbe Basismodell","en":"Qwen3.8-27B + Program-Agent, same base model","es":"Qwen3.8-27B + Program-Agent, mismo modelo base","fr":"Qwen3.8-27B + Program-Agent, même modèle de base","pt":"Qwen3.8-27B + Program-Agent, mesmo modelo-base","tr":"Qwen3.8-27B + Program-Agent, aynı temel model"}},{"configuration":{"ar":"Qwen3.8-27B-SFT مع Program-Agent، النموذج المضبوط نفسه","de":"Qwen3.8-27B-SFT + Program-Agent, dasselbe feinabgestimmte Modell","en":"Qwen3.8-27B-SFT + Program-Agent, same fine-tuned model","es":"Qwen3.8-27B-SFT + Program-Agent, mismo modelo ajustado","fr":"Qwen3.8-27B-SFT + Program-Agent, même modèle réglé","pt":"Qwen3.8-27B-SFT + Program-Agent, mesmo modelo ajustado","tr":"Qwen3.8-27B-SFT + Program-Agent, aynı ince ayarlı model"}}],"rows":[{"configuration":"Qwen3.8-27B + Claude Code, before fine-tuning on Program-Env trajectories","test_pass":34.87},{"configuration":"Qwen3.8-27B-SFT + Claude Code, after fine-tuning on Program-Env trajectories","test_pass":42.84},{"configuration":"Qwen3.8-27B + Program-Agent, same base model","test_pass":55.71},{"configuration":"Qwen3.8-27B-SFT + Program-Agent, same fine-tuned model","test_pass":56.25}],"sourceUrls":["https://arxiv.org/html/2610.13395v1"],"title":{"ar":"o","de":"a","en":"r","es":"r","fr":"g","pt":"m","tr":"P"},"type":"table","updatedAt":"2026-10-13T09:31:52Z"},"version":1}