Researchers outline a multi-session workflow for Olympiad agents
HOA combines independent review, structured knowledge notes and formal verification.
Event / data period: 2026-10-09
Published: · Updated:
Researchers introduced HOA, an open workflow that coordinates multiple agent sessions on difficult mathematics and science problems. It sends candidate solutions to an independent reviewer, supplies missing domain knowledge through a structured wiki, and checks Lean-formalized proofs with a trusted verifier.
The authors report solving 672 PutnamBench problems and 251 problems on Lean-Eval with HOA. Experiments also cover the official 2026 mathematics, physics, chemistry and programming Olympiad problem sets; scoring varies by field and uses human review, code tests or an LLM judge. The findings are limited to these tasks and evaluation procedures and do not establish general scientific-discovery ability.
Data
Measure
PutnamBench result in the paper's evaluation
| PutnamBench problems solved with HOA | 672 | PutnamBench result in the paper's evaluation |
Methodology
Values come from the paper's stated benchmark experiments; they are not field measurements or general performance guarantees.
Updated:
Measure
Lean-Eval result in the paper's evaluation
| Lean-Eval problems solved with HOA | 251 | Lean-Eval result in the paper's evaluation |
Methodology
Values come from the paper's stated benchmark experiments; they are not field measurements or general performance guarantees.
Updated:
Subjects and places
Subject proposals
- Science and technologySuggested
- Preserved editorial category/topic; broad candidate onlyarxiv.org ↗
Geographic references
Only source-provided geographic references are shown. Opening an external map is optional. Optional story maps use OpenStreetMap. Opening a map sends your IP address and this site’s address to the map provider; location data remains readable as text without loading the map.
- China · Place role: Coverage · Place type: Country or area · Location precision: RegionalEvidence
- Explicit preserved editorial country/region; no city or national centroid inferredarxiv.org ↗