Formalizing Numerical Analysis: An Agent Pipeline and Quality Audit Beyond Kernel Acceptance
Quick Answer
This study formalizes Numerical Methods for Ordinary Differential Equations using a coding agent in Lean 4, addressing gaps in existing mathlib.
Quick Take
A new evaluation framework reveals that traditional kernel acceptance metrics overstate formalization quality, uncovering issues like incomplete statements and added hypotheses.
Key Points
- Formalization focuses on a textbook largely absent from existing mathlib resources.
- Introduces a three-dimensional framework to evaluate formalization quality beyond kernel acceptance.
- Identifies recurring issues in formalizations, such as incomplete statements and added hypotheses.
- Suggests that compilation-based metrics significantly overstate the quality of formalizations.
- Provides a reproducible audit methodology for evaluating future autoformalization systems.
Paper Resources
Source Excerpt
arXiv:2606. 14000v1 Announce Type: new Abstract: Recent work has demonstrated that coding agents can formalize entire advanced mathematics textbooks in Lean 4, yet existing efforts concentrate on branches of mathematics already well-represented in mathlib and measure success solely through kernel acceptance.
We address both limitations by applying a coding agent to formalize Numerical Methods for Ordinary Differential Equations, a textbook in numerical analysis that is largely absent from mathlib, stressing the agent's capacity to develop new theory from scratch. …
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.AI
See more →HOBA: Hierarchical On-Policy Bidding Agents for Adaptive Online Advertising
HOBA (Hierarchical On-policy Bidding Agents) is a novel hierarchical reinforcement learning framework that enhances online advertising bidding systems by improving adaptability and reducing hyperparameter tuning costs. It utilizes a for hyperparameter inference, a SARSA agent for expert model selection, and a dynamic expert pool for bid execution, achieving a +3.6% increase in target cost during large-scale deployment and outperforming state-of-the-art baselines on AuctionNet.