ANNEAL: Adapting LLM Agents via Governed Symbolic Patch Learning
arXiv cs.AI·Safayat Bin Hakim, Keyan Guo, Wenkai Tan, Alvaro Velasquez, Shouhuai Xu, Houbing Herbert Song
1d agoQuick Take
ANNEAL introduces a neuro-symbolic approach for governed symbolic patch learning to eliminate recurring faults in LLM agents.
Key Points
- Transforms failures into symbolic edits without altering model weights.
- Employs Failure-Driven Knowledge Acquisition for effective fault localization.
- Achieves 0% holdout failure rates in tested scenarios.
📖 Reader Mode
~2 min readAbstract:LLM-based agents can recover from individual execution errors, yet they repeatedly fail on the same fault when the underlying process knowledge--operator schemas, preconditions, and constraints--remains unrepaired. Existing self-evolving approaches address this gap by updating prompts, memory, or model weights, but none directly repair the symbolic structures that encode how tasks are executed, and few provide the governance guarantees required for safe deployment. We introduce ANNEAL, a neuro-symbolic agent that converts recurring failures into governed symbolic edits of a process knowledge graph without modifying foundation model weights. Its core mechanism, Failure-Driven Knowledge Acquisition (FDKA), localizes the responsible operator, synthesizes a typed patch through constrained LLM generation, and validates the proposal via multi-dimensional scoring, symbolic guardrails, and canary testing before commit. Every accepted edit carries full provenance and deterministic rollback capability. Across four domains and 27 multi-seed runs, ANNEAL is the only evaluated system that commits persistent structural repairs--strong baselines such as ReAct and Reflexion achieve high episodic recovery yet retain 72-100% holdout failure rates on recurring faults, whereas ANNEAL reduces these to 0% in the tested recurring-failure settings. Ablation confirms that removing FDKA eliminates all structural repairs and drops success rate by up to 26.7 percentage points. These results suggest that governed symbolic repair offers a complementary paradigm to weight-level and prompt-level adaptation for persistent fault elimination.
| Comments: | Code Implementation: this https URL |
| Subjects: | Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA) |
| Cite as: | arXiv:2605.16309 [cs.AI] |
| (or arXiv:2605.16309v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2605.16309 arXiv-issued DOI via DataCite |
Submission history
From: Safayat Bin Hakim [view email]
[v1]
Mon, 4 May 2026 05:24:03 UTC (602 KB)
— Originally published at arxiv.org
More from arXiv cs.AI
See more →1d ago
FeaturedOriginal
From Prompts to Protocols: An AI Agent for Laboratory Automation
AI Summary
An AI agent integrates large language models for automating laboratory protocols, enhancing efficiency and accuracy.