GenesisFunc: Multi-Agent Data Generation for Accurate and Generalizable Function-Calling
Quick Take
GenesisFunc introduces an automated multi-agent pipeline for generating high-quality function-calling (FC) training data, outperforming existing models in both in-domain performance and out-of-domain generalization. Fine-tuned on an 8B LLM, it demonstrates comparable FC capabilities to leading API-based models, addressing challenges of diversity and quality in synthetic data generation.
Key Points
- GenesisFunc employs a multi-agent framework for diverse dialogue generation.
- Fine-tuned 8B LLM outperforms similar-sized open-source models in FC tasks.
- Demonstrates strong scalability potential across various downstream tools.
- Multi-stage evaluation system enhances data accuracy and quality.
- Addresses challenges of limited diversity and weak quality control in synthetic data.
Article Content
From source RSS / original summaryarXiv:2605. 28835v1 Announce Type: new Abstract: Large Language Models (LLMs) extend their capabilities through function-calling (FC), which relies on training data with high quality, diversity, and broad coverage of scenario. However, obtaining and annotating real function-calling data is challenging, while synthetic data from existing pipelines often suffers from unreliable APIs, limited tool scalability, insufficient diversity, and weak quality control.
To address these, we present GenesisFunc, an automated pipeline for generating FC training data. Starting from reliable tools in widely used public benchmarks, our GenesisFunc employs a multi-agent framework to support a dialogue generation system that produces conversations spanning diverse scenarios, while maintaining both diversity and quality throughout the process. The accuracy of the data is further reinforced through a multi-stage evaluation system.
We fine-tune an 8B LLM on the synthetic dataset and show through extensive experiments that it outperforms similarly sized open-source models in in-domain FC performance and out-of-domain generalization, while reaching FC capabilities comparable to some of the latest API-based models. In addition, our method demonstrates strong potential to scale effectively across downstream tools, underscoring its real-world applicability.
Reader Mode unavailable (could not extract clean content).
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CL
See more →Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
The reliability of LLM judges for evaluating deep research agents is critically assessed using the REFLECT benchmark.