TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter
Quick Answer
This paper shows that The Task-Aware Prompt Rewriter (TAPR) enhances LLM performance by reformulating prompts for tasks like question answering and summarization.
Quick Take
Trained with reinforcement learning, TAPR shows consistent improvements over base models, achieving higher accuracy on benchmarks such as Natural Questions and GSM8K. The code is available for further exploration.
Key Points
- TAPR reformulates user prompts into task-optimized versions for better performance.
- Utilizes for training with LLM-as-judge evaluations.
- Demonstrated consistent gains in prompt rewriting across various tasks.
- Fine-tuning Phi-4-mini-instruct leads to clearer, more instructive prompts.
- Achieved higher accuracy on benchmarks like Natural Questions and GSM8K.
Paper Resources
Source Excerpt
(LLMs) often require carefully crafted prompts to unlock their full potential, which can be a barrier for non-expert users. This work addresses the challenge by introducing a Task-Aware Prompt Rewriter (TAPR), a model that reformulates user prompts into task-optimized prompts with the explicit goal of improving downstream LLM performance. We train TAPR using reinforcement learning with (GRPO), where rewards are derived from LLM-as-judge ev
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.AI
See more →HOBA: Hierarchical On-Policy Bidding Agents for Adaptive Online Advertising
HOBA (Hierarchical On-policy Bidding Agents) is a novel hierarchical reinforcement learning framework that enhances online advertising bidding systems by improving adaptability and reducing hyperparameter tuning costs. It utilizes a for hyperparameter inference, a SARSA agent for expert model selection, and a dynamic expert pool for bid execution, achieving a +3.6% increase in target cost during large-scale deployment and outperforming state-of-the-art baselines on AuctionNet.