Keyword Matters: Unveiling the Energy Sensitivity of On-Device LLM Prompting
Quick Answer
This study reveals that prompt design significantly impacts energy consumption in on-device LLMs, with specific linguistic features influencing decoding length and total energy usage.
Quick Take
By analyzing real power measurements from smartphones, the research highlights that imperative keywords and instruction structures can serve as effective tools for enhancing energy efficiency during inference.
Key Points
- Prompt wording affects energy consumption in on-device , particularly with imperative keywords.
- Real power measurements from smartphones were used to quantify energy differences across tasks.
- The study shows consistent energy variances across different verbs and tasks.
- Prompt engineering is identified as a lightweight method to enhance energy efficiency.
- Model compression and runtime acceleration have been widely studied, but prompt design remains underexplored.
Paper Resources
Source Excerpt
(LLMs) are increasingly deployed on mobile and embedded devices to improve privacy and reduce network latency. Yet on-device inference faces a fundamental constraint: high energy consumption on battery-powered, resource-limited hardware. While model compression and runtime acceleration have been widely studied, the effect of \emph{prompt design} on energy efficiency remains underexplored. This paper presents an empirical study of the relationship between prompt wording and
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.AI
See more →AINTMA: Agentic AI Architecture for Autonomous Test Management with Generative Intelligence, Secure Cloud Communication and Adaptive Quality Analytics
AINTMA, an autonomous test management architecture utilizing six specialized AI agents, achieves 88.4% test prioritization accuracy and reduces defect escape rates from 8.3% to 2.1%. The system demonstrates a 340% ROI within nine months, showcasing the potential of agentic AI in enhancing software quality management in cloud environments.