commercial-assistants-show-large-accuracy-drop-when-relevant CLM-0033
mechanismsingle paperReviewed by AI and Russ Miller

Commercial assistants show a large accuracy drop when the relevant information sits in a long interaction history, especially for updates and multi-session reasoning.

Capability: Remembering across sessions

Sources

Reviewed by AI and Russ MillerLast checked: 2026-09-03Evidence activityHow much the field cites the sources under this claimvery heavily cited in the last 12 months517 in 12mo · 588 total — LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory
Either way, bring evidence: a link, or what you saw.

Disagreeing is the most useful thing you can do here. Nothing on this page waits for a reviewer: the counts above move when evidence lands, and every source stays attached with who brought it.

Related claims